Have you looked at the Note Pro?
The only reason I gave it up was that it got smashed and destroyed and it was going to take $$$ and too long to fix, so I went back to iPad, but the Note Pro is a good tablet.
I used it for work, drawing plans for job estimates (construction business), keeping track of jobs, hours, expenses and income, I used it for school, took notes, wrote papers, took tests, I used it for my other job (environmental studies) and again took notes, pictures, created documents, though the best part was being able to have 4 screens to work with at once.
I did experience a little lag at times, I don't know if that's been addressed.
Also because of TouchWiz, there's a possibility that the Lollipop update completely wrecked it, Samsung is known for that.
But with the OS it shipped out with, it was a solid tablet.
It certainly sounds like iPad is not the tablet for you.
Personally I won't go back to Android, I've found what works for me in Apple, but you might want to try the Note Pro.
You sound more like an Android kinda guy.