I have several screens with my most used app icons, set only to two rows at the top, other than the dock. That way I can see the wallpaper (a lake scene). The rest of my apps are grouped into the following categories...
Then, I have a couple folders for related web site shortcuts. On the iPhone, with folders that have a more limited app content than the iPad, the overflow folders are given a numerical designation (ex: Office 1, Office 2). Within folders, I try to arrange the icons according to the way I use them. Very useful!!
I've used these same categories for quite a while, even on past smartphones. They seem to cover all bases - for me, anyway.