Winterboard, SBSettings, or anything draining system resources.
Your stored media could also cause longer load times. This isn't proven.
You could also look into a Jailbreak app like Snappy.
A lot of people are having this issue especially with ios4.
I just keep it multitasking while I am out using it. LIKE AT THE 2011 RENAISSANCE FAIRE IN BRISTOL, WI.