double tap the home button, then hold over app.. then a delete icon will come up.. they'll you'll remove them just like you do an app on the home screen. I clear mine out about once a day..
To easy your mind a little though, those apps showing aren't doing anything. They're just there so you can get to them quickly. Since you have used them, it's possible you might want to use them again.