Press and hold on the app until they all begin to jiggle. Afterwards, tap on the "X" next to the app you want to delete. This will remove the app from the device, but not from your account. It will be readily available to reinstall via the purchased section of the App Store. If you're trying to delete a native app, you can't do that natively...
