Restore. That is really the only way to ensure you don't run into future issues. Also, make sure to set it up as a "New iPhone" and not restore using a backup.
It cleans itself after some time. When it does, the icon will be greyed out and it will say "cleaning...". You used to be able to delete an individual apps data in early builds of the iOS 5 beta.