Sometimes warnings will come up in the description if its incompatible.
That or just read the description, some of them include for iOS 3.x, 4.x, and or 5.x
And as 3cit said. Worst case scenario, you restore your phone. More than likely though you'll just spring into safe mode and be able to delete it.