You can indeed downgrade, I did it. I had to restore from an old backup but it can be done.
How to Downgrade from iOS 7 Back to iOS 6 on your iPhone : iPad - YouTube
How to Downgrade from iOS 7 Back to iOS 6 on your iPhone / iPad - TheUnlockr
iClarified - iPhone - Where To Download iPhone...