I have nearly 50 Gb of photos on my PC, most of which I do not care to upload to iCloud as I have them backed up. I certainly don't want them on my iPhone. Can I control which ones are uploaded?
I would suggest doing a cleanup. If you know you have pictures you don't want on the phone, you could get rid of those photos or move them to a different location.