It is one extra step. One step. You are blowing this way out of proportion. One step. One time. If you have a pair of head phones or a special audio jack that you use you only need to place the dongle on once. Then leave it there. That's like complaining about plugging a charger in. Or flipping a light switch when you enter a room. That is literally the amount of time in your life you spend plugging in a dongle. It is one second out of your life that you are slightly inconvenienced.
You forgot that it's not just headphones. I have an additional 3 other devices that use that port. Only one has been verified as working with the adapter, and even if the others do it will be troublesome to do so the way they are designed. As posted through an external article in another thread, Walt Mossberg, a well respected Apple reviewer also called it a bad move that is annoying and negative. I respect you are only "slightly inconvenienced", but you can't force that viewpoint on others.