Sounds to me like it could be a bad battery or maybe some wildly inconsistent usage between the two scenarios. It's really, really hard to control the variables--from day to day even in the same area, your phone may have very different power requirements for talking to the cell towers (e.g. suppose the tower nearest you were down for maintenance, your phone would have to crank up the radio power to talk to the next farthest tower, etc.)
If you notice this very consistently, even though your usage doesn't vary drastically, you may want to have it checked out at an Apple Store if possible. Grab some data points, keep track of roughly how long you're using it, for what, and where, and see if any patterns arise.
I notice my phone drains very quickly around lunch time, because I tend to go out to eat at a place where the signal is really low and I flip through a lot of Flipboard and twitter, which load heavy gifs and web pages and ads and whatnot.
Incidentally, low power mode used to prevent night shift from turning on. I wonder what the power impact of night shift actually is.