I had an issue where my iPhone didn't pair with my vehicle. Couldn't figure why it wouldn't pair. One day I happened to look at my Note 4, which is my second wifi only device, and saw that it was paired with my vehicle. It was paired before but never removed the pairing. SO I deleted the pairing of my Note 4 and my iPhone instantly paired.
Now I gave this information to ask if maybe your husbands phone is blocking your iPhone from pairing to the device? Try and have him turn off his Bluetooth on the iPhone and see if that is the issue. If not, try re-pair the device to the speaker.