It really depends which smart home devices you have. If you recently bought a Philips Hue starter kit, or an August Smart Lock, for example, you're already good to go. There are special "works with HomeKit"-type logos on boxes of products that are compatible with HomeKit. A big part of HomeKit is hardening the security of these home automation systems with end-to-end encryption; that's why some of your existing hardware isn't compatible.