Click on iBooks, go to your "Books" section, and then click the "Select" button at the top right. Click on the books to select them, and then in the top left corner there will be a delete button. Click it and it will ask you if you want to remove from this device device or all device connected to your iCloud account. Choose remove from all and it should go away.