After more than 15 years covering everything Apple, it’s with a heavy heart we announce that we will no longer be publishing new content on iMore and the iMore forums will be closing as of November 1st, 2024.
If you're referring to the music app, click on the 3 dots to the right of the album name & select remove download. If you're talking about photo albums, go to photos > albums then click edit in the top right corner. An x will appear on the albums you're able to delete.