How do I delete Apple's built-in / preset wallpapers?

Apple's bundled wallpapers can't be removed from the system — they reappear after every iOS update. You can hide them by removing them from Photo Shuffle albums or by sticking with custom photos.