There’s a bug in Apple’s Remote app for iOS 8. It doesn’t display album art for the currently playing track. It does, however, display art if you tap Up Next.
This is a bit annoying. I hope Apple fixes this soon, because I do like to see the album art when I’m listening to music and using the Remote app.
Just another bug in iOS 8…