@Harlequin: Select an artist or a song in the collection view and type something. See what happens. Unfortunately it's broken for albums and videos since release 3.2 (I think).
@contextfree`: What's the problem with classical music? I don't have any and find the experience to be like that with CDs.
@magicalclick: Tag your files properly. There are fields for artist (TPE1) and album artist/band (TPE2). Set artist to the artist of the track and band to "Various Artists" and they'll show up correctly in the software and on the device/phone. For properly tagging sampler discs you can also set the compilation tag (TCMP) to "1" even though that is not required.