You right in that something (not sure exactly what) just isn't "right" with Windows Media.

As another data-point, the new WinForms "sound" control in Visual Studio 2005 does not support WMA files.