I imagine the existing SL can have HW acceleration because of WinRT? You can have a much smaller SL plug-in running as an interop to WinRT. In this case, SL can link to WinRT and have automatic HW acceleration without having SL plug-in to talk to DX directly.

This is a wild idea of course, I have no idea if this is possible.