Nevermind, I was able to get it figured out. I used the Bootstrapper Manifest Generator to create my manifest, and through some trial and error figured out where to copy the needed files to in the publish location.

I'm really surprised that MS hasn't built this into the Publish section in VS, as it has to be a pretty common scenario.