That was indeed the problem. On the "Publish Web" dialog there is a "Setting" section that I could enter and selection Configuration="Debug". I didn't guess that I needed to go there, since the Configuration Manager settings for my application were set to Debug. And unfortunately this step wasn't a step that was shown on the Video.
But other than that the video was awesome and VStudio 2013 is working great.
Thanks again for the help.