I actually found the solution myself.
When you create a WCF Service Library project it adds an app.config to the project. To host the service you have to copy the contents of the app.config to the host projects app.config.
The presence of an app.config (even if empty) in the service project triggers the launching of the WCF Service Host. I deleted the app.config from the service project and it stopped loading.