I ran into the "System.InvalidOperationException: Cannot load the X.509 certificate identity specified in the configuration." error as well. At that point I added the <dns value="localhost"/> to any identity section that was missing it.
I then got another error. The erro was:
"Please try changing the HTTP port to 8732 or running as Administrator. System.ServiceModel.AddressAccessDeniedException: HTTP could not register URL http://+:8080/evalservice/. Your process does not have access rights to this namespace"