I once read that turning off IntelliTrace can speed things up.

EDIT: And while we are complaining about VS... When will MS fix VS so Debugger Visualizers work with Windows Phone development? The argument that debugger visualizers require a different security model is bogus when you realize the debugger has access to all the same objects and data that the debugger visualizer is trying to display. Just saying...