I do, as it happens. My own particular weapon of choice is Livescribe
I type about the same speed I write but, as you say, diagrams and doodles are much easier with a pen.
I'll start with the disadvantages:
You have to use their own paper and notebooks which can be a little expensive but well worth it in my opinion. They do a whole range of notebooks which cover just about everything you should need (I use the Moleskins). If you have access to a laser printer you can print your own paper for Livescribe, but I reckon it would be cheaper to buy the notebooks. The notebooks also have the added advantage of having a calculator printed on the inside cover, which means you can tap in calculations on the fly and have the results displayed on the pen.
The pen also has a microphone which starts recording when you tap an icon on the bottom of the page. Tap it and keep writing. When you upload the notes to your Livescribe Desktop application (PC or Mac), you'll notice that some of your scrawl is shown on the page in green. Click the mouse over the green bit and your lectures dulcit tones will play out through your speakers. Really useful; you don't miss a thing. You can run any number of notebooks at the same time, and the pen will keep track of what was written in which book, so they always get loaded up to the right notebook on the Livescribe desktop application.
It can search for words in hand-written notes, just like Evernote and OneNote can, and if that wasn't enough, it has an addon which allows you to OCR your notes into editable RTF files.
Buy it already.