Designing and Sizing a Global Scale Telemetry Platform on Azure Event Hubs

The Discussion

• 

  A very valuable and thorough presentation on key aspects of Event Hubs (and Stream Analytics). I like the work stealing algorithm implemented in the EventProcessorHost API - there's a lot of coordination going on which usually is an obstacle for a large group of developers.

  I'm wondering if one can pipe events from the EventHub to Azure storage and use the EventProcessorHost in parallel (over the same stream of events). So computation and storage at the same time - using an Azure provided service for storage, and a custom impemented EventProcessorHost.

• 

  Indeed! Event Hubs is designed to have multiple groups of readers (consumer groups) each read the entire stream. This way you can have different paths for your data running in parallel and each at their own pace.