Getting Your Apps Connected with Networking APIs
Description
Building a global scale telemetry pipeline used to be the preserve of the largest internet companies, but today it is common for even moderately sized businesses to receive a high volume of telemetry across the world. The cloud and Internet of Things are making this even more common. This session will cover building a global scale telemetry pipeline on Azure Event Hubs and including how to size and plan for your platform. We will show and discus how we see customers successfully create telemetry pipelines that can handle billions of events per day all around the world. Speaker: Dan Rosanova
Download
Download this episode
- MP3 (37.0 MB)
- Low Quality MP4 (44.2 MB)
- Mid Quality MP4 (77.8 MB)
Event Homepage
Build 2015More episodes in this series
Azure Storage Performance, Scalability and Security
Related episodes
Be an integration superhero with Azure and build API-enabled and connected enterprises
Streaming Big Data in Azure with Kafka and Event Hubs
Azure Event Grid: Powering serverless through eventing
Messaging in Azure: Event Hubs, Service Bus, and Relay
Azure Messaging: When to use what and why
How we serve 3 Trillion requests per week with Event Hubs
Implementing high availability and disaster recovery in cloud messaging solutions
Get an Azure Event Hubs & Service Bus feature update
Premium Messaging & Messaging Scale
WTF is happening in my telemetry pipeline: how to monitor and debug your Event Hubs…
The Discussion
-
Borum.NET A very valuable and thorough presentation on key aspects of Event Hubs (and Stream Analytics). I like the work stealing algorithm implemented in the EventProcessorHost API - there's a lot of coordination going on which usually is an obstacle for a large group of developers.
I'm wondering if one can pipe events from the EventHub to Azure storage and use the EventProcessorHost in parallel (over the same stream of events). So computation and storage at the same time - using an Azure provided service for storage, and a custom impemented EventProcessorHost.
-
Rosanova Indeed! Event Hubs is designed to have multiple groups of readers (consumer groups) each read the entire stream. This way you can have different paths for your data running in parallel and each at their own pace.