Build with an Azure free account. Get USD200 credit for 30 days and 12 months of free services.

Start free today

Data ingestion, stream processing and sentiment analysis pipeline using Twitter data example

Sign in to queue

Description

Follow the conversation between Lena and Suz and learn about setting up a data ingestion and processing system consisting of event producer, reliable event aggregation and consumer using Twitter client, Event Hubs and Spark on Azure Databricks as an example. Lena and Suz are also discussing alternative options for stream processing, and how it can be used for various scenarios, including IoT, and how to apply machine learning to streaming data by showing an example of sentiment analysis on tweets coming in real-time.

Useful links:
https://lenadroid.github.io/posts/connecting-spark-and-eventhubs.html
https://lenadroid.github.io/posts/offset-enqueuetime-spark-eventhubs.html
https://lenadroid.github.io/posts/sentiment-analysis-streaming-data.html

Create a Free Account (Azure)

Embed

Download

The Discussion

Add Your 2 Cents