Scaling .NET for Apache Spark processing jobs with Azure Synapse
Episode 181: Azure Data Factory and Big Legacy Data with Shweta Gupta
Play Episode 181: Azure Data Factory and Big Legacy Data with Shweta Gupta
Description
In this special episode Lara Rubbelke is joined by Shweta Gupta, a Technical Evangelist at Microsoft. Shweta joins the show to talk about her experience helping a healthcare customer solve a big legacy data problem with Azure Data Factory. In this scenario, they wanted to use Streaming Analytics but needed to figure out how to get legacy data into the system.
Links from the show:
- [00:39] - Introductions
- [01:37] - What is Big Legacy Data?
- [05:44] - Parsing vs Transforming data
- [10:10] - Why Azure Data Factory?
- [11:10] - Demos
- Solving the Big Legacy Data problem with Azure Data Factory
- Transformation of XML to JSON on GitHub
- Custom Data Activities with ADF
Follow @CloudCoverShow
Follow @chrisrisner
Follow @haishibai2010
Follow @sqlgal
Follow @shwetastweets
Download
Right click or Alt+Enter to download this episode
- MP3 (19.0 MB)
- Low Quality MP4 (50.3 MB)
- Mid Quality MP4 (186.5 MB)
The Discussion
-
Joe Why can't I see the code!?!?! All we can see is two people looking at a laptop :(
-
shwetagupta @Joe: Sorry about that! It comes a little later. From 13:00 minute onward.
Conversation locked
This conversation has been locked by the site admins. No new comments can be made.
Related episodes
Data processing with .NET for Apache Spark
Making the case for AI, chat bots, and Power BI
Finding parking spots with Custom Vision and IoT
Streaming and Batching with the Cosmos DB SDK for .NET
Lesser known features of the Cosmos DB SDK for .NET
Azure Event Hubs supported Protocols
Authentication and authorization options for Azure Event Hubs
Understanding the Event Processor Host in Azure Event Hubs
Messaging with Azure Event Hubs
