Data processing with .NET for Apache Spark
Build with an Azure free account. Get USD200 credit for 30 days and 12 months of free services.
Start free todayScaling .NET for Apache Spark processing jobs with Azure Synapse
Play Scaling .NET for Apache Spark processing jobs with Azure Synapse
Description
When you are processing gigs or terabytes of data, it's important to have resources that will help you scale to fit your data processing needs.
In this episode, Brigit Murtaugh joins us again to show us how Azure Synapse can help us power our .NET for Apache Spark data processing jobs.
- [01:55] - Azure?
- [03:30] - Which Azure service do you choose?
- [T04:52} - Running on Azure Synapse
- [11:35] - Inspecting Spark job results
- [13:00] - Using Notebooks tin Azure Synapse
- [16:59] - Using ML.NET with Apache Spark
Useful Links
- .NET for Apache Spark
- .NET for Apache Spark documentation
- .NET for Apache Spark 101 videos
- .NET for Apache Spark on GitHub
- An Introduction to DataFrame
Download
More episodes in this series
DevOps for ASP.NET Developers: GitHub Actions
Related episodes
Data processing with .NET for Apache Spark
Training Machine Learning models with ML.NET
Modern Entity Framework: A Tour of EF Core 5.0 pt 1
GraphQL Schema Design
Customizing the Graph SDKs
Authentication with Graph SDKs
GraphQL Schema stitching
Real-time Data fetching with GraphQL and Blazor
.NET Microservices with DAPR
Using External Configuration with Spring Cloud Config and Steeltoe
