Data processing with .NET for Apache Spark
Build with an Azure free account. Get USD200 credit for 30 days and 12 months of free services.
Start free todayScaling .NET for Apache Spark processing jobs with Azure Synapse
Play Scaling .NET for Apache Spark processing jobs with Azure Synapse
Description
When you are processing gigs or terabytes of data, it's important to have resources that will help you scale to fit your data processing needs.
In this episode, Brigit Murtaugh joins us again to show us how Azure Synapse can help us power our .NET for Apache Spark data processing jobs.
- [01:55] - Azure?
- [03:30] - Which Azure service do you choose?
- [T04:52} - Running on Azure Synapse
- [11:35] - Inspecting Spark job results
- [13:00] - Using Notebooks tin Azure Synapse
- [16:59] - Using ML.NET with Apache Spark
Useful Links
- .NET for Apache Spark
- .NET for Apache Spark documentation
- .NET for Apache Spark 101 videos
- .NET for Apache Spark on GitHub
- An Introduction to DataFrame
Download
More episodes in this series
DevOps for ASP.NET Developers: GitHub Actions
Related episodes
Data processing with .NET for Apache Spark
Training Machine Learning models with ML.NET
Using External Configuration with Spring Cloud Config and Steeltoe
Adding a little Swagger to OData
Using Redis as a .NET Core Data Store
ASP.NET Core Series: Getting started with the Worker templates
Working with the new Microsoft.Data.SqlClient
Blazor and Customizing the OData entity model
Machine Learning with ML.NET 1.0 from Build 2019
Securing Services with MSAL
