Giving Hadoop a Microsoft-class UI with HDInsight and Datameer

In this week's episode of Data Exposed, Scott welcomes Anand Subbaraj, Senior Lead PM on the Azure Data Factory team. Today Anand introduce us to Data Factory, a new Azure service for data developers & IT professionals to easily transform raw data into trusted data assets for their organization at scale. Data Factory operates over a range of data services, and supports processing of on-premises SQL Server, Azure SQL Database, Blobs, and Tables using Hive, Pig, and C# on HDInsight (Hadoop). Easily create and orchestrate simple, highly available, fault tolerant data analytics pipelines that can be monitored at a glance with the Azure Preview Portal. Competitive, data-driven organizations are collecting, processing and gaining insight from more data than ever before. Use data pipelines to deliver transformed data from the cloud back to on-premises sources like SQL Server, or keep it in cloud storage. Take advantage of seamless connection with Power BI for O365 and other applications for consumption of data assets.
Very informative session. Got a nice overview of Azure Data Factory
Great vision but seems to be code heavy at this time which could be an adoption blocker.
Seems to be an adequate replacement for SSIS.
But how about the custom activities, can you somehow debug them? Or can you just deploy them online in a blob storage and then you have to cross your fingers?
Haven't tried it yet.
Thanks!
Very nice addition to Azure data platform. Looking forward to try it with current data streams in my environment.
This conversation has been locked by the site admins. No new comments can be made.