Global real-time multi-user apps with Azure Cosmos DB
Build with an Azure free account. Get USD200 credit for 30 days and 12 months of free services.
Start free todayRun Azure Functions from Azure Data Factory pipelines
Description
Azure Functions is a serverless compute service that enables you to run code on-demand without having to explicitly provision or manage infrastructure. Using Azure Functions, you can run a script or piece of code in response to a variety of events. Azure Data Factory (ADF) is a managed data integration service in Azure that enables you to iteratively build, orchestrate, and monitor your Extract Transform Load (ETL) workflows. Azure Functions is now integrated with ADF, enabling you to run an Azure function as a step in your data factory pipelines.
- Azure Function activity in Azure Data Factory (docs)
- Azure Functions now supported as a step in Azure Data Factory pipelines (blog post)
- Azure Data Factory (docs)
- Azure Data Factory (overview)
- Azure Data Factory pricing
- Create a free account (Azure)
Follow @SHanselman Follow @AzureFriday Follow @DataAzure
Share
Download
More episodes in this series
Using HashiCorp Consul to connect Kubernetes clusters on Azure
Related episodes
Monitor your Azure Data Factory pipelines proactively with alerts
Hybrid data movement across multiple Azure Data Factories
Parameterize connections to your data stores in Azure Data Factory
Enhanced productivity using Azure Data Factory visual tools
Azure Data Factory visual tools now integrated with GitHub
Event-based data integration with Azure Data Factory
Visually build pipelines for Azure Data Factory V2
Azure Instance Metadata Service updates for attested data
Anomaly detection using machine learning in Azure Stream Analytics
Quickly build data integration pipelines using templates in Azure Data Factory
The Discussion
-
Leo Scott Link don't work
ie https://azfr/513/01 does not work -
robcaron @Leo Scott: Thanks Leo - all fixed. Error between keyboard and chair.
-
Maryam can we run python azure functions in azure data factory? My current function (written in python) does not return any value; it saves the output in datalake (csv file). When I tried to run the function on data factory I got following error: { "errorCode": "3600", "message": "Error calling the endpoint.", "failureType": "UserError", "target": "Azure Functiontest".
-
Jon Same error with javascript function using function key.
-
MarkoOja Same for us. C# function. interesting is that the function actually executes correctly but it still gives an error. Kind of a problem for production environment to determine if it really worked or not.
-
Gin Having exactly same issue. Even by chaing return value to JObject type, still shows incorrect Failed message.
-
Arul Hey guys,
Sorry to hear that you are facing issues. I will need more information about your Azure Function Apps to investigate and see how I can help you with this. Please reach out to me at arsunda@microsoft.com and we can look into this further -
JoostvR To make our .Net code in Azure Functions work for Azure Data Factory we did need to change the return type of the function. Here is my example for that: https://microsoft-bitools.blogspot.com/2019/01/introducing-azure-function-activity-to.html -
Matias Hi guys, in which part of the data factory can you extend the timeout-response feature? My AzureFunctionActivity runs for 3.8 minutes (230 sec) and fails. It shows "Error calling the endpoint", and other functions that are almost the same but shorter, run perfectly.