Issue: How to Write Web Activity Output OR Azure Function Json Output to Azure Blob Storage - ADF Tutorial.
In this article, we are going to learn how to write web activity output or Azure function JSON output to Azure Blob storage, in this scenario we are going to get data from a website, that provides the free Dummy JSON data, so I have copied the web link and then get data from that link then write it to the blob storage. let's start our demonstration.
Open your Azure data factory studio, go to the Author tab, click on + sign to create a new pipeline, find and bring the Web activity, click on the settings tab, paste the copied web link, in the method select Get, as we are getting the data from this web link.
Find and drag the set variable activity, connect with the web activity, go to the Variables tab, select the variable that we created, then in the value click on Add dynamic content and select the web activity then add the curly brackets in the expressions.
Find and bring the copy data activity, connect with the set variable activity, go to the source tab then click on the + New button to create a new source dataset.
Select Azure blob storage then click on continue.
Select the file format as CSV, then click on continue.
Name your dataset, select the linked service pointing to your blob storage, and then create a template file in your blob storage and then select that file, as we will write the data in that template file, for import schema select from connection/store, then click on ok.
In the Source tab click on the + New button and create an additional column, then provide the column name and in the values, click on ad dynamic content and select my variable.
Once we are done with our source tab, go to the sink tab, click on the + New button to create a new sink dataset.
Select Azure blob storage then click on continue.
In the sink tab click on the Open button and provide the output file name, then in the escape character select No escape character, and in the Quote, character select No quote character.
Next, go to the mapping tab, click on import schemas, it will bring the column in the template file, select the column and click on delete, leave the second column which we have created in the additional column, then we are good to go, click on Debug to execute the piepline.
Video Demo: How to Write Web Activity Output OR Azure Function Json Output to Azure Blob Storage - ADF Tutorial