Scheduling jobs in Azure Data Factory.

Azure Data Factory Scheduling

Setup the resources for this tutorial

Create resources

  • Create a Blob Storage
    • Create two containers input and output
    • Upload a CSV file to input
  • Create a Data Factory
    • Create a Linked Service to Blob
    • Create a Dataset for Blob input with the filepath pointing at the CSV uploaded file
    • Create a Dataset for Blob output with filepath pointing at the output container
    • Create a pipeline with a Copy Activity with source/sink set to the input/output datasets
    • Click Debug to test the initial setup

Set parameters for the datasets

  • In the Input dataset
    • Create a parameter