How to schedule a pipeline

This topic describes how to schedule pipeline executions to run at specific intervals. The pipeline can be scheduled in two ways:

Basic: To schedule the execution of the pipeline based on a particular frequency and for a particular interval of time.
Cron Expression: Cron Expression is used to schedule the execution of your pipeline. The Cron Expression consists of seven sub-expressions describing the execution schedule details for the pipeline.

To schedule the pipeline, follow the below steps:

On the File menu, select Schedule.

To schedule workflow, turn on Enable Scheduler toggle.
Select the scheduling method such as Basic or Cron Expression for scheduling the pipeline.
If you choose Basic ,
1. In Frequency, select the preferred execution frequency.
  1. Once
  2. Daily
  3. Weekly
  4. Monthly
  5. Yearly
  6. Custom
2. In Start Date, set the pipeline execution start date.
3. In Start Time, set the pipeline execution start time.
4. In End Date, set the pipeline execution end date.
5. In Timezone, select the time zone.
6. Click to schedule the pipeline.

In the above figure, the pipeline is scheduled to run every week, effective from November 24, 2022, at 04:44 PM until December 24, 2022.

Note:

If the preferred pipeline execution frequency is Custom, you need to set the Minutes and End Time along with Start date, Start time, End date, and Timezone for the execution.

In the above figure, the pipeline is scheduled to run every 50 minutes, effective from February 8, 2022, at 09:33 PM until March 29, 2022, at 09:34 PM.

If you choose Cron Expression,
1. In Cron Expression, enter the cron expression. The Cron Expression’s format is “Seconds” “Minutes” “Hours” “Day of the month” “Month” “Day of the Week” “Year” all separated by a space.
2. Click to schedule the pipeline.