Skip to main content

Schedule recurring pipeline runs

Set up cron-style schedules to trigger pipeline runs automatically

Schedule recurring pipeline runs

Recurring runs are cron-style triggers that create new pipeline runs on a schedule. Use them for nightly retraining, periodic data ingestion, or regular model evaluation.

Prerequisites

Create a recurring run

Use the Vantage SDK to set up a schedule:

from vantage_sdk import VantageClient

client = VantageClient()
schedule = client.pipelines.create_recurring_run(
pipeline_name="training-pipeline",
name="nightly-retrain",
cron="0 2 * * *", # 2 AM daily
params={"data_path": "/data/raw/latest.csv"},
)
print(f"Schedule created: {schedule.id}")

Common cron patterns:

PatternSchedule
0 2 * * *Daily at 2:00 AM
0 */6 * * *Every 6 hours
0 0 * * 1Weekly on Monday at midnight
0 0 1 * *Monthly on the 1st at midnight

Manage recurring runs in the UI

  1. Click Workbench in the left sidebar, then click Pipelines.
  2. Click the pipeline name, then select the Recurring Runs tab.
  3. The list shows:
ColumnDescription
NameSchedule display name
PipelinePipeline version triggered
Cron scheduleThe interval expression
StatusEnabled or Disabled
Last runWhen the schedule last triggered
Next runWhen the next trigger will fire

Enable or disable a schedule

Click the row's action menu to Enable or Disable the schedule. Disabling pauses future triggers without deleting the configuration.

Delete a recurring run

Click the action menu and select Delete. Runs already triggered by the schedule are not affected.

Ask AI
Ask a question about Vantage Compute...