Skip to content

run_pipeline

Run a data pipeline and wait for it to finish. A failed run fails the deploy.

Step fragment for a hooks file. Shared step keys are under Steps.

- action: run_pipeline
  item: <Name>.DataPipeline          # `.DataPipeline` may be omitted
  timeout_seconds: 1800
  parameters: {full_load: true}
  on_error: fail                     # default: stop the deploy here; `continue` logs it and goes on

Keys

Key Required Description
item yes The data pipeline, <Name> or <Name>.DataPipeline.
timeout_seconds no Seconds to wait before failing. Default: fab's.
parameters no A mapping passed to the run, as for run_notebook.