Dagster

Orchestrate data pipelines and manage job runs with Dagster

Dagster is an open-source data orchestration platform designed for building, testing, and monitoring data pipelines. It provides a unified model for defining data assets, scheduling jobs, and observing pipeline execution — whether running locally or deployed to Dagster+.

With Dagster, you can:

  • Orchestrate data pipelines: Define and run jobs composed of ops and assets with full dependency tracking
  • Monitor executions: Track run status, inspect logs, and debug failures step by step
  • Manage schedules and sensors: Automate pipeline triggers on a cron schedule or in response to external events
  • Reexecute selectively: Resume failed pipelines from the point of failure without rerunning successful steps

In Sim, the Dagster integration enables your agents to interact with a Dagster instance programmatically. Agents can launch and monitor job runs, retrieve execution logs, reexecute failed runs, and manage schedules and sensors — all as part of a larger automated workflow. Use Dagster as an orchestration layer your agents can control and observe, enabling data-driven automation that responds dynamically to pipeline outcomes.

Usage Instructions

Connect to a Dagster instance to launch job runs, monitor run status, list available jobs across repositories, terminate or delete runs, reexecute failed runs, fetch run logs, and manage schedules and sensors. API token only required for Dagster+.

Tools

dagster_launch_run

Launch a job run on a Dagster instance.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3000\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)
repositoryLocationNamestringYesRepository location (code location) name
repositoryNamestringYesRepository name within the code location
jobNamestringYesName of the job to launch
runConfigJsonstringNoRun configuration as a JSON object (optional)
tagsstringNoTags as a JSON array of {key, value} objects (optional)

Output

ParameterTypeDescription
runIdstringThe globally unique ID of the launched run

dagster_get_run

Get the status and details of a Dagster run by its ID.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3000\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)
runIdstringYesThe ID of the run to retrieve

Output

ParameterTypeDescription
runIdstringRun ID
jobNamestringName of the job this run belongs to
statusstringRun status (QUEUED, NOT_STARTED, STARTING, MANAGED, STARTED, SUCCESS, FAILURE, CANCELING, CANCELED)
startTimenumberRun start time as Unix timestamp
endTimenumberRun end time as Unix timestamp
runConfigYamlstringRun configuration as YAML
tagsjsonRun tags as array of {key, value} objects

dagster_get_run_logs

Fetch execution event logs for a Dagster run.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3001\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)
runIdstringYesThe ID of the run to fetch logs for
afterCursorstringNoCursor for paginating through log events (from a previous response)
limitnumberNoMaximum number of log events to return

Output

ParameterTypeDescription
eventsjsonArray of log events (type, message, timestamp, level, stepKey, eventType)
typestringGraphQL typename of the event
messagestringHuman-readable log message
timestampstringEvent timestamp as a Unix epoch string
levelstringLog level (DEBUG, INFO, WARNING, ERROR, CRITICAL)
stepKeystringStep key, if the event is step-scoped
eventTypestringDagster event type enum value
cursorstringCursor for fetching the next page of log events
hasMorebooleanWhether more log events are available beyond this page

dagster_list_runs

List recent Dagster runs, optionally filtered by job name.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3001\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)
jobNamestringNoFilter runs by job name (optional)
statusesstringNoComma-separated run statuses to filter by, e.g. "SUCCESS,FAILURE" (optional)
limitnumberNoMaximum number of runs to return (default 20)

Output

ParameterTypeDescription
runsjsonArray of runs
runIdstringRun ID
jobNamestringJob name
statusstringRun status
tagsjsonRun tags as array of {key, value} objects
startTimenumberStart time as Unix timestamp
endTimenumberEnd time as Unix timestamp

dagster_list_jobs

List all jobs across repositories in a Dagster instance.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3001\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)

Output

ParameterTypeDescription
jobsjsonArray of jobs with name and repositoryName
namestringJob name
repositoryNamestringRepository name

dagster_reexecute_run

Reexecute an existing Dagster run, optionally resuming only from failed steps.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3001\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)
parentRunIdstringYesThe ID of the run to reexecute
strategystringYesReexecution strategy: ALL_STEPS reruns everything, FROM_FAILURE resumes from failed steps, FROM_ASSET_FAILURE resumes from failed assets

Output

ParameterTypeDescription
runIdstringThe ID of the newly launched reexecution run

dagster_terminate_run

Terminate an in-progress Dagster run.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3001\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)
runIdstringYesThe ID of the run to terminate

Output

ParameterTypeDescription
successbooleanWhether the run was successfully terminated
runIdstringThe ID of the terminated run
messagestringError or status message if termination failed

dagster_delete_run

Permanently delete a Dagster run record.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3001\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)
runIdstringYesThe ID of the run to delete

Output

ParameterTypeDescription
runIdstringThe ID of the deleted run

dagster_list_schedules

List all schedules in a Dagster repository, optionally filtered by status.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3001\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)
repositoryLocationNamestringYesRepository location (code location) name
repositoryNamestringYesRepository name within the code location
scheduleStatusstringNoFilter schedules by status: RUNNING or STOPPED (omit to return all)

Output

ParameterTypeDescription
schedulesjsonArray of schedules (name, cronSchedule, jobName, status, id, description, executionTimezone)
namestringSchedule name
cronSchedulestringCron expression for the schedule
jobNamestringJob the schedule targets
statusstringSchedule status: RUNNING or STOPPED
idstringInstigator state ID — use this to start or stop the schedule
descriptionstringHuman-readable schedule description
executionTimezonestringTimezone for cron evaluation

dagster_start_schedule

Enable (start) a schedule in a Dagster repository.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3001\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)
repositoryLocationNamestringYesRepository location (code location) name
repositoryNamestringYesRepository name within the code location
scheduleNamestringYesName of the schedule to start

Output

ParameterTypeDescription
idstringInstigator state ID of the schedule
statusstringUpdated schedule status (RUNNING or STOPPED)

dagster_stop_schedule

Disable (stop) a running schedule in Dagster.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3001\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)
instigationStateIdstringYesInstigationState ID of the schedule to stop — available from dagster_list_schedules output

Output

ParameterTypeDescription
idstringInstigator state ID of the schedule
statusstringUpdated schedule status (RUNNING or STOPPED)

dagster_list_sensors

List all sensors in a Dagster repository, optionally filtered by status.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3001\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)
repositoryLocationNamestringYesRepository location (code location) name
repositoryNamestringYesRepository name within the code location
sensorStatusstringNoFilter sensors by status: RUNNING or STOPPED (omit to return all)

Output

ParameterTypeDescription
sensorsjsonArray of sensors (name, sensorType, status, id, description)
namestringSensor name
sensorTypestringSensor type (ASSET, AUTO_MATERIALIZE, FRESHNESS_POLICY, MULTI_ASSET, RUN_STATUS, STANDARD)
statusstringSensor status: RUNNING or STOPPED
idstringInstigator state ID — use this to start or stop the sensor
descriptionstringHuman-readable sensor description

dagster_start_sensor

Enable (start) a sensor in a Dagster repository.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3001\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)
repositoryLocationNamestringYesRepository location (code location) name
repositoryNamestringYesRepository name within the code location
sensorNamestringYesName of the sensor to start

Output

ParameterTypeDescription
idstringInstigator state ID of the sensor
statusstringUpdated sensor status (RUNNING or STOPPED)

dagster_stop_sensor

Disable (stop) a running sensor in Dagster.

Input

ParameterTypeRequiredDescription
hoststringYesDagster host URL (e.g., https://myorg.dagster.cloud/prod or http://localhost:3001\)
apiKeystringNoDagster+ API token (leave blank for OSS / self-hosted)
instigationStateIdstringYesInstigationState ID of the sensor to stop — available from dagster_list_sensors output

Output

ParameterTypeDescription
idstringInstigator state ID of the sensor
statusstringUpdated sensor status (RUNNING or STOPPED)

On this page