This documentation is for an older version (1.4.7) of Dagster. You can view the version of this page from our latest release below.
This guide is applicable to Dagster Cloud.
This reference describes the settings that can be configured for full deployments in Dagster Cloud.
Refer to the Managing deployments in Dagster Cloud guide for info about configuring settings in the Dagster Cloud interface or using the dagster-cloud CLI.
Settings are formatted using YAML. For example:
run_queue: max_concurrent_runs: 10 tag_concurrency_limits: - key: "database" value: "redshift" limit: 5 run_monitoring: start_timeout_seconds: 1200 cancel_timeout_seconds: 1200 run_retries: max_retries: 0 sso_default_role: EDITOR auto_materialize: run_tags: {}
For each deployment, you can configure settings for:
The run_queue settings allow you to specify how many runs can execute concurrently in the deployment.
run_queue: max_concurrent_runs: 10 tag_concurrency_limits: - key: "database" value: "redshift" limit: 5
| Property | Description |
|---|---|
| run_queue.max_concurrent_runs | The maximum number of runs that are allowed to be in progress at once. Set to 0 to stop any runs from launching. Negative values aren't permitted.
|
| run_queue.tag_concurrency_limits | A list of limits applied to runs with particular tags.
|
The run_monitoring settings allow you to define how long Dagster Cloud should wait for runs to start before making them as failed, or to terminate before marking them as canceled.
run_monitoring: start_timeout_seconds: 1200 cancel_timeout_seconds: 1200
| Property | Description |
|---|---|
| run_monitoring.start_timeout_seconds | The number of seconds that Dagster Cloud will wait after a run is launched for the process or container to start executing. After the timeout, the run will fail. This prevents runs from hanging in STARTING indefinitely when the process or container doesn't start.
|
The run_retries settings allow you to define how Dagster Cloud handles retrying failed runs in the deployment.
run_retries: max_retries: 0
| Property | Description |
|---|---|
| run_retries.max_retries | The maximum number of times Dagster Cloud should attempt to retry a failed run. Dagster Cloud will use the default if this setting is undefined.
|
The sso_default_role setting lets you configure the default role on the deployment which is granted to new users that log in via SSO. For more information on available roles, see the Dagster Cloud permissions reference.
sso_default_role: EDITOR
| Property | Description |
|---|---|
| sso_default_role | If SAML SSO is enabled, this is the default role that will be assigned to Dagster Cloud users for this deployment. If SAML SSO is not enabled, this setting is ignored.
|
Configure non-isolated runs on your deployment.
non_isolated_runs: enabled: True max_concurrent_non_isolated_runs: 1
| Property | Description |
|---|---|
| enabled | If enabled, the `Isolate run environment` checkbox will appear in the Launchpad.
|
| max_concurrent_non_isolated_runs | A limit for how many non-isolated runs to launch at once. Once this limit is reached, the checkbox will be greyed out and all runs will be isolated. This helps to avoid running out of RAM on the code location server.
|
Configure auto-materializing assets for your deployment.
auto_materialize: run_tags: foo: bar
| Property | Description |
|---|---|
| run_tags | Tags to apply to all runs created for an auto-materialize policy.
|