Deploying Dagster with your infrastructure#

This section is applicable to Dagster Open Source. If you're looking for Dagster Cloud, click here.

Learn how to deploy and execute Dagster with these hands-on guides.

Overview#

Get started with a look at Dagster's architecture, including a primer on deployment concepts. Learn more.

Concepts#

Learn about the concepts relevant to deploying Dagster.

Dagster instance
Dagster daemon
Run launchers
Executors
Run coordinator
Run monitoring
Run retries

Deploying Dagster#

Check out these guides to learn the basics of Dagster deployment, including setting up Dagster and running the Dagster webserver.

Running Dagster locally
Running Dagster as a service
Deploying to a single node using Docker
Deploying to Amazon Web Services EC2 or ECS
Deploying to Google Cloud Platform

Using Helm? Check out the following guides to walk you through Dagster deployment:

Deploying with Helm
Deploying with Celery using Helm
Customizing Kubernetes deployments
Migrating Dagster instances while upgrading

Executing Dagster#

For more advanced job execution, you can submit to different compute substrates. These can be mixed and matched. For example, you can deploy the Dagster webserver on Amazon Web Services (AWS) EC2 and execute jobs on a Dask cluster.

Celery
Dask