Dagster Cloud Hybrid agents#

For Hybrid deployments, Dagster Cloud uses an agent that is responsible for executing your code. The agent streams metadata about code execution over HTTPS to Dagster Cloud’s Agent API.

Dagster Cloud currently supports agents running on the following backends:

NameHow it works
Amazon Elastic Container Service (ECS)The Amazon Elastic Container Service (ECS) agent executes Dagster jobs as Amazon Web Services (AWS) ECS tasks. This agent is appropriate for scaled production deployments; ECS is a good choice for teams who have already standardized on ECS or who don't plan to run their own container orchestration infrastructure.
DockerThe Docker agent executes Dagster jobs in Docker containers on your computer.
KubernetesThe Kubernetes agent executes Dagster jobs on a Kubernetes cluster. This agent is appropriate for scaled production deployments and is a good choice for teams who have already standardized on Kubernetes.
LocalThe local agent executes Dagster jobs as processes on your computer.

Amazon ECS agents#


Docker agents#


Kubernetes agents#


Local agents#


Customizing agents#