The open-source data orchestrator for machine learning, analytics, and ETL
Check out Dagster
Dagster is a data orchestrator for machine learning, analytics, and ETL
Dagster lets you define pipelines in terms of the data flow between reusable, logical components, then test locally and run anywhere. With a unified view of pipelines and the assets they produce, Dagster can schedule and orchestrate Pandas, Spark, SQL, or anything else that Python can invoke.
Dagster is designed for data platform engineers, data engineers, and full-stack data scientists. Building a data platform with Dagster makes your stakeholders more independent and your systems more robust. Developing data pipelines with Dagster makes testing easier and deploying faster.
Elementl is building the next generation of open source data tools. As part of our founding team, you’ll work with an experienced team of engineers with a passion for developer tools, quality engineering, and moving fast.
We're hiring across engineering, product, and operations. Check out our open roles below.