You are viewing an outdated version of the documentation.

This documentation is for an older version (1.4.7) of Dagster. You can view the version of this page from our latest release below.

View Latest Documentation

DuckDB + Dagster#

Using Dagster's Software-defined Assets and DuckDB I/O manager, you can easily interact with DuckDB tables alongside other Dagster assets.

Managing your DuckDB tables with Dagster enables you to:

  • Use Python to analyze your data stored in DuckDB without writing custom SQL queries to fetch the data
  • Visualize the data dependencies between tables
  • Selectively update the contents of your tables
  • Integrate your DuckDB tables with other tools in your data stack

Additionally, since DuckDB is a local database, you can use the DuckDB I/O manager to test assets that use the Snowflake or BigQuery I/O managers in production scenarios.

DuckDB and Dagster tutorial#

In this tutorial, you'll learn how to store and load Dagster's Software-defined Assets in DuckDB. Click here to get started.

By the end of the tutorial, you will have a connection to your DuckDB instance and a handful of assets that create tables in DuckDB or read existing tables from DuckDB.

References#