You are viewing an outdated version of the documentation.

This documentation is for an older version (1.4.7) of Dagster. You can view the version of this page from our latest release below.

Google BigQuery + Dagster#

Using Dagster's software-defined assets and BigQuery I/O manager, you can easily interact with BigQuery tables alongside other Dagster assets.

Managing your BigQuery tables with Dagster enables you to:

  • Use Python to analyze your data stored in BigQuery without writing custom SQL queries to fetch the data
  • Visualize the data dependencies between tables
  • Selectively update the contents of your tables
  • Integrate your BigQuery tables with other tools in your data stack

BigQuery and Dagster tutorial#

In this tutorial, you'll learn how to store and load Dagster's software-defined asset in BigQuery. Click here to get started.

By the end of the tutorial, you will have a connection to your BigQuery instance and a handful of assets that create tables in BigQuery or read existing tables from BigQuery.


References#