Blog

Scalable data pipelines from dagster with pyspark featured image

Scalable data pipelines from dagster with pyspark

Getting started with simple dagster pipelines.

avatar
Dr. Georg Heiler
Tame your notebooks featured image

Tame your notebooks

Include jupyter notebooks into reliable data pipelines.

avatar
Dr. Georg Heiler
Fully-fledged example with resources featured image

Fully-fledged example with resources

A full example E2E

avatar
Dr. Georg Heiler
Turning the data pipeline inside out featured image

Turning the data pipeline inside out

Flip the data pipeline to get a better notion about the things we actually care about: data assets not transformations.

avatar
Dr. Georg Heiler
From hello-world to simple pipelines featured image

From hello-world to simple pipelines

Getting started with simple dagster pipelines.

avatar
Dr. Georg Heiler
Modern data orchestration using Dagster featured image

Modern data orchestration using Dagster

Overview over the modern data stack ecosystem. Introduction to this blog series

avatar
Dr. Georg Heiler
Interactive dagster debugging featured image

Interactive dagster debugging

Interacting with a running dagster instance interactively

avatar
Dr. Georg Heiler
Scalable sparse matrix multiplication featured image

Scalable sparse matrix multiplication

Using Apache Spark for **sparse** matrix multiplication

avatar
Dr. Georg Heiler
COVID population model featured image

COVID population model

WWTF COVID project summary

avatar
Dr. Georg Heiler

ML project configuration management

Easy configuration handling for complex machine learning pipelines

avatar
Dr. Georg Heiler