Dagster

Perfecting the Art of Doing Nothing: Incremental Multimodal AI Pipelines with Metaxy featured image

Perfecting the Art of Doing Nothing: Incremental Multimodal AI Pipelines with Metaxy

AI pipelines are now expensive enough that recomputing more than necessary is the dominant cost. Tokens and GPU hours change the economics, and agentic workflows branch and …

avatar
Dr. Georg Heiler
Docling + Metaxy: Patent Intelligence at Scale featured image

Docling + Metaxy: Patent Intelligence at Scale

A walkthrough at the Docling Community Office Hours of how Jubust combines Docling for document parsing with Metaxy as an incremental, field-level metadata control plane to build …

avatar
Dr. Georg Heiler
Metaxy + Dagster-Slurm for Efficient Multimodal Pipelines featured image

Metaxy + Dagster-Slurm for Efficient Multimodal Pipelines

How to combine Metaxy, Dagster-Slurm, Docling, and Ray to run incremental multimodal pipelines on sovereign AI infrastructure.

avatar
Dr. Georg Heiler
Dagster + Slurm featured image

Dagster + Slurm

Run and orchestrate Dagster workloads on Slurm-based HPC environments with production-oriented patterns.

Scaling Data Pipelines @Magenta Telekom featured image

Scaling Data Pipelines @Magenta Telekom

Making humans and machines collaborate efficiently.

avatar
Dr. Georg Heiler
Rediscovering the SUPER in Supercomputing featured image

Rediscovering the SUPER in Supercomputing

Improving developer experience on HPC systems with dagster.

avatar
Hernan Picatto
Simple Sovereign Scalable Data Stack featured image

Simple Sovereign Scalable Data Stack

**Duck taming** the tigers of distributed systems. Join us for a practical talk on building a fast, portable, and sovereign data & AI stack with: DuckDB, Dagster, Ray, Small …

avatar
Dr. Georg Heiler
Simple Sovereign Scalable Data Stack featured image

Simple Sovereign Scalable Data Stack

Tired of cloud lock-in and surprise bills? This talk shows how to build a fast, portable analytics stack around DuckDB and Dagster. Along the way of our journey to sovereignty and …

avatar
Dr. Georg Heiler
Scaling data pipelines (Big Data Minds conference Frankfurt) featured image

Scaling data pipelines (Big Data Minds conference Frankfurt)

Datenabhängigkeiten, Tool-Silos und Entwicklungsprozesse müssen keine Hindernisse sein – sie können gezielt zu einem integralen Bestandteil einer leistungsfähigen Datenplattform …

avatar
Dr. Georg Heiler
Scaling data pipelines @Magenta Telekom featured image

Scaling data pipelines @Magenta Telekom

Tackling data challenges via the orchestrator.

avatar
Dr. Georg Heiler