VDSG: Optimizing Multimodal AI Pipelines with Metaxy
The AI era has shifted compute toward complex multimodal pipelines, where a small input or code change can trigger expensive downstream recomputation. This talk introduces Metaxy, …
SAO: Metaxy - Field-Level Metadata Management for Incremental Multimodal ML Pipelines
Multimodal machine learning pipelines that process video, audio, and images incur substantial GPU costs. Existing data orchestrators operate at table or asset granularity: when any …
Perfecting the Art of Doing Nothing: Incremental Multimodal AI Pipelines with Metaxy
AI pipelines are now expensive enough that recomputing more than necessary is the dominant cost. Tokens and GPU hours change the economics, and agentic workflows branch and …
Docling + Metaxy: Patent Intelligence at Scale
A walkthrough at the Docling Community Office Hours of how Jubust combines Docling for document parsing with Metaxy as an incremental, field-level metadata control plane to build …
Metaxy + Dagster-Slurm for Efficient Multimodal Pipelines
How to combine Metaxy, Dagster-Slurm, Docling, and Ray to run incremental multimodal pipelines on sovereign AI infrastructure.
Dagster + Slurm
Run and orchestrate Dagster workloads on Slurm-based HPC environments with production-oriented patterns.
•
1 min read
Scaling Data Pipelines @Magenta Telekom
Making humans and machines collaborate efficiently.
Rediscovering the SUPER in Supercomputing
Improving developer experience on HPC systems with dagster.
Simple Sovereign Scalable Data Stack
**Duck taming** the tigers of distributed systems. Join us for a practical talk on building a fast, portable, and sovereign data & AI stack with: DuckDB, Dagster, Ray, Small …
Simple Sovereign Scalable Data Stack
Tired of cloud lock-in and surprise bills? This talk shows how to build a fast, portable analytics stack around DuckDB and Dagster. Along the way of our journey to sovereignty and …