Metaxy + Dagster-Slurm for Efficient Multimodal Pipelines
How to combine Metaxy, Dagster-Slurm, Docling, and Ray to run incremental multimodal pipelines on sovereign AI infrastructure.
Dagster + Slurm
Run and orchestrate Dagster workloads on Slurm-based HPC environments with production-oriented patterns.
•
1 min read
Scaling Data Pipelines @Magenta Telekom
Making humans and machines collaborate efficiently.
Rediscovering the SUPER in Supercomputing
Improving developer experience on HPC systems with dagster.
Simple Sovereign Scalable Data Stack
**Duck taming** the tigers of distributed systems. Join us for a practical talk on building a fast, portable, and sovereign data & AI stack with: DuckDB, Dagster, Ray, Small …
Simple Sovereign Scalable Data Stack
Tired of cloud lock-in and surprise bills? This talk shows how to build a fast, portable analytics stack around DuckDB and Dagster. Along the way of our journey to sovereignty and …
Scaling data pipelines (Big Data Minds conference Frankfurt)
Datenabhängigkeiten, Tool-Silos und Entwicklungsprozesse müssen keine Hindernisse sein – sie können gezielt zu einem integralen Bestandteil einer leistungsfähigen Datenplattform …
Scaling data pipelines @Magenta Telekom
Tackling data challenges via the orchestrator.
Scaling data pipelines @Telekom
Tackling data challenges via the orchestrator.
Open Data Hackathon Wien 25
Principles of open data and data procesing