Governance and pipelines in the modern data stack

Dec 8, 2022·
Dr. Georg Heiler
Dr. Georg Heiler
· 1 min read
Abstract
Efficiently getting data governance right is important. Starting with a motivatory talk and several demo examples we will explore how pipeliens can be developed and governed in a modern data stack.
Date
Dec 8, 2022 4:00 PM — 8:00 PM
Location

weXelerate

Praterstraße 1, Vienna, Vienna

events

In particular we will explore how:

  • dagster
  • DBT
  • open-metadata
  • Airbyte
  • Postgres
  • docker

make data pipeliens a joy to develop and govern.

URLs for reference:

Python Dagster Open-Metadata Airbyte
Dr. Georg Heiler
Authors
Dr. Georg Heiler
senior data expert
Georg is a Senior data expert at Magenta and a ML-ops engineer at ASCII. He is solving challenges with data. His interests include geospatial graphs and time series. Georg transitions the data platform of Magenta to the cloud and is handling large scale multi-modal ML-ops challenges at ASCII.