Big-Data

Parallel aggregation of dataframes
Use idempotency of RDD’s to your advantage
Georg Heiler
Last updated on Oct 29, 2020 1 min read
Geospatial binning with hexagons on spark
Bring hexagons as efficient spatial operations to spark
Georg Heiler
Last updated on Nov 28, 2019 2 min read
Geospatial binning with hexagons on spark
data processing
recent history of data processing.
Aug 4, 2019 9:00 AM — 11:00 AM Yogyakarta, Indonesia
Georg Heiler
Follow
data processing
Spark descriptive name for cached dataframes
Display user friendly names for cached table in Spark web UI
Georg Heiler
Nov 20, 2019 1 min read
Solve data skew issues for array columns in spark
Preventing data skew issues for Arrays.
Georg Heiler
Nov 20, 2019 4 min read
Ultimate open vector geoprocessing on spark
Combine the strengths from geomesa and geospark for ultimate geoprocessing capabilities on spark
Georg Heiler
Last updated on Oct 29, 2020 4 min read
Ultimate open vector geoprocessing on spark
Analyze OSM data in spark
Analyze the OSM community and extract geometries from the graph.
Georg Heiler
Oct 29, 2020 2 min read
OSM to Spark
Processing OSM in a scalable hadoop native way.
Georg Heiler
Oct 29, 2020 6 min read
OSM to Spark
Headless spark on YARN
Sometimes you want to run a different version of spark than the one offered by your distributor. This is easily possible.
Georg Heiler
Nov 20, 2019 2 min read
Headless spark on YARN
Dynamically select columns by type
Dynamically select columns by type in spark
Georg Heiler
Nov 20, 2019 1 min read