Headless spark on YARN
Sometimes you want to run a different version of spark than the one offered by your distributor. This is easily possible.
May 1, 2019
Dynamically select columns by type
Dynamically select columns by type in spark
Feb 22, 2019
Geospatial data processing
https://docs.google.com/presentation/d/1wBMFVv-4iaVfbmH5GNynvSaTAMQtWpUoHuMNHP83Uys/edit?usp=sharing
May 27, 2018
R for HPC and big data
https://docs.google.com/presentation/d/1VgocCul4ZyLVDqqr6iXsBRmmwsGhJkZj6-lzgdXs0ag/edit?usp=sharing A similar talk was held at a Meetup in December 2018 in Vienna using the following slides and focusing on sparklyR: https://docs.google.com/presentation/d/1NHG7-WoEUsjrdxFjy01OmZjxWB-FZomhfrxO-QapzKg/edit?usp=sharing There is even a videom from the talk. It was one of my first video recorded talks ;)
Sep 27, 2017