Run the latest version of spark
Execute the latest version of spark on HDP.
Aug 31, 2020
Production grade pyspark jobs
Use additional python packages with pyspark
Jul 15, 2020
Deterministic scale-out for spark jobs under increased load
Make spark jobs scale reliably using iteration
Dec 13, 2019
Spark and Hive 3
Get spark and Hive to play nice again on HDP 3.1
Dec 10, 2019
Parallel aggregation of dataframes
Use idempotency of RDD's to your advantage
Dec 5, 2019
Geospatial binning with hexagons on spark
Bring hexagons as efficient spatial operations to spark
Nov 20, 2019
data processing
recent history of data processing.
Aug 4, 2019
Spark descriptive name for cached dataframes
Display user friendly names for cached table in Spark web UI
Jul 23, 2019
Solve data skew issues for array columns in spark
Preventing data skew issues for Arrays.
Jun 13, 2019
Ultimate open vector geoprocessing on spark
Combine the strengths from geomesa and geospark for ultimate geoprocessing capabilities on spark
Jun 2, 2019