Skip to content

Releases: G-Research/spark-extension

[1.3.1] - 2020-12-10

Choose a tag to compare

@EnricoMi EnricoMi released this 07 Apr 19:38

Changed

  • Refine conditional transformation helper methods.

[1.3.0] - 2020-12-07

Choose a tag to compare

@EnricoMi EnricoMi released this 07 Apr 19:38

Added

  • Add transformation to compute histogram. (#26)
  • Add conditional transformation helper methods. (#27)
  • Add partitioned writing helpers that simplifies writing optimally ordered partitioned data. (#29)

[1.2.0] - 2020-10-06

Choose a tag to compare

@EnricoMi EnricoMi released this 07 Apr 19:37

Added

  • Add diff modes (#22): column-by-column, side-by-side, left and right side diff modes.
  • Add sparse mode (#23): diff DataFrame contains only changed values.

[1.1.0] - 2020-08-24

Choose a tag to compare

@EnricoMi EnricoMi released this 07 Apr 19:36

Added

  • Add Python API for Diff transformation.
  • Add change column to Diff transformation providing column names of all changed columns in a row.
  • Add fluent methods to change immutable diff options.
  • Add backticks method to handle column names that contain dots (.).

[1.0.0] - 2020-03-12

Choose a tag to compare

@EnricoMi EnricoMi released this 07 Apr 19:35

Added

  • Add Diff transformation for Datasets.