All Versions
71
Latest Version
Avg Release Cycle
6 days
Latest Release
1226 days ago
Changelog History
Page 3
Changelog History
Page 3
-
v0.0.91
August 09, 2020 -
v0.0.90
August 09, 2020 -
v0.0.89
August 09, 2020 -
v0.0.88 Changes
August 02, 2020- Long to Timestamp conversion UDF
- Deequ version dependency fix
- Data Quality - Added new data validations to Metorikku based on Amazon Deequ: hasSize, hasUniqueness
-
v0.0.87 Changes
July 28, 2020๐ New
- Data Quality - Added data validations to Metorikku based on Amazon Deequ (IsUnique, IsComplete)
- LoadIfExist- UDF to attempt to load a table otherwise return an empty DF by specific schema.
-
v0.0.86
July 01, 2020 -
v0.0.85
July 01, 2020 -
v0.0.84 Changes
May 25, 2020๐ New
๐ท 1. Added new mode called periodic, basically runs a batch job in a loop ๐ 2. Selective merge UDF ๐ท 3. Added lag reporting to batch and streaming jobs
- Added empty output protection ๐ 5. Support reading metrics from remote location (s3, HDFS)
๐ Improvements
๐ 1. Hudi: removeNullColumns flag to remove null columns before writing to hudi ๐ 2. Hudi: deletePendingCompactions flag removes pending compactions when running in streaming ๐ 3. Hudi: added a manual hive sync mode (this helps hive 1 users)
- Hudi: added hudiTableName parameter ๐ 5. Hive: support hive 2.3
- Started releasing assembled JAR to maven central
๐ Fixes
- Hudi: fix metrics reporting when using hudi in streaming โฌ๏ธ 2. Hudi: upgrade to 0.5.2 (breaking change) ๐จ 3. Refactored build process
-
v0.0.83
May 19, 2020 -
v0.0.82
May 19, 2020