« Changelog History


metorikku v0.0.84 Release Notes

Release Date: 2020-05-25 // almost 4 years ago

  • 🆕 New

    👷 1. Added new mode called periodic, basically runs a batch job in a loop 🔀 2. Selective merge UDF 👷 3. Added lag reporting to batch and streaming jobs

    1. Added empty output protection 👍 5. Support reading metrics from remote location (s3, HDFS)

    👌 Improvements

    🚚 1. Hudi: removeNullColumns flag to remove null columns before writing to hudi 🚚 2. Hudi: deletePendingCompactions flag removes pending compactions when running in streaming 🔀 3. Hudi: added a manual hive sync mode (this helps hive 1 users)

    1. Hudi: added hudiTableName parameter 👍 5. Hive: support hive 2.3
    2. Started releasing assembled JAR to maven central

    🛠 Fixes

    1. Hudi: fix metrics reporting when using hudi in streaming ⬆️ 2. Hudi: upgrade to 0.5.2 (breaking change) 🔨 3. Refactored build process