metorikku v0.0.59 Release Notes

Release Date: 2019-12-26 // over 4 years ago
  • ๐Ÿ‘Œ Improvements:

    • โฌ†๏ธ Upgrade to spark 2.4.4
    • โœ‚ Removed our AVRO deserialisation code and moved to Abris (https://github.com/AbsaOSS/ABRiS), performance is much better with their code.
    • ๐ŸŽ Major performance improvement for Hudi writer when using alignToPreviousSchema configuration

    ๐Ÿ›  Fixes

    • โœ… Some fixes to the new tester code
    • ๐Ÿ›  Fix for oracle DB writing (thanks @wangqinghuan)