Scio v0.7.1 Release Notes

Release Date: 2019-02-08 // about 5 years ago
  • "Taxidea Taxus"

    ๐Ÿ”‹ Features

    • ๐Ÿ†• New HashCode-based partitioning method for keyed SCollections (#1654)
    • ๐Ÿ†• New Coder for java.lang.ArrayList (#1649), and more space-efficient coders for small ADTs like Either and Try (#1652)
    • ๐Ÿ†• new BinaryIO output (#1663)
    • Simpler, clearer toString method for Coders (#1671)
    • ๐Ÿ“ฆ Custom Assertions for unit testing Coders added to scio-test package (#1642)
    • ๐Ÿ†• New SideMap and SideSet SideInput types, usable in hashFullOuterJoin, hashIntersectByKey, and hashFilter methods
    • Library version bumps: mysql-connector-java -> 8.0.15 (#1653), mysql-socket-factory -> 1.0.12 (#1627), protobuf-java -> 3.6.1 (#1633), hadoop-client -> 2.7.7 (#1634), jackson-module-scala -> 2.9.8 (#1632), parquet-avro -> 1.10.1 (#1648), kantan.csv -> 0.5.0 (#1647)

    ๐Ÿ› Bug fixes & Improvements

    • โšก๏ธ Optimized Bloom filter aggregations in sparse joins (#1644)
    • ๐Ÿ“ฆ Spanner-specific Coders repackaged from scio-core to scio-spanner (#1630)
    • ๐Ÿšš Fallback coder always uses Kryo (#1668) and RichCoderRegistry is removed (#1670)