Scio v0.9.1 Release Notes

Release Date: 2020-06-03 // almost 4 years ago
  • "Aberto"

    ๐Ÿš€ There are no breaking changes in this release, but some were introduced with v0.9.0:

    ๐Ÿ‘€ See v0.9.0 Migration Guide for detailed instructions.

    ๐Ÿ‘Œ Improvements

    • โž• Add option to disable colors when pretty printing (#2897)
    • โž• Add SCollection reify methods (#2987)
    • โž• Add scio-extra BigQuery saveAvroAsBigQuery IT test (#3004)
    • Unify sharded & non sharded sparkey write (#3012)
    • Write empty sparkey shards when no data (#3008)
    • โž• Add SCollection#groupMap and SCollection#groupMapReduce operations (#2996)
    • โž• Add BigQuery section to 0.9.0 migration guide (#2991)
    • โšก๏ธ Update default SMB sorter memory to 1GB (#2993)
    • SCollection.withWindowFn with upper bound type (#2975)
    • Implement SMB "least bucket replication" for SortedBucketSource (#2953)
    • โž• Add Grpc-specific Kryo serializers (fix #2963) (#2964)
    • Document bigquery Query type (#2950)
    • โœ‚ Remove unsused Coder and ClassTag (#2934)
    • โœ‚ Remove unused declared vals
    • ๐Ÿ†• New method mapKeys for PairScollection (#2922)
    • 0๏ธโƒฃ Use scala 2.13 as default (#2927)
    • ๐Ÿ†• New inLatePane matcher for SCollection (#2921)
    • โž• Add java.sql.Timestamp coder (#2907)

    ๐Ÿ› Bug Fixes

    • ๐Ÿ‘‰ Use scalaVersion semantic selector (#3022)
    • โž• Add -release 8 scalac option (#3006)
    • ๐Ÿ›  Fix scio-extra BigQuery IT test
    • ๐Ÿ‘‰ Use base64 encoding (#3003)
    • ๐Ÿ‘‰ Use BigQuery client project consistently (#2995)
    • Propagate targetParallelism from SortedBucketIO (#2997)
    • โœ‚ Remove mercator override (#2992)
    • ๐Ÿ›  Fixup Grpc Kryo serializers (#2967)
    • โช Revert "Fix: generate tree eagerly before checking for private constructors (#2846)" (#2943)
    • ๐Ÿ›  Fix tcnative and gcsio dep conflicts (#2948)
    • ๐Ÿ“‡ Rename BigQuery Beam Schema based op (#2932)
    • ๐Ÿ›  Fix creation of local sharded Sparkey files (#2930)
    • Don't require a List for Bigtable admin operations. (#2931)
    • ๐Ÿ“‡ Don't write SMB metadata if prior steps fail (fix #2895) (#2899)
    • ๐Ÿ›  Fix dependency conflicts (#2924)
    • ๐Ÿ›  Fix docs public datasets
    • ๐Ÿ›  Fix circe deprecation warn (#2910)
    • ๐Ÿ›  Fix: Parser with custom Formatter not always in scope (#2909)
    • ๐Ÿ›  Fix ScalaMatcher serialization in isEqualTo (#2904)
    • ๐Ÿ›  Fix: temp table location changed back to US (#2905)
    • ๐Ÿ›  Fix deprecation warns (#2966)

    โšก๏ธ Dependency Updates

    • โšก๏ธ Update kantan.csv to 0.6.1 (#3016)
    • โšก๏ธ Update caffeine to 2.8.4 (#2999)
    • โšก๏ธ Update magnolify-avro, magnolify-bigtable, ... to 0.2.0 (#2986)
    • โšก๏ธ Update caffeine to 2.8.3 (#2983)
    • โšก๏ธ Update elasticsearch 6/7 (#2974) (#2970)
    • โšก๏ธ Update auto-value, auto-value-annotations to 1.7.2 (#2973)
    • โšก๏ธ Update auto-service to 1.0-rc7 (#2972)
    • โšก๏ธ Update scala to 2.13.2 (#2951)
    • โšก๏ธ Update scalactic to 3.1.2 (#2959)
    • โšก๏ธ Update scalatest to 3.1.2 (#2961)
    • โšก๏ธ Update algebird-core, algebird-test to 0.13.7 (#2954)
    • โšก๏ธ Update auto-value, auto-value-annotations to 1.7.1 (#2940)
    • โšก๏ธ Update jackson-annotations, jackson-core, ... to 2.10.4 (#2938) (#2939)
    • โšก๏ธ Update magnolia to 0.16.0 (#2923)
    • โšก๏ธ Update cassandra-driver-core to 3.9.0 (#2925)
    • โšก๏ธ Update mysql-socket-factory to 1.0.16 (#2911)
    • โšก๏ธ Update mysql-connector-java to 8.0.20 (#2918)
    • โšก๏ธ Update joda-time to 2.10.6 (#2912)
    • โšก๏ธ Update featran-core, featran-scio, ... to 0.6.0 (#2896)
    • โšก๏ธ Update scala-collection-compat to 2.1.6 (#2894)