Scio v0.9.1 Release Notes
Release Date: 2020-06-03 // almost 4 years ago-
"Aberto"
๐ There are no breaking changes in this release, but some were introduced with
v0.9.0
:๐ See v0.9.0 Migration Guide for detailed instructions.
๐ Improvements
- โ Add option to disable colors when pretty printing (#2897)
- โ Add SCollection reify methods (#2987)
- โ Add scio-extra BigQuery saveAvroAsBigQuery IT test (#3004)
- Unify sharded & non sharded sparkey write (#3012)
- Write empty sparkey shards when no data (#3008)
- โ Add SCollection#groupMap and SCollection#groupMapReduce operations (#2996)
- โ Add BigQuery section to 0.9.0 migration guide (#2991)
- โก๏ธ Update default SMB sorter memory to 1GB (#2993)
- SCollection.withWindowFn with upper bound type (#2975)
- Implement SMB "least bucket replication" for SortedBucketSource (#2953)
- โ Add Grpc-specific Kryo serializers (fix #2963) (#2964)
- Document bigquery Query type (#2950)
- โ Remove unsused Coder and ClassTag (#2934)
- โ Remove unused declared vals
- ๐ New method mapKeys for PairScollection (#2922)
- 0๏ธโฃ Use scala 2.13 as default (#2927)
- ๐ New inLatePane matcher for SCollection (#2921)
- โ Add java.sql.Timestamp coder (#2907)
๐ Bug Fixes
- ๐ Use scalaVersion semantic selector (#3022)
- โ Add -release 8 scalac option (#3006)
- ๐ Fix scio-extra BigQuery IT test
- ๐ Use base64 encoding (#3003)
- ๐ Use BigQuery client project consistently (#2995)
- Propagate targetParallelism from SortedBucketIO (#2997)
- โ Remove mercator override (#2992)
- ๐ Fixup Grpc Kryo serializers (#2967)
- โช Revert "Fix: generate tree eagerly before checking for private constructors (#2846)" (#2943)
- ๐ Fix tcnative and gcsio dep conflicts (#2948)
- ๐ Rename BigQuery Beam Schema based op (#2932)
- ๐ Fix creation of local sharded Sparkey files (#2930)
- Don't require a List for Bigtable admin operations. (#2931)
- ๐ Don't write SMB metadata if prior steps fail (fix #2895) (#2899)
- ๐ Fix dependency conflicts (#2924)
- ๐ Fix docs public datasets
- ๐ Fix circe deprecation warn (#2910)
- ๐ Fix: Parser with custom Formatter not always in scope (#2909)
- ๐ Fix ScalaMatcher serialization in isEqualTo (#2904)
- ๐ Fix: temp table location changed back to US (#2905)
- ๐ Fix deprecation warns (#2966)
โก๏ธ Dependency Updates
- โก๏ธ Update kantan.csv to 0.6.1 (#3016)
- โก๏ธ Update caffeine to 2.8.4 (#2999)
- โก๏ธ Update magnolify-avro, magnolify-bigtable, ... to 0.2.0 (#2986)
- โก๏ธ Update caffeine to 2.8.3 (#2983)
- โก๏ธ Update elasticsearch 6/7 (#2974) (#2970)
- โก๏ธ Update auto-value, auto-value-annotations to 1.7.2 (#2973)
- โก๏ธ Update auto-service to 1.0-rc7 (#2972)
- โก๏ธ Update scala to 2.13.2 (#2951)
- โก๏ธ Update scalactic to 3.1.2 (#2959)
- โก๏ธ Update scalatest to 3.1.2 (#2961)
- โก๏ธ Update algebird-core, algebird-test to 0.13.7 (#2954)
- โก๏ธ Update auto-value, auto-value-annotations to 1.7.1 (#2940)
- โก๏ธ Update jackson-annotations, jackson-core, ... to 2.10.4 (#2938) (#2939)
- โก๏ธ Update magnolia to 0.16.0 (#2923)
- โก๏ธ Update cassandra-driver-core to 3.9.0 (#2925)
- โก๏ธ Update mysql-socket-factory to 1.0.16 (#2911)
- โก๏ธ Update mysql-connector-java to 8.0.20 (#2918)
- โก๏ธ Update joda-time to 2.10.6 (#2912)
- โก๏ธ Update featran-core, featran-scio, ... to 0.6.0 (#2896)
- โก๏ธ Update scala-collection-compat to 2.1.6 (#2894)