Scio v0.10.0-beta2 Release Notes

Release Date: 2020-11-19 // 14 days ago

Previous changes from v0.10.0-beta1

  • ๐Ÿ‘€ See v0.10.0 Migration Guide for detailed instructions.

    ๐Ÿ‘Œ Improvements

    • โž• Add scio-redis (#3386)
    • โž• Add RedisMutation support for RedisIO (#3331) (#3391)
    • โž• Add ApproxDistinctCount trait and two HLL++ beam extension implementations. (#3361)
    • โž• Add Predicate for SMB source, fix #3398 (#3402)
    • ๐Ÿ‘ Allow SortedBucketPreKeyedSink key validation with null keys (#3439)
    • โž• Add missing sortMergeGroupByKey API with custom parallelism (#3430)
    • ๐Ÿ”€ Unblock MergeAndWriteBucketsSource while in progress (#3407)
    • โž• Add SColletion withResource functions (#3389)
    • ๐Ÿ‘ท Make BQ inherit labels from Beam/Dataflow job (#3375)
    • Simplify Bigquery Format typeclass and bubble up Avro coder (#3401)
    • ๐Ÿ‘Œ Support $LATEST replace for BQ Table type (#3376)
    • โ†” Integrate docs in CI (#3392)
    • โž• Add 0.10.0 migration guide (#3436)
    • โž• Add scalafix rules for 0.10 (#3432)
    • ๐Ÿ“„ Clarify extra.csv.CsvIO docs (#3435)
    • โšก๏ธ Update scio.g8 steps
    • โž• Add install instructions for sbt. (#3433)

    ๐Ÿ› Bug Fixes

    • Avoid Iterable backed by List when running locally (#3408)
    • โœ‚ Remove Coder context bound from read (#3384)
    • Avoid fallback Coder on GenericRecord read (#3385)
    • โž• Add missing pubsub coders to avoid fallback (#3382)
    • โœ‚ Remove prompt before interp is created (#3404)
    • ๐Ÿ›  Fix repl windows character escape (#3405)
    • Sanitize staged file path string (#3406)
    • โœ‚ Remove unused fields in AvroIO (#3383)
    • ๐Ÿ›  Fix JavaAsyncLookupDoFn doc link (#3381)

    โšก๏ธ Dependency Updates

    • โšก๏ธ Update Beam to 2.25.0 (#3438)
    • โšก๏ธ Update sbt-avro to 3.2.0 (#3434)
    • โšก๏ธ Update magnolify-avro, magnolify-bigtable, ... to 0.3.0 (#3431)
    • โšก๏ธ Update elasticsearch-rest-client, ... to 7.9.3 (#3422)
    • โšก๏ธ Update sbt-explicit-dependencies to 0.2.15 (#3417)
    • โšก๏ธ Update joda-time to 2.10.8 (#3424)
    • โšก๏ธ Update sbt-mima-plugin to 0.8.1 (#3414)
    • โšก๏ธ Update sbt to 1.4.1 (#3415)
    • โšก๏ธ Update scalafmt-core to 2.7.5 (#3410)
    • โšก๏ธ Update mysql-connector-java to 8.0.22 (#3412)
    • โšก๏ธ Update sbt-mdoc to 2.2.10 (#3413)
    • โšก๏ธ Update junit to 4.13.1 (#3394)
    • โšก๏ธ Update caffeine to 2.8.6 (#3395)
    • โฌ†๏ธ Bump Featran to 0.7.0, re-enable failing TF tests (#3380)