« Changelog History


Scio v0.10.0-beta1 Release Notes

Release Date: 2020-10-30 // over 3 years ago

  • 👀 See v0.10.0 Migration Guide for detailed instructions.

    👌 Improvements

    • ➕ Add scio-redis (#3386)
    • ➕ Add RedisMutation support for RedisIO (#3331) (#3391)
    • ➕ Add ApproxDistinctCount trait and two HLL++ beam extension implementations. (#3361)
    • ➕ Add Predicate for SMB source, fix #3398 (#3402)
    • 👍 Allow SortedBucketPreKeyedSink key validation with null keys (#3439)
    • ➕ Add missing sortMergeGroupByKey API with custom parallelism (#3430)
    • 🔀 Unblock MergeAndWriteBucketsSource while in progress (#3407)
    • ➕ Add SColletion withResource functions (#3389)
    • 👷 Make BQ inherit labels from Beam/Dataflow job (#3375)
    • Simplify Bigquery Format typeclass and bubble up Avro coder (#3401)
    • 👌 Support $LATEST replace for BQ Table type (#3376)
    • ↔ Integrate docs in CI (#3392)
    • ➕ Add 0.10.0 migration guide (#3436)
    • ➕ Add scalafix rules for 0.10 (#3432)
    • 📄 Clarify extra.csv.CsvIO docs (#3435)
    • ⚡️ Update scio.g8 steps
    • ➕ Add install instructions for sbt. (#3433)

    🐛 Bug Fixes

    • Avoid Iterable backed by List when running locally (#3408)
    • ✂ Remove Coder context bound from read (#3384)
    • Avoid fallback Coder on GenericRecord read (#3385)
    • ➕ Add missing pubsub coders to avoid fallback (#3382)
    • ✂ Remove prompt before interp is created (#3404)
    • 🛠 Fix repl windows character escape (#3405)
    • Sanitize staged file path string (#3406)
    • ✂ Remove unused fields in AvroIO (#3383)
    • 🛠 Fix JavaAsyncLookupDoFn doc link (#3381)

    ⚡️ Dependency Updates

    • ⚡️ Update Beam to 2.25.0 (#3438)
    • ⚡️ Update sbt-avro to 3.2.0 (#3434)
    • ⚡️ Update magnolify-avro, magnolify-bigtable, ... to 0.3.0 (#3431)
    • ⚡️ Update elasticsearch-rest-client, ... to 7.9.3 (#3422)
    • ⚡️ Update sbt-explicit-dependencies to 0.2.15 (#3417)
    • ⚡️ Update joda-time to 2.10.8 (#3424)
    • ⚡️ Update sbt-mima-plugin to 0.8.1 (#3414)
    • ⚡️ Update sbt to 1.4.1 (#3415)
    • ⚡️ Update scalafmt-core to 2.7.5 (#3410)
    • ⚡️ Update mysql-connector-java to 8.0.22 (#3412)
    • ⚡️ Update sbt-mdoc to 2.2.10 (#3413)
    • ⚡️ Update junit to 4.13.1 (#3394)
    • ⚡️ Update caffeine to 2.8.6 (#3395)
    • ⬆️ Bump Featran to 0.7.0, re-enable failing TF tests (#3380)