« Changelog History


Scio v0.9.2 Release Notes

Release Date: 2020-07-02 // almost 4 years ago

  • "Alohomora"

    🚀 There are no breaking changes in this release, but some were introduced with v0.9.0:

    👀 See v0.9.0 Migration Guide for detailed instructions.

    👌 Improvements

    • ➕ Add more info to RateLimiterDoFn javadoc (#3054)
    • ➕ Add OnTimeBehaviour window option (#3063)
    • ➕ add small SMB sink optimizations (#3079)
    • ➕ Add support for PipelineOptions in ContextAndArgs (#3121)
    • ➕ Add support for read only ensureTable (#3114)
    • ➕ Add support for sharded JDBC reads from tables (#3020)
    • ➕ Add support for String/ByteString TF Bucket key types (#3098)
    • Ensures the future returned by addCallback will complete (#3099)
    • ⚡️ Update BigQueryType and AvroType compileTimeOnly msg (#3107)
    • Cleanup scio-repl classloader (#3118)
    • 🎉 Initialize ScioContext on :reset (#3109)
    • ✂ Remove unnecessary cache of client interceptors (#3091)
    • 🔨 Refactor scio-repl underlying ILoop (#3108)
    • 👉 Make SMB source a splittable BoundedSource (#3005)
    • More Coder doc (#3025)
    • 👉 Use a sampled subset of files to compute estimated SMB source size (#3037)
    • 👉 Use IndexRecord upper bound (#3028)
    • 👉 Use MonoidAggregator when available (#3051)
    • Wrap skewedJoin internals in transform (#3104)
    • ⚡️ Update deprecated .toIterator with .iterator (#3053)
    • ⚡️ Update to use testId instead of toString (#3115)

    🐛 Bug Fixes

    • 🛠 Fix additional exception wrappings for Flink (#3035)
    • 🛠 Fix classpath issue when running from IntelliJ or Bloop (#3087)
    • 🛠 Fix containValue serialization (#3128)
    • 🛠 Fix doc site edit page link (#3062)
    • 🛠 Fix javafmt from #3054
    • 🛠 Fix repl-generated classfiles output directory (#3106)
    • 🛠 Fix scio-repl scala specific repl settings (#3089)
    • 🛠 fix site homepage formatting
    • 🛠 fix SMB doc formatting (#3078)
    • 🛠 Fix tuplecoders script
    • 🛠 Fix: Add extra schema encoding step if coder already set (#3027)
    • 🛠 Fix: propagate PipelineOptions in job test (#3026)
    • 🛠 Fix: support mutable zeroValue in aggregate/combine/fold (#3033)
    • ➕ Add missing Dataflow runner to scio-repl (#3081)

    ⚡️ Dependency Updates

    • ⚡️ Update auto-value, auto-value-annotations to 1.7.3 (#3042)
    • ⚡️ Update Beam to 2.22.0 (#3039)
    • ⚡️ Update caffeine to 2.8.5 (#3112)
    • ⚡️ Update case-app, case-app-annotations, ... to 2.0.3 (#3094)
    • ⚡️ Update elasticsearch-rest-client, ... to 7.8.0 (#3067)
    • ⚡️ Update magnolify-avro, magnolify-bigtable, ... to 0.2.1 (#3127)
    • ⚡️ Update scala to 2.13.3 (#3130)
    • ⚡️ Update scalactic to 3.2.0 (#3072)
    • ⚡️ Update scalatest to 3.2.0 (#3073)
    • ⚡️ Update transport to 6.8.10 (#3047)