Scio v0.8.0-beta2 Release Notes

Release Date: 2019-10-16 // over 4 years ago
  • ๐Ÿ”‹ Features

    • โฌ†๏ธ Bump Beam to 2.16.0 (#2292)
    • โฌ†๏ธ Bump featran to 0.4.0
    • โž• Add DelegatingSideInput and TypedSparkeySideInput. (#2287)
    • โž• Add initial BigQuery methods with Beam schema (#2197)
    • ๐Ÿ‘ Allow user to pass in Bigtable GcRule (#2256)
    • ๐Ÿ‘Œ Support accessing all counters within JobTest (fix #2007) (#2247)
    • โž• Add BigQuery Source type (#2214)
    • โž• Add Storage API read from query (#2204)

    ๐Ÿ› Bug Fixes & Improvements

    • ๐Ÿ—„ Segregate and deprecate avro reflective records support (#2300)
    • ๐Ÿ›  Fix lambda ser/de in SCollectionMatchers, #2294 (#2296)
    • ๐Ÿ“œ Use PubsubIO.readMessagesWithCoderAndParseFn from Beam 2.16 (#2295)
    • Wrap PubsubWithAttributes write in composite PTransform (fix #2286) (#2288)
    • AvroType macro shouldn't generate duplicate record classes fix #2264) (#2267)
    • โž• Add Paradise dependency back to scio-repl classpath (fix #2265) (#2266)
    • ๐Ÿ‘‰ Use JavaSerializer for encoding Throwable (fix #2249) (#2261)
    • Check name uniqueness without running on Dataflow (#2252)
    • โž• Added fix for BinaryIO output. (#2251)
    • Truncate app args if long (#2244)
    • ๐Ÿ›  Fix: run repl with jdk11 (#2246)
    • โฌ‡๏ธ Reduce guava usage #2223 #2242
    • ๐Ÿ‘‰ Use upstream magnolia for scala >= 2.12, fix #2192 (#2241)
    • ๐Ÿ›  Fix #2096: restore sbt < 1.3.0 behaviour by not closing classloader (#2224)
    • โšก๏ธ Update version check message (#2227)
    • Don't wrap exceptions in WrappedBCoder (#2266)
    • Bypass nullable coder for ObjectFileIO, fix #2187 (#2188)

    ๐Ÿ’ฅ Breaking Changes

    • Decouple SQL extension from scio-core (#2201)