Scio v0.8.0-beta2 Release Notes
Release Date: 2019-10-16 // over 4 years ago-
๐ Features
- โฌ๏ธ Bump Beam to 2.16.0 (#2292)
- โฌ๏ธ Bump featran to 0.4.0
- โ Add DelegatingSideInput and TypedSparkeySideInput. (#2287)
- โ Add initial BigQuery methods with Beam schema (#2197)
- ๐ Allow user to pass in Bigtable GcRule (#2256)
- ๐ Support accessing all counters within JobTest (fix #2007) (#2247)
- โ Add BigQuery Source type (#2214)
- โ Add Storage API read from query (#2204)
๐ Bug Fixes & Improvements
- ๐ Segregate and deprecate avro reflective records support (#2300)
- ๐ Fix lambda ser/de in SCollectionMatchers, #2294 (#2296)
- ๐ Use PubsubIO.readMessagesWithCoderAndParseFn from Beam 2.16 (#2295)
- Wrap PubsubWithAttributes write in composite PTransform (fix #2286) (#2288)
- AvroType macro shouldn't generate duplicate record classes fix #2264) (#2267)
- โ Add Paradise dependency back to scio-repl classpath (fix #2265) (#2266)
- ๐ Use JavaSerializer for encoding Throwable (fix #2249) (#2261)
- Check name uniqueness without running on Dataflow (#2252)
- โ Added fix for BinaryIO output. (#2251)
- Truncate app args if long (#2244)
- ๐ Fix: run repl with jdk11 (#2246)
- โฌ๏ธ Reduce guava usage #2223 #2242
- ๐ Use upstream magnolia for scala >= 2.12, fix #2192 (#2241)
- ๐ Fix #2096: restore sbt < 1.3.0 behaviour by not closing classloader (#2224)
- โก๏ธ Update version check message (#2227)
- Don't wrap exceptions in WrappedBCoder (#2266)
- Bypass nullable coder for ObjectFileIO, fix #2187 (#2188)
๐ฅ Breaking Changes
- Decouple SQL extension from scio-core (#2201)