Scio v0.8.2 Release Notes
Release Date: 2020-03-02 // about 4 years ago-
"Capacious Extremis"
🔋 Features
- ⚡️ Update Beam to 2.19.0 (#2665)
- ➕ Add SCollection#tap (#2713)
- ➕ Add SortedBucketTransform (#2693)
- ➕ Add API bindings for SortedBucketTransform (#2712)
- ➕ Add counters to SMB read transforms (#2704)
- ➕ Add ParquetExampleIO (#2696)
- 👍 Allow setting MIME type on RemoteFileUtil.upload (#2711)
- ➕ Add BigQuery macro Avro Schema and toAvro support (#2646)
🐛 Bug fixes & improvements
- ⚡️ Ignore updates on google libs that we need to keep in sync with beam (#2728)
- ➕ Add all scio compile deps (#2634)
- ⬆️ Bump circe to 0.13.0 (#2717)
- 🛠 Fix BigQuery Storage default params (#2692)
- 🛠 Fix: TableRow#getRecord returns Map (#2710)
- 🛠 Fix: eval coder eagerly for sealead traits (#2699)
- ➕ Add readFiles alternative to deprecated readAll (#2697)
- ⚡️ Minor update topByKey comments (#2695)
- ✂ Remove duplicate stage files (#2678)
- 👉 Make files to stage list mutable (#2676)
- 👉 Make Coder[Set] throw NonDeterministicException (#2674)
- Prevent sharded-sparkey shards from having negative indices. (#2667)
- ⬇️ Reduce SMB Dataflow graph size for many-bucketed joins (#2666)
- ➕ Add test for #2649, Avro map field in SMB sink (#2664)
- 👮 Force GenericRecord writer in SMB Avro, fix 2649 (#2650)
- 🛠 Fix: Add missing toAvro to BigQueryType (#2657)
- ✂ Remove patched bigquery rows iterator (#2647)