Scio v0.8.0-alpha1 Release Notes
Release Date: 2019-05-29 // almost 5 years ago-
Highlights
๐ Features
- โฌ๏ธ Bump beam version to 2.12.0 (#1874)
- ๐ BeamSQL support (#1850)(#1944)(#1808)(#1784)(#1804)(#1778)(#1767)(#1698)(#1800)(#1895)(#1821)(#1893)(#1851)(#1917)(#1853)(#1865)(#1823)(#1842)
- โ Add support for generic case class type conversion (#1809)
- BeamSQL string interpolation (#1830)(#1939)(#1892)(#1896)
- ๐ Increased JDK11 support (#1847)(#1846)
- โ Add new BloomFilter implementation for Sparse Joins (#1806)(#1897)
- โ Add BigQuery read storage api support (#1822)(#1940)(#1883)(#1887)(#1862)
- โ Add fluent backoff support for ES (#1826)
- โ Add sparse inner join (#1872)
- ๐ Move scio-contrib back to scio-extra (#1776)
- ๐ Allow TestStream as JobTest input (#1905)
- Implement saveAsDynamicProtobufFile (#1901)
- ๐ฆ Expose BigQuery Failed inserts (#1867)
๐ Bug Fixes & Improvements
- โ Add defaults for BinaryIO (#1919)
- โ Add BigQuery NUMERIC missing cases (#1827)
- โ Add Spanner syntax and instances package (#1863)
- โ Add bigquery syntax package (#1838)
- โ Add dynamic syntax package (#1920)
- ๐ Change default fpProb of sparseIntersectByKey (#1935)
- Wrap unsafe access of nullable fields and methods in try (#1930)
- ๐ Fix FileStorage implicit access modifier (#1909)
- โ Remote sys.exit from code path which is used in tests (#1900)
- ๐จ Refactor bigquery schema/table cache (#1886)
- Correctly format dataset id (#1907)
- โ Add header/footer/prefix/suffix to BinaryIO, fix #1785 (#1884)
- โ Add table type to disambiguate spec and reference (#1866)
- ๐ Replace IllegalStateException with UnsupportedOperationException (#1861)
- ๐จ Refactor sparse intersect by key (#1881)
- scio-tensorflow cleanup (#1879)
- ๐ Initialize counters from ScioContext (#1873)
- ๐ Fix #1866 bigquery it tests (#1878)
- Add warn combine*/sum* transform usage, fix #1620 (#1856)
- Create empty Sparkey file on empty collection (#1834)
- ๐ Use java.io.tmpdir and username as cache dir (#1843)
- โก๏ธ Update WriteDynamicExample, fix #1786 (#1802)
- ๐ Fix KryAtomicCoder null encoding (#1841)
- โ Add jmh benchmarks for bloom filters (#1913)
- ๐ Fix AvroIO type bounds (#1799)
- โ Add more join tests (#1797)
- ๐ป Avro map string key cast exception (#1832)
- โ Add toString on Coders impl (#1819)
- โ Add a hand written Coder for pairs (#1775)
- โ Remove usage of deprecated api (#1812)
- Enable higher kinds and partial unification (#1810)
- ๐ Enable more Xlint options (#1816)
- Enable -Ywarn-value-discard (#1815)
- ๐ Fix schema parsing in BQ TypeProvider
- ๐ Fix NPE in coders with nullableCoders=true (#1820)
- ๐ Make BQ annotations serializable (#1773)
- ๐ Fix: use same protoc (#1781)
- ๐ Use camelCase for typed arguments, fix #1770 (#1780)
- โฌ๏ธ Bump versions (#1801)
- ๐ Fix scalac options for 2.11
- โช Revert auto-service to 1.0-RC2. Same version as beam (#1837)
- โก๏ธ Dependency updates (#1807)(#1803)(#1928)(#1924)(#1916)(#1914)(#1868)(#1875)(#1836)
- ๐ Fix more scalac warns (#1844)
- ๐ Quieted down code dumper for IntelliJ Scala Plugin (#1854)
- ๐ Make ensureSerializable return Either (#1798)
- โ Disable checkVersion in Scio's tests (#1908)
- ๐จ Refactor jdbc io (#1910)
- โก๏ธ Updated overall documentaion (#1906)(#1941)(#1890)(#1936)(#1817)(#1825)
๐ฅ Breaking changes