All Versions
39
Latest Version
Avg Release Cycle
219 days
Latest Release
1961 days ago

Changelog History
Page 3

  • v0.8.5 Changes

    • 🛠 Fixed bug in RichPipe.insert
    • ➕ Add souce[T] to JobTest
    • 👍 Allow DelimitedScheme to override strictness and safety.
    • ➕ Add distinct method to RichPipe and TypedPipe, add mapValues to TypedPipe
    • ISSUE 389: Catch exceptions in Tool
    • Sbt assembly 0.8.7
    • ➕ Add CascadeJob to allow multiple flows in one job
    • ➕ Adding cross-build scala versions
    • 👉 Use mima to check binary compatibility

  • v0.8.4 Changes

    • ⬆️ ISSUE 340: Upgrade to Cascading 2.1.5
    • 👀 ISSUE 327,329,337: adds sample method with seed in RichPipe
    • 🚚 ISSUE 323: Remove untyped write from TypedPipe (must write to Mappable[U])
    • ISSUE 321: pulls out scalding-date and scalding-args as separate projects

    Contributions

    27 commits

    • P. Oscar Boykin: 13 commits
    • willf: 4 commits
    • Argyris Zymnis: 3 commits
    • Sam Ritchie: 3 commits
    • Tim Chklovski: 1 commits
    • Chris Severs: 1 commits
    • Rickey Visinski: 1 commits
    • David Shimon: 1 commits

  • v0.8.3 Changes

    • ISSUE 312: dramatic speedup for sortWithTake/sortedTake if you take many items
    • 👍 ISSUE 307: Read support for JsonLine support (previously, just write)
    • ISSUE 305: Adds a shuffle-method to RichPipe (for sampling/sharding)
    • ISSUE 299: limit method for Typed-safe API.
    • 🛠 ISSUE 296: Fixes self-joins in the Type-safe API.
    • ISSUE 295: unpack-all syntax (use Fields.ALL) for TupleUnpacker
    • ISSUE 280: Improvements to AbsoluteDuration
    • ⬆️ ISSUE 277: Upgrade to Cascading 2.0.7

    Contributions

    75 commits total.

    • P. Oscar Boykin: 25 commits
    • Alex Dean: 15 commits
    • Argyris Zymnis: 11 commits
    • Sam Ritchie: 4 commits
    • Timothy Chklovski: 4 commits
    • Dan McKinley: 4 commits
    • Aaron Siegel: 3 commits
    • Tim Chklovski: 3 commits
    • Ashutosh Singhal: 2 commits
    • João Oliveirinha: 2 commits
    • Arkajit Dey: 1 commits
    • Avi Bryant: 1 commits

  • v0.8.2 Changes

    • ISSUE 269: Improvements to AbsoluteDuration.fromMillisecs and some new APIs
    • ISSUE 256: Weighted page-rank with the Matrix API
    • ISSUE 249: Fix for Matrix.scala missing some obvious operations
    • ISSUE 246: Partition in RichPipe (create a new field, and then groupBy on it)
    • ISSUE 241: Fix joinWithLarger with a custom joiner
    • 🔀 ISSUE 234. 238: Etsy sync: periodic date jobs, ability to add traps, more flexible Args
    • ISSUE 230: shard and groupRandomly on RichPipe
    • ✅ ISSUE 229: Initial skew-Join implementation (please test!)
    • ISSUE 228 - 233, 265: Improve Typed-API
    • ISSUE 221: Combinatorics in scalding.mathematics

    Contributions

    106 commits total.

    • P. Oscar Boykin: 29 commits
    • Krishnan Raman: 16 commits
    • Arkajit Dey: 15 commits
    • Avi Bryant: 7 commits
    • Edwin Chen: 6 commits
    • Aaron Siegel: 5 commits
    • Koert Kuipers: 5 commits
    • Argyris Zymnis: 4 commits
    • Sam Ritchie: 4 commits
    • Chris Severs: 4 commits
    • Brad Greenlee: 3 commits
    • Wil Stuckey: 2 commits
    • Dan McKinley: 2 commits
    • Matteus Klich: 2 commits
    • Josh Devins: 1 commits
    • Steve Mardenfeld: 1 commits

  • v0.8.1 Changes

    • ISSUE 220: Etsy date improvements and local-mode tap improvements
    • ISSUE 219: scald.rb fix
    • ISSUE 218: Add aggregate method to ReduceOperations
    • ISSUE 216: Improve variance notations
    • ISSUE 213,215: Make Field[T] serializable
    • 🔨 ISSUE 210,211: Refactor date code into individual files + tests
    • ISSUE 209: Add hourly/daily time pathed source classes
    • 🏗 ISSUE 207,208: sbt build improvements
    • 🚚 ISSUE 205,206: Remove scala serialization code to com.twitter.chill
    • 📜 ISSUE 203: Improved date-parsing and docs (from Etsy)
    • ISSUE 202,204: Add propagate/mapWithIndex in Matrix (use Monoids with graphs)
    • ISSUE 201: add stdDev to groupBuilder.
    • ISSUE 200: typed write and key-value swap
    • 🗄 ISSUE 196: Clean up deprecations
    • ISSUE 194,195: Fix negative numbers as args
    • ISSUE 190-192,197,199: Improved Joining/Co-grouping in the typed-API

  • v0.8.0 Changes

    • 🛠 Many small bugfixes
    • ISSUE 189: Adds spillThreshold to GroupBuilder to tune memory usage
    • ISSUE 187: Adds TypedTsv for type-safe TSV files.
    • ISSUE 179: Add forceToDisk to help hand optimization of flows
    • ISSUE 175: API to set the type/comparators in the Fields API.
    • ISSUE 162, 163: Adds keys, values methods to Typed-API
    • ISSUE 160: adds approxUniques to GroupBuilder
    • ISSUE 153: mapPlusMap in GroupBuilder
    • 👍 ISSUE 149: Support for Hadoop sequence files
    • ISSUE 148: Matrix API
    • 🚚 ISSUE 147: Move Monoid/Algebra code to Algebird
    • Mulitple issues: many new Kryo serializers added
    • ISSUE 140: Adds ability to do side-effects (foreach, using in RichPipe)

  • v0.7.3 Changes

    • ISSUE 134: Cleans up scalding.Tool
    • ✅ ISSUE 133: Adds SortedListTake monoid, Either monoid, and tests
    • ⬆️ ISSUE 130: Upgrades cascading.kryo to 0.4.4
    • 0️⃣ ISSUE 129: Disable Kryo references by default, add config
    • 👷 ISSUE 128: Minor fix to normalize job

  • v0.7.2 Changes

    • ⬆️ ISSUE 127: Upgrade maple and remove jdks.
    • ISSUE 126: Switch normalize to use crossWithTiny
    • 🛠 ISSUE 125: Serialization fixes

  • v0.7.1 Changes

    • ISSUE 124: Add crossWithSmaller and use it in normalize.
    • ISSUE 123: Adds generated classes that allow tuple concatenation.

  • v0.7.0 Changes

    • ⬆️ ISSUE 122: Upgrade cascading to version 2.0.2 and maple to 0.2.1
    • ISSUE 119: Iterator fix
    • ISSUE 118: Specialized tuplegetter
    • 👷 ISSUE 117: Job conf keys
    • ISSUE 116: Feature/flatten
    • ISSUE 115: Fold scan init fix
    • ⚡️ ISSUE 114: Feature/scald update
    • ISSUE 113: Make sure SequenceFile uses the fields list if one is passed in
    • ⬆️ ISSUE 110: Upgrade Kryo to 2.16.
    • ISSUE 107: Add a method to GroupBuilder to force all aggregation on the reducers.
    • ISSUE 105: Feature/head fix
    • 0️⃣ ISSUE 104: Feature/default date improvements
    • ISSUE 103: Feature/case case pack
    • ISSUE 100: Adds trivial UnitGroup
    • 🏗 ISSUE 99: Fix build breakage and add tutorial run script.