Summingbird changelog

Changelog History

Page 2

• v0.4.2 Changes

  • 🛠 Use scalding version 0.9.0rc17 which has some bug fixes
  • ➕ Add fully satisfiable flag to UniqueKeyedService: https://github.com/twitter/summingbird/pull/489
  • Mark the scalding platform as serializable, but also don't grab the platform in the scalding env: https://github.com/twitter/summingbird/pull/485
  • ✅ smoketest displaying error running example: https://github.com/twitter/summingbird/pull/483

• v0.4.1 Changes

  • 🚀 Release tool failure fix from 0.4.0 release.

• v0.4.0 Changes

  • ➕ Add/use the multiplier option: https://github.com/twitter/summingbird/pull/481
  • ➕ add variations on pipeFactory to allow a map function before time extrac...: https://github.com/twitter/summingbird/pull/482
  • 👉 Make HDFSState public: https://github.com/twitter/summingbird/pull/478
  • 🔋 Feature/ianoc frozen keys: https://github.com/twitter/summingbird/pull/477
  • Piping prune function through the VersionedStore factory method: https://github.com/twitter/summingbird/pull/476
  • ✂ Remove deprecation indirections: https://github.com/twitter/summingbird/pull/472
  • 🛠 fix unidoc target: https://github.com/twitter/summingbird/pull/469
  • ➕ Add hadoop2 compression options: https://github.com/twitter/summingbird/pull/466
  • Few more profiler noticed changes, mostly Future.collect indexedSeq's. O...: https://github.com/twitter/summingbird/pull/465
  • ➕ Add deprecation: https://github.com/twitter/summingbird/pull/463
  • Vagrant folder added to .gitignore: https://github.com/twitter/summingbird/pull/464
  • Manually block up sections of output from caches into lists to avoid flo...: https://github.com/twitter/summingbird/pull/453
  • 🛠 Fixes bug that meant storm tests weren't running: https://github.com/twitter/summingbird/pull/460
  • Factor batch from online: https://github.com/twitter/summingbird/pull/455
  • 🚚 This moves from using the completeTopology approach to running it normal...: https://github.com/twitter/summingbird/pull/458
  • ✅ Code is called heavily, and in tests where we do it 100's of times it wa...: https://github.com/twitter/summingbird/pull/457
  • Clean up a little bit of this code. Uses seq/traversable once in some ap...: https://github.com/twitter/summingbird/pull/456
  • 🔨 This refactors time out of several places inside the online code. Allows...: https://github.com/twitter/summingbird/pull/454
  • 🚚 Move the hadoop defaults into scalding platform: https://github.com/twitter/summingbird/pull/452
  • 🔋 Feature/add option to tune output sizes online: https://github.com/twitter/summingbird/pull/451
  • 🚚 Move to using Mergable from storehaus instead of mergable store.: https://github.com/twitter/summingbird/pull/450
  • 🔋 Feature/state deprecated ptrs: https://github.com/twitter/summingbird/pull/449
  • ➕ Adds BatchID interval to TS interval: https://github.com/twitter/summingbird/pull/443
  • ➕ Adds a scalding-test project: https://github.com/twitter/summingbird/pull/447
  • 👉 Make Commutativity settings a case object: https://github.com/twitter/summingbird/pull/448
  • 📦 Splits the storm test code out into its own package to help end users be...: https://github.com/twitter/summingbird/pull/442
  • ➕ Add toString to InitialBatchedStore: https://github.com/twitter/summingbird/pull/444
  • 🔋 Feature/long to timestamp offline: https://github.com/twitter/summingbird/pull/439
  • 🔋 Feature/add pruning support: https://github.com/twitter/summingbird/pull/435
  • 📦 Split the scalding platform out into packages: https://github.com/twitter/summingbird/pull/434
  • ➕ Add mima command support: https://github.com/twitter/summingbird/pull/427
  • ➕ Add PipeFactoryOps, with mapElements, flatMapElements and mapPipe: https://github.com/twitter/summingbird/pull/432
  • 🔋 Feature/move code from scalding: https://github.com/twitter/summingbird/pull/424

• v0.3.3 Changes

  • Depend on proper Tormenta version (fix semver hiccup)

• v0.3.2 Changes

  • We don't want to hit runningState.fail twice: https://github.com/twitter/summingbird/pull/425
  • 👍 also tail producer support: https://github.com/twitter/summingbird/pull/423
  • 🛠 fix merge planner bug: https://github.com/twitter/summingbird/pull/417
  • shard fm: https://github.com/twitter/summingbird/pull/416
  • ➕ Add sinking to stores: https://github.com/twitter/summingbird/pull/408
  • ➕ Add NormalScaldingStore which contains only (K, V) pairs: https://github.com/twitter/summingbird/pull/407

• v0.3.1 Changes

  • ⬆️ Bump the chill version - makes storm provided: https://github.com/twitter/summingbird/pull/406
  • sort by batch if monoid is commutative: https://github.com/twitter/summingbird/pull/411
  • 🛠 Fix README to properly run Storm locally: https://github.com/twitter/summingbird/pull/412
  • 🔋 Feature/async summer store: https://github.com/twitter/summingbird/pull/400

• v0.3.0 Changes

  • ➕ Add serializers for BatchID, Timestamp: https://github.com/twitter/summingbird/pull/350
  • ➕ ADd a means to set defaults outside the planner: https://github.com/twitter/summingbird/pull/351
  • 🛠 fix bugs hdfs: https://github.com/twitter/summingbird/pull/353
  • ➕ add default option setting: https://github.com/twitter/summingbird/pull/356
  • ➕ Add options tests: https://github.com/twitter/summingbird/pull/335
  • ➕ Add some hadoop defaults to the builder API: https://github.com/twitter/summingbird/pull/359
  • Cleanup the Storm API a bit: https://github.com/twitter/summingbird/pull/360
  • Put all Collector actions in one execute: https://github.com/twitter/summingbird/pull/365
  • Producer API executors for storm and scalding: https://github.com/twitter/summingbird/pull/367
  • standardize get or else scalding: https://github.com/twitter/summingbird/pull/363
  • 🛠 Fixes ticks: https://github.com/twitter/summingbird/pull/368
  • spout metrics: https://github.com/twitter/summingbird/pull/344
  • ➕ Add the summingbird prefix to the graphs: https://github.com/twitter/summingbird/pull/370
  • ➕ add localOrShuffle: https://github.com/twitter/summingbird/pull/371
  • 👉 Make the StormMetric Covariant: https://github.com/twitter/summingbird/pull/373
  • 🛠 Fix depreciation to be from sink: https://github.com/twitter/summingbird/pull/375
  • ➕ add options to cfg: https://github.com/twitter/summingbird/pull/376
  • Null out Tuple.values for GC: https://github.com/twitter/summingbird/pull/374
  • ➕ Add timestamps to hadoop configs: https://github.com/twitter/summingbird/pull/377/files
  • ➕ add Options.toString: https://github.com/twitter/summingbird/pull/378
  • 🛠 Fix out of sync versions to keep: https://github.com/twitter/summingbird/pull/379
  • 🔋 Feature fix ffm: https://github.com/twitter/summingbird/pull/381
  • ➕ Add an await timeout: https://github.com/twitter/summingbird/pull/380
  • ➕ Add local or shuffle option: https://github.com/twitter/summingbird/pull/384
  • ➕ Add dequeueAll to Queue: https://github.com/twitter/summingbird/pull/386
  • ➕ Add in log4j and slf4j to the example: https://github.com/twitter/summingbird/pull/392
  • 🛠 Fixes naming in bolts for options to work right after plan: https://github.com/twitter/summingbird/pull/391
  • ➕ Add error checking to the cache size: https://github.com/twitter/summingbird/pull/393
  • ➕ Add more storm tests, add some new test graphs: https://github.com/twitter/summingbird/pull/394
  • Proxy the select correctly on initialbatch: https://github.com/twitter/summingbird/pull/389
  • 🔨 Refactors the bolts from storm to be independent workers in online: https://github.com/twitter/summingbird/pull/395
  • 🔌 Pluggable caches in FinalFlatMap: https://github.com/twitter/summingbird/pull/396
  • 👉 Uses multimerge: https://github.com/twitter/summingbird/pull/399
  • ack on entry option: https://github.com/twitter/summingbird/pull/398

• v0.2.5 Changes

  • 🛠 Fix issue with externalizer: https://github.com/twitter/summingbird/pull/316
  • 🎉 Initial implementation of checkpoint state: https://github.com/twitter/summingbird/pull/315
  • 🚚 Move to sbt 0.13: https://github.com/twitter/summingbird/pull/322
  • 🚚 Move Dependants common code to graph: https://github.com/twitter/summingbird/pull/321
  • CheckpointState -> HDFSState: https://github.com/twitter/summingbird/pull/318
  • 🔄 Change depthFirstOf to use List instead of Vector: https://github.com/twitter/summingbird/pull/323
  • ➕ Add an optional parameter to set default parallelism for a storm source: https://github.com/twitter/summingbird/pull/319
  • ➕ Add a method to prepare for optimizing FlatMapKeys: https://github.com/twitter/summingbird/pull/305
  • 🛠 fix the increased output issue: https://github.com/twitter/summingbird/pull/327
  • ⚡️ Optimize iterator sums: https://github.com/twitter/summingbird/pull/326
  • 👉 Make sure to register BatchID and Timespan: https://github.com/twitter/summingbird/pull/324
  • ✅ Sum by key test: https://github.com/twitter/summingbird/pull/330
  • ➕ Add slf4j logging to scalding: https://github.com/twitter/summingbird/pull/331
  • 📦 Move the versioned store to scalding package: https://github.com/twitter/summingbird/pull/332
  • 🌲 storm logging: https://github.com/twitter/summingbird/pull/333
  • ➕ Adds/extends some storm option tests: https://github.com/twitter/summingbird/pull/334
  • 👉 Make VersionedState fail-safe: https://github.com/twitter/summingbird/pull/337
  • Throw on Storm Submission w/ no online store: https://github.com/twitter/summingbird/pull/338
  • 👍 General graph support online: https://github.com/twitter/summingbird/pull/340
  • Summingbird config: https://github.com/twitter/summingbird/pull/339

• v0.2.4 Changes

  • 🛠 Fix off-by-one bug in scalding batched store: https://github.com/twitter/summingbird/pull/311

• v0.2.3 Changes

  • ➕ Add convenience methods to Producer: https://github.com/twitter/summingbird/pull/307
  • ⚡️ Massively optimize Scalding merge/sumByKey: https://github.com/twitter/summingbird/pull/303
  • 👌 Improve the WaitingState state machine: https://github.com/twitter/summingbird/pull/302
  • 🚚 Move code for common realtime planners (storm + akka): https://github.com/twitter/summingbird/pull/299
  • 🛠 Fix an issue with source minify in scalding: https://github.com/twitter/summingbird/pull/298
  • 👌 Improve scalding tests: https://github.com/twitter/summingbird/pull/296
  • 👌 Improve storm tests: https://github.com/twitter/summingbird/pull/292
  • 👉 Use an AnyVal-like class rather than java.util.Date: https://github.com/twitter/summingbird/pull/295
  • 👌 improve Batcher documentation: https://github.com/twitter/summingbird/pull/293

• « First
• ‹ Prev
• 1
• 2
• 3
• 4
• Next ›
• Last »