« Changelog History


Spark Utils v0.3 Release Notes

  • 0.3.2

    • ➕ Added support for bucketing in data sinks
    • 👌 Improved the community resources

    0.3.1

    • ➕ Added configuration variable substitution support

    0.3.0

    • Split SparkRunnable into SparkRunnable and SparkApp
    • Changed the SparkRunnable API; now run() returns Result instead of Try[Result]
    • Changed the SparkApp API; now buildConfig() was renamed to createContext() and now it returns Context instead of Try[Context]
    • Changed the DataSource API; now read() returns DataFrame instead of Try[DataFrame]
    • Changed the DataSink API; now write() returns DataFrame instead of Try[DataFrame]
    • Small documentation improvements