Spark Utils v0.3 Release Notes

  • 0.3.2

    • โž• Added support for bucketing in data sinks
    • ๐Ÿ‘Œ Improved the community resources


    • โž• Added configuration variable substitution support


    • Split SparkRunnable into SparkRunnable and SparkApp
    • Changed the SparkRunnable API; now run() returns Result instead of Try[Result]
    • Changed the SparkApp API; now buildConfig() was renamed to createContext() and now it returns Context instead of Try[Context]
    • Changed the DataSource API; now read() returns DataFrame instead of Try[DataFrame]
    • Changed the DataSink API; now write() returns DataFrame instead of Try[DataFrame]
    • Small documentation improvements