Spark Notebook v0.6.0 Release Notes

Release Date: 2015-07-23 // over 8 years ago
    • ๐Ÿ›  a loooooot of fixes \o/
    • ๐Ÿ“š a loooooot of documentation including on how to install and run the spark notebook on distros and clusters (yarn, mapr, EMR, ...)
    • support for HADOOP_CONF_DIR and EXTRA_CLASSPATH to include spark cluster specific classpath entries, like hadoop conf dir, but also lzo jar and
      โšก๏ธ so on. This updates both the classpath of the notebook server and the notebooks processes.
    • ๐Ÿ“‡ the custom repos specified in the metadata or application.conf have an higher priority
    • ๐Ÿ‘Œ support for spark 1.4.1
    • ๐Ÿณ mesos is added to the docker distro
    • code is now run asynchronously, allowing the introduction of the flame button , that can cancel all running spark jobs
    • โž• added many new notebooks, included @Data-Fellas ML and ADAM examples or anomaly detection by @radek1st
    • LOGO :-D
    • added :markdown , :javascript , :jpeg , :png , :latex , :svg , :pdf , :html , :plain , :pdf that support interpolation (using scala variables)
    • ๐Ÿ’ป clusters can be deleted from the ui
    • ๐Ÿ“ฆ spark packages repo is available by default
    • ๐Ÿ“ฆ spark package format is now supported : groupId:artifactId:version
    • โž• added with.parquet modifier to include parquet deps
    • 0๏ธโƒฃ spark.app.name uses the name of the notebook by default (easier to track in clusters)
    • Dynamic table renderer for DataFrame
    • โž• Added a users sections in the README
    • Tachyon can be disabled by setting manager.tachyon.enabled to false
    • support for printing from the browser ( CTRL+P )
    • added :ldp for local dependency definitions (so not added to spark context)
    • ๐Ÿ‘€ Graph (nodes-edges) can be plotted easily using the Node and Edge types โ†’ see viz/Graph Plots.snb
    • ๐Ÿ‘€ Geo data viz added using latlon data โ†’ see viz/Geo Data (Map).snb
    • โœจ Enhanced the twitter stream example to show tweets in a map
    • Enhanced the WISP examples including Histogram, BoxPot. Wisp plots can now be build using the lower api for Highchart
    • โž• Adding the commons lib in the spark context to enable extended viz using spark jobs