Spark Notebook v0.6.0 Release Notes
Release Date: 2015-07-23 // over 8 years ago-
- ๐ a loooooot of fixes \o/
- ๐ a loooooot of documentation including on how to install and run the spark notebook on distros and clusters (yarn, mapr, EMR, ...)
- support for HADOOP_CONF_DIR and EXTRA_CLASSPATH to include spark cluster specific classpath entries, like hadoop conf dir, but also lzo jar and
โก๏ธ so on. This updates both the classpath of the notebook server and the notebooks processes. - ๐ the custom repos specified in the metadata or application.conf have an higher priority
- ๐ support for spark 1.4.1
- ๐ณ mesos is added to the docker distro
- code is now run asynchronously, allowing the introduction of the flame button , that can cancel all running spark jobs
- โ added many new notebooks, included @Data-Fellas ML and ADAM examples or anomaly detection by @radek1st
- LOGO :-D
- added :markdown , :javascript , :jpeg , :png , :latex , :svg , :pdf , :html , :plain , :pdf that support interpolation (using scala variables)
- ๐ป clusters can be deleted from the ui
- ๐ฆ spark packages repo is available by default
- ๐ฆ spark package format is now supported :
groupId:artifactId:version
- โ added
with.parquet
modifier to include parquet deps - 0๏ธโฃ
spark.app.name
uses the name of the notebook by default (easier to track in clusters) - Dynamic table renderer for
DataFrame
- โ Added a users sections in the README
- Tachyon can be disabled by setting
manager.tachyon.enabled
tofalse
- support for printing from the browser ( CTRL+P )
- added
:ldp
for local dependency definitions (so not added to spark context) - ๐ Graph (nodes-edges) can be plotted easily using the
Node
andEdge
types โ seeviz/Graph Plots.snb
- ๐ Geo data viz added using latlon data โ see
viz/Geo Data (Map).snb
- โจ Enhanced the twitter stream example to show tweets in a map
- Enhanced the WISP examples including Histogram, BoxPot. Wisp plots can now be build using the lower api for Highchart
- โ Adding the commons lib in the spark context to enable extended viz using spark jobs