Spark Notebook v0.6.2 Release Notes
Release Date: 2015-12-15 // over 8 years ago-
- 🏗 build information in the UI
- 👍 better https support for web socket connections
- 👉 use the presentation compiler for completion
- 🛠 fix restart kernel
- 💻 log the server/spark forwarded to the browser's console
- 0️⃣ chart are plotting 25 entries by default (extendable using maxPoints) but this cap is changeable using a reactive HTML input
- 👷 spark jobs' monitor/progress bar is now always live (still in progress, needs some UI hardening and enhancements)
- graph plots are reactive
- table chart using dynatable
- 👍 HTTP proxy support for dependency managements
- generic spark version support in a best effort way for any new spark versions (including nightly builds)
- nightly build repos can be detected and injected with the
spark.resolver.search
jvm property set totrue
- 💻 presentation mode added, including UI tuning via
- variables environment support in metadata: loca repo, vm arguments and spark configuration
- 👍 Better
DataFrame
viz support PivotChart
tuning, including viz and state managment- 👌 support
%%
in the deps definition to take care of the used scala version - support the current spark version in the deps definition using
_
like"org.apache.spark %% spark-streaming-kafka % _"
- ➕ added
user_custom.css
for users' extensions or redefinings of the CSS - 💻 report the Spark UI link on the left hand side of the notebook
- URL Query parameter
action=recompute_now
to automatically recompute everything at loading time - 0️⃣ default logging less verbose
- ➕ added CSV downloader from DataFrame capability (directly in HDFS using spark-csv)!
- 🆕 new C3 based widgets
- 🆕 new GeoChart widget -- support for JTS geometries, GeoJSON and String
- 🆕 new Flow for visual flow management using boxes and arrows (needs hardening and improvements)
- 💻 UI cleaning (menubars, ...)
- kernel auto starts can be disabled (useful for view only mode like presentation):
autostartOnNotebookOpen
in conf - 💻 UI shows when kernel isn't ready
- 💻 died kernel are now reported throughout the UI too
- ➕ added
manager.notebooks.override
to override and merge default values with metadata provided before starting a notebook - 🆕 new examples notebooks:
- Machine Learning
- C3
- Geospatial
- Flow
- 📚 more documentation (not enough...)
🍱 Special thanks to @vidma for his amazing work on many new and killing features! 👏 👏 👏