Spark Notebook v0.6.2 Release Notes

Release Date: 2015-12-15 // over 8 years ago
    • 🏗 build information in the UI
    • 👍 better https support for web socket connections
    • 👉 use the presentation compiler for completion
    • 🛠 fix restart kernel
    • 💻 log the server/spark forwarded to the browser's console
    • 0️⃣ chart are plotting 25 entries by default (extendable using maxPoints) but this cap is changeable using a reactive HTML input
    • 👷 spark jobs' monitor/progress bar is now always live (still in progress, needs some UI hardening and enhancements)
    • graph plots are reactive
    • table chart using dynatable
    • 👍 HTTP proxy support for dependency managements
    • generic spark version support in a best effort way for any new spark versions (including nightly builds)
    • nightly build repos can be detected and injected with the spark.resolver.search jvm property set to true
    • 💻 presentation mode added, including UI tuning via
    • variables environment support in metadata: loca repo, vm arguments and spark configuration
    • 👍 Better DataFrame viz support
    • PivotChart tuning, including viz and state managment
    • 👌 support %% in the deps definition to take care of the used scala version
    • support the current spark version in the deps definition using _ like "org.apache.spark %% spark-streaming-kafka % _"
    • ➕ added user_custom.css for users' extensions or redefinings of the CSS
    • 💻 report the Spark UI link on the left hand side of the notebook
    • URL Query parameter action=recompute_now to automatically recompute everything at loading time
    • 0️⃣ default logging less verbose
    • ➕ added CSV downloader from DataFrame capability (directly in HDFS using spark-csv)!
    • 🆕 new C3 based widgets
    • 🆕 new GeoChart widget -- support for JTS geometries, GeoJSON and String
    • 🆕 new Flow for visual flow management using boxes and arrows (needs hardening and improvements)
    • 💻 UI cleaning (menubars, ...)
    • kernel auto starts can be disabled (useful for view only mode like presentation): autostartOnNotebookOpen in conf
    • 💻 UI shows when kernel isn't ready
    • 💻 died kernel are now reported throughout the UI too
    • ➕ added manager.notebooks.override to override and merge default values with metadata provided before starting a notebook
    • 🆕 new examples notebooks:
      • Machine Learning
      • C3
      • Geospatial
      • Flow
    • 📚 more documentation (not enough...)

    🍱 Special thanks to @vidma for his amazing work on many new and killing features! 👏 👏 👏