Spark packages

Showing projects tagged as Spark

  • Apache Spark

    10.0 10.0 Scala
    Apache Spark - A unified analytics engine for large-scale data processing
  • Deeplearning4J

    9.9 6.5 L1 Java
    Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation.
  • Jupyter Scala

    8.7 9.0 Scala
    A Scala kernel for Jupyter
  • Hail

    8.3 9.8 Python
    Cloud-native genomic dataframes and batch computing
  • metorikku

    7.4 2.4 Scala
    A simplified, lightweight ETL Framework based on Apache Spark
  • ScalNet

    6.3 0.0 Scala
    DISCONTINUED. A Scala wrapper for Deeplearning4j, inspired by Keras. Scala + DL + Spark + GPUs
  • LynxKite

    3.7 4.3 Scala
    The complete graph data science platform
  • raster-frames

    2.1 0.0 Scala
    DISCONTINUED. Spark DataFrames for earth observation data
  • Spark Utils

    2.0 4.6 Scala
    Basic framework utilities to quickly start writing production ready Apache Spark applications
  • Spark Tools

    1.0 0.0 Scala
    Executable Apache Spark Tools: Format Converter & SQL Processor