10

8

6

4

2


10.0

10.0

10.0

9.9

9.9

10.0

9.9

9.8

9.6

2.6

9.3
0.0

26 Big Data packages and projects

  • Apache Spark

    10.0 10.0 Scala
    Apache Spark - A unified analytics engine for large-scale data processing
  • Kafka

    10.0 9.9 L2 Java
    Mirror of Apache Kafka
  • Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.
    Sponsored scoutapm.com
  • Flink

    9.9 10.0 L2 Java
    Apache Flink
  • Deeplearning4J

    9.9 9.8 L1 Java
    Model import deployment framework for retraining models (pytorch, tensorflow,keras) deploying in JVM Micro service environments, mobile devices, iot, and Apache Spark
  • Scalding

    9.6 2.6 Scala
    A Scala API for Cascading
  • Summingbird

    9.3 0.0 Scala
    Streaming MapReduce with Scalding and Storm
  • Scio

    9.3 9.5 Scala
    A Scala API for Apache Beam and Google Cloud Dataflow.
  • Reactive-kafka

    8.9 8.4 Scala
    Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.
  • Jupyter Scala

    8.7 8.3 Scala
    A Scala kernel for Jupyter
  • BIDMach

    8.4 0.0 Scala
    CPU and GPU-accelerated Machine Learning Library
  • Gearpump

    8.1 0.0 Scala
    Lightweight real-time big data streaming engine over Akka
  • Sparkta

    8.1 0.0 Scala
    Real Time Analytics and Data Pipelines based on Spark Streaming
  • Hail

    8.1 9.8 Python
    Scalable genomic data analysis.
  • Vegas

    7.6 0.0 Scala
    The missing MatPlotLib for Scala + Spark
  • Scoobi

    7.0 0.0 Scala
    A Scala productivity framework for Hadoop.
  • metorikku

    6.8 8.6 Scala
    A simplified, lightweight ETL Framework based on Apache Spark
  • Scrunch

    5.1 1.4 L3 Java
    Mirror of Apache Crunch (Incubating)
  • Scoozie

    4.7 0.0 Scala
    Scala DSL on top of Oozie XML
  • spark-deployer

    3.5 0.0 Scala
    Deploy Spark cluster in an easy way.
  • Schemer

    3.5 0.0 Scala
    Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  • GridScale

    2.1 5.5 Scala
    Scala library for accessing various file, batch systems, job schedulers and grid middlewares.
  • raster-frames

    2.1 0.0 Scala
    Spark DataFrames for earth observation data
  • Sparkplug

    1.9 0.0 Scala
    Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
  • Spark Utils

    1.8 0.8 Scala
    Basic framework utilities to quickly start writing production ready Apache Spark applications
  • Shadoop

    1.4 0.0 Scala
    A wrapper for Hadoop in Scala
  • Spark Tools

    1.1 0.8 Scala
    Executable Apache Spark Tools: Format Converter & SQL Processor

Add another 'Big Data' Package