10

8

6

4

2


10.0

9.9
Apache Spark

10.0

9.7
Kafka

9.9

9.3
Deeplearning4J

9.9

10.0
Flink

9.6

2.8
Scalding

9.4
0.0
Summingbird

26 Big Data packages and projects

  • Apache Spark

    10.0 9.9 Scala
    Big data platform

  • Kafka

    10.0 9.7 L2 Java
    Kafka is a message broker project and aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds.

  • Deeplearning4J

    9.9 9.3 L1 Java
    Deep Learning for Java, Scala & Clojure on Hadoop & Spark - From Skymind

    • SaaSHub will help you find the best software and product alternatives
    Promoted www.saashub.com

  • Flink

    9.9 10.0 L2 Java
    Processing framework with powerful stream- and batch-processing capabilities.

  • Scalding

    9.6 2.8 Scala
    A Scala binding for the Cascading abstraction of Hadoop MapReduce.

  • Summingbird

    9.4 0.0 Scala
    An implementation of the “lambda architecture” as a software abstraction

  • Scio

    9.2 9.5 Scala
    A Scala API for Apache Beam and Google Cloud Dataflow

  • Reactive-kafka

    8.9 8.2 Scala
    Reactive Streams API for Apache Kafka.

  • Jupyter Scala

    8.7 8.5 Scala
    Lightweight Scala kernel for Jupyter / IPython 3

  • BIDMach

    8.4 2.8 Jupyter Notebook
    CPU and GPU machine learning library, using JNI for GPU computation.

  • Sparkta

    8.2 0.3 Scala
    Real Time Aggregation based on Spark Streaming.

  • Gearpump

    8.2 0.4 Scala
    Lightweight real-time big data streaming engine

  • Hail

    7.9 9.8 Scala
    Scalable genetic data analysis

  • Vegas

    7.7 0.0 Scala
    The missing MatPlotLib for Scala + Spark

  • Scoobi

    7.2 0.0 Scala
    Write type-safe Hadoop programs in idiomatic Scala way

  • metorikku

    6.3 8.8 Scala
    A simplified, lightweight ELT Framework based on Apache Spark

  • Scrunch

    5.0 3.7 L3 Java
    A Scala wrapper for Apache Crunch which provides a framework for writing, testing, and running MapReduce pipelines.

  • Scoozie

    4.8 0.0 Scala
    Scala DSL on top of Oozie XML

  • spark-deployer

    3.5 0.0 Scala
    A sbt plugin which helps deploying Apache Spark stand-alone cluster and submitting job on cloud system like AWS EC2.

  • Schemer

    3.4 0.0 Scala
    Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

  • GridScale

    2.0 6.0 Java
    A Scala API for computing clusters and grids.

  • raster-frames

    2.0 0.0 Scala
    Spark DataFrames for earth observation data

  • Shadoop

    1.8 0.0 Scala
    A Scala DSL for Hadoop MapReduce.

  • Sparkplug

    1.8 4.5 Scala
    Spark package to "plug" holes in data using SQL based rules

  • Spark Utils

    1.5 3.7 Scala
    Basic framework utilities to quickly start writing production ready Apache Spark applications

  • Spark Tools

    1.0 3.7 Scala
    Executable Apache Spark Tools: Format Converter & SQL Processor

Popular Comparisons


99 Remote Jobs

Work from home. Anywhere in the world.
+ Post a job

Add another 'Big Data' Package