Scala Big Data

23 Big Data packages and projects

• Apache Spark

  10.0 9.9 Scala

  Big data platform

• Deeplearning4J

  9.9 9.9 L1 Java

  Deep Learning for Java, Scala & Clojure on Hadoop & Spark - From Skymind

• Kafka

  9.9 9.8 L2 Java

  Kafka is a message broker project and aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds.

• Flink

  9.8 9.9 L2 Java

  Processing framework with powerful stream- and batch-processing capabilities.

• Scalding

  9.6 7.7 Scala

  A Scala binding for the Cascading abstraction of Hadoop MapReduce.

• Summingbird

  9.3 3.7 Scala

  An implementation of the “lambda architecture” as a software abstraction

• Reactive-kafka

  8.9 8.7 Scala

  Reactive Streams API for Apache Kafka.

• Scio

  8.9 9.4 Scala

  A Scala API for Apache Beam and Google Cloud Dataflow

• BIDMach

  8.4 9.0 Jupyter Notebook

  CPU and GPU machine learning library, using JNI for GPU computation.

• Jupyter Scala

  8.1 0.0 Scala

  Lightweight Scala kernel for Jupyter / IPython 3

• Gearpump

  7.9 0.0 Scala

  Lightweight real-time big data streaming engine

• Sparkta

  7.9 0.0 Scala

  Real Time Aggregation based on Spark Streaming.

• Scoobi

  7.1 0.0 Scala

  Write type-safe Hadoop programs in idiomatic Scala way

• Hail

  6.9 9.8 Scala

  Scalable genetic data analysis

• Vegas

  6.7 4.9 Scala

  The missing MatPlotLib for Scala + Spark

• Scrunch

  4.7 4.5 L3 Java

  A Scala wrapper for Apache Crunch which provides a framework for writing, testing, and running MapReduce pipelines.

• Scoozie

  4.6 0.0 Scala

  Scala DSL on top of Oozie XML

• spark-deployer

  3.3 0.0 Scala

  A sbt plugin which helps deploying Apache Spark stand-alone cluster and submitting job on cloud system like AWS EC2.

• metorikku

  2.8 7.5 Scala

  A simplified, lightweight ELT Framework based on Apache Spark

• raster-frames

  1.8 8.3 Scala

  Spark DataFrames for earth observation data

• Shadoop

  1.6 0.0 Scala

  A Scala DSL for Hadoop MapReduce.

• GridScale

  1.5 7.7 Java

  A Scala API for computing clusters and grids.

• Sparkplug

  1.2 5.2 Scala

  Spark package to "plug" holes in data using SQL based rules

* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest. Visit our partner's website for more details.

Datadog - Monitor and correlate metrics, request traces, and logs in one platform. Try it free. More from our partner

Popular Comparisons

• Apache Spark
  vs
  Scalding
• Summingbird
  vs
  Apache Spark
• Gearpump
  vs
  Apache Spark
• Gearpump
  vs
  Flink
• Scrunch
  vs
  Apache Spark

SaaSHub - The independent software marketplace. Find the best software and alternatives. More from our team