Scala Big Data

26 Big Data packages and projects

• Flink

  9.9 10.0 L2 Java

  Processing framework with powerful stream- and batch-processing capabilities.

• Apache Spark

  10.0 9.9 Scala

  Big data platform

Get performance insights in less than 4 minutes

Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.

Sponsored scoutapm.com



• Hail

  8.0 9.8 Scala

  Scalable genetic data analysis

• Kafka

  10.0 9.8 L2 Java

  Kafka is a message broker project and aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds.

• Scio

  9.3 9.5 Scala

  A Scala API for Apache Beam and Google Cloud Dataflow

• Deeplearning4J

  9.9 8.3 L1 Java

  Deep Learning for Java, Scala & Clojure on Hadoop & Spark - From Skymind

• metorikku

  6.5 8.5 Scala

  A simplified, lightweight ELT Framework based on Apache Spark

• Jupyter Scala

  8.7 8.0 Scala

  Lightweight Scala kernel for Jupyter / IPython 3

• Reactive-kafka

  8.9 8.3 Scala

  Reactive Streams API for Apache Kafka.

• GridScale

  2.0 3.9 Scala

  A Scala API for computing clusters and grids.

• Sparkplug

  1.9 2.1 Scala

  Spark package to "plug" holes in data using SQL based rules

• Spark Tools

  1.1 2.0 Scala

  Executable Apache Spark Tools: Format Converter & SQL Processor

• Spark Utils

  1.8 2.0 Scala

  Basic framework utilities to quickly start writing production ready Apache Spark applications

• Scalding

  9.6 2.0 Scala

  A Scala binding for the Cascading abstraction of Hadoop MapReduce.

• Scrunch

  5.1 1.4 L3 Java

  A Scala wrapper for Apache Crunch which provides a framework for writing, testing, and running MapReduce pipelines.

• BIDMach

  8.4 0.3 Scala

  CPU and GPU machine learning library, using JNI for GPU computation.

• Scoozie

  4.8 0.0 Scala

  Scala DSL on top of Oozie XML

• Scoobi

  7.0 0.0 Scala

  Write type-safe Hadoop programs in idiomatic Scala way

• Gearpump

  8.2 0.0 Scala

  Lightweight real-time big data streaming engine

• Vegas

  7.7 0.0 Scala

  The missing MatPlotLib for Scala + Spark

• raster-frames

  2.1 0.0 Scala

  Spark DataFrames for earth observation data

• Schemer

  3.5 0.0 Scala

  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

• Summingbird

  9.4 0.0 Scala

  An implementation of the “lambda architecture” as a software abstraction

• Sparkta

  8.1 0.0 Scala

  Real Time Aggregation based on Spark Streaming.

• spark-deployer

  3.5 0.0 Scala

  A sbt plugin which helps deploying Apache Spark stand-alone cluster and submitting job on cloud system like AWS EC2.

• Shadoop

  1.5 0.0 Scala

  A Scala DSL for Hadoop MapReduce.

* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest. Visit our partner's website for more details.

Popular Comparisons

• Scalding
  vs
  Apache Spark
• Apache Spark
  vs
  Summingbird
• Gearpump
  vs
  Flink
• Gearpump
  vs
  Apache Spark
• Gearpump
  vs
  Kafka

SaaSHub - Software Alternatives and Reviews Sponsored www.saashub.com