Selected Tags

Click on a tag to remove it

More Tags

Click on a tag to add it and filter down

Big Data packages

Showing projects tagged as Big Data

  • Kafka

    10.0 9.7 L2 Java
    Kafka is a message broker project and aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds.
  • Apache Spark

    10.0 9.9 Scala
    Big data platform
  • Flink

    9.9 10.0 L2 Java
    Processing framework with powerful stream- and batch-processing capabilities.
  • Deeplearning4J

    9.9 9.6 L1 Java
    Deep Learning for Java, Scala & Clojure on Hadoop & Spark - From Skymind
  • Scalding

    9.6 6.6 Scala
    A Scala binding for the Cascading abstraction of Hadoop MapReduce.
  • Summingbird

    9.3 3.0 Scala
    An implementation of the “lambda architecture” as a software abstraction
  • Scio

    9.2 9.6 Scala
    A Scala API for Apache Beam and Google Cloud Dataflow
  • Reactive-kafka

    9.0 8.9 Scala
    Reactive Streams API for Apache Kafka.
  • BIDMach

    8.4 8.2 Jupyter Notebook
    CPU and GPU machine learning library, using JNI for GPU computation.
  • Jupyter Scala

    8.3 8.9 Scala
    Lightweight Scala kernel for Jupyter / IPython 3
  • Gearpump

    8.0 6.9 Scala
    Lightweight real-time big data streaming engine
  • Sparkta

    7.8 0.0 Scala
    Real Time Aggregation based on Spark Streaming.
  • Hail

    7.7 9.9 Scala
    Scalable genetic data analysis
  • Vegas

    7.2 2.4 Scala
    The missing MatPlotLib for Scala + Spark
  • Scoobi

    6.9 0.0 Scala
    Write type-safe Hadoop programs in idiomatic Scala way
  • metorikku

    5.2 8.2 Scala
    A simplified, lightweight ELT Framework based on Apache Spark
  • DynaML

    4.9 8.8 Scala
    Scala Library/REPL for Machine Learning Research
  • Scrunch

    4.8 4.3 L3 Java
    A Scala wrapper for Apache Crunch which provides a framework for writing, testing, and running MapReduce pipelines.
  • Scoozie

    4.7 0.0 Scala
    Scala DSL on top of Oozie XML
  • spark-deployer

    3.2 0.0 Scala
    A sbt plugin which helps deploying Apache Spark stand-alone cluster and submitting job on cloud system like AWS EC2.
  • Schemer

    2.9 2.8 Scala
    Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  • raster-frames

    1.8 0.0 Scala
    Spark DataFrames for earth observation data
  • Shadoop

    1.5 0.0 Scala
    A Scala DSL for Hadoop MapReduce.
  • GridScale

    1.5 6.6 Java
    A Scala API for computing clusters and grids.
  • Sparkplug

    1.3 0.0 Scala
    Spark package to "plug" holes in data using SQL based rules