Schemer alternatives and similar packages
Based on the "Big Data" category.
Alternatively, view Schemer alternatives based on common mentions on social networks and blogs.
-
Apache Spark
Apache Spark - A unified analytics engine for large-scale data processing -
-
Deeplearning4J
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation. -
-
-
-
-
Reactive-kafka
Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka. -
-
-
-
-
-
-
metorikku
A simplified, lightweight ETL Framework based on Apache Spark -
-
-
-
-
GridScale
Scala library for accessing various file, batch systems, job schedulers and grid middlewares. -
Spark Utils
Basic framework utilities to quickly start writing production ready Apache Spark applications -
Sparkplug
Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌 -
Spark Tools
Executable Apache Spark Tools: Format Converter & SQL Processor
Delete the most useless function ever: context switching.
* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest.
Do you think we are missing an alternative of Schemer or a related project?
|
Build time-series-based applications quickly and at scale.
sponsored
www.influxdata.com
|
Popular Comparisons
-
SchemervsSummingbird
-
Apache SparkvsScalding
-
SummingbirdvsApache Spark
-
GearpumpvsFlink
-
GearpumpvsApache Spark
|
Clean code begins in your IDE with SonarLint
sponsored
www.sonarlint.org
|
README
schemer
Schema registry with support for CSV, TSV, AVRO, JSON and Parquet. Has ability to infer schema from a given data source.
Schemer UI [WIP]
Schemer UI is the wizard based frontend for Schemer. It provides a wizard based schema creation and versioning workflow apart from browsing and search capabilities. It is a work in progress. [More screens](schemer-ui.md)
Schemer Core
schemer-core is the core library that implements most of the logic needed to understand the supported schema types along with the schema inference. To use schemer-core directly, just add it to your dependencies:
libraryDependencies += "com.indix" %% "schemer" % "v0.2.3"
Schemer Registry
schemer-registry is a schema registry for storing the metadata about schema and schema versions. It provides a GraphQL API for adding, viewing and inferring schemas.
Schemer Registry is available as a docker image at DockeHub
Running Locally
Local docker based PostgreSQL can be run as follows:
docker run -e POSTGRES_USER=schemer -e POSTGRES_PASSWORD=schemer -e PGDATA=/var/lib/postgresql/data/pgdata -e POSTGRES_DB=schemer -v $(pwd)/schemer_db:/var/lib/postgresql/data/pgdata -p 5432:5432 postgres:9.5.0
Remove schmer_db folder to clear all data and start from scratch.
The registry service can be run using sbt:
sbt "project registry" ~reStart