Schemer alternatives and similar packages
Based on the "Big Data" category.
Alternatively, view Schemer alternatives based on common mentions on social networks and blogs.
-
Apache Spark
Apache Spark - A unified analytics engine for large-scale data processing -
-
Deeplearning4J
Model import deployment framework for retraining models (pytorch, tensorflow,keras) deploying in JVM Micro service environments, mobile devices, iot, and Apache Spark -
-
-
-
-
Reactive-kafka
Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka. -
-
-
-
-
-
-
-
metorikku
A simplified, lightweight ETL Framework based on Apache Spark -
-
-
-
GridScale
Scala library for accessing various file, batch systems, job schedulers and grid middlewares. -
Sparkplug
Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌 -
Spark Utils
Basic framework utilities to quickly start writing production ready Apache Spark applications -
Spark Tools
Executable Apache Spark Tools: Format Converter & SQL Processor
* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest.
Do you think we are missing an alternative of Schemer or a related project?
|
Scout APM: A developer's best friend. Try free for 14-days
sponsored
scoutapm.com
|
Popular Comparisons
-
SchemervsSummingbird
-
Apache SparkvsScalding
-
SummingbirdvsApache Spark
-
GearpumpvsFlink
-
GearpumpvsApache Spark
|
SaaSHub - Software Alternatives and Reviews
sponsored
www.saashub.com
|
README
schemer
Schema registry with support for CSV, TSV, AVRO, JSON and Parquet. Has ability to infer schema from a given data source.
Schemer UI [WIP]
Schemer UI is the wizard based frontend for Schemer. It provides a wizard based schema creation and versioning workflow apart from browsing and search capabilities. It is a work in progress. [More screens](schemer-ui.md)
Schemer Core
schemer-core is the core library that implements most of the logic needed to understand the supported schema types along with the schema inference. To use schemer-core directly, just add it to your dependencies:
libraryDependencies += "com.indix" %% "schemer" % "v0.2.3"
Schemer Registry
schemer-registry is a schema registry for storing the metadata about schema and schema versions. It provides a GraphQL API for adding, viewing and inferring schemas.
Schemer Registry is available as a docker image at DockeHub
Running Locally
Local docker based PostgreSQL can be run as follows:
docker run -e POSTGRES_USER=schemer -e POSTGRES_PASSWORD=schemer -e PGDATA=/var/lib/postgresql/data/pgdata -e POSTGRES_DB=schemer -v $(pwd)/schemer_db:/var/lib/postgresql/data/pgdata -p 5432:5432 postgres:9.5.0
Remove schmer_db folder to clear all data and start from scratch.
The registry service can be run using sbt:
sbt "project registry" ~reStart