Schemer alternatives and similar packages
Based on the "Big Data" category
-
Kafka
Kafka is a message broker project and aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds. -
Scrunch
A Scala wrapper for Apache Crunch which provides a framework for writing, testing, and running MapReduce pipelines. -
spark-deployer
A sbt plugin which helps deploying Apache Spark stand-alone cluster and submitting job on cloud system like AWS EC2.
* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest. Visit our partner's website for more details.
Do you think we are missing an alternative of Schemer or a related project?
Popular Comparisons
-
Apache SparkvsScalding
-
SummingbirdvsApache Spark
-
GearpumpvsFlink
-
GearpumpvsApache Spark
-
GearpumpvsKafka
|
SaaSHub - Software Alternatives and Reviews
View more from us
|
README
schemer
Schema registry with support for CSV, TSV, AVRO, JSON and Parquet. Has ability to infer schema from a given data source.
Schemer UI [WIP]
Schemer UI is the wizard based frontend for Schemer. It provides a wizard based schema creation and versioning workflow apart from browsing and search capabilities. It is a work in progress. [More screens](schemer-ui.md)
Schemer Core
schemer-core is the core library that implements most of the logic needed to understand the supported schema types along with the schema inference. To use schemer-core directly, just add it to your dependencies:
libraryDependencies += "com.indix" %% "schemer" % "v0.2.3"
Schemer Registry
schemer-registry is a schema registry for storing the metadata about schema and schema versions. It provides a GraphQL API for adding, viewing and inferring schemas.
Schemer Registry is available as a docker image at DockeHub
Running Locally
Local docker based PostgreSQL can be run as follows:
docker run -e POSTGRES_USER=schemer -e POSTGRES_PASSWORD=schemer -e PGDATA=/var/lib/postgresql/data/pgdata -e POSTGRES_DB=schemer -v $(pwd)/schemer_db:/var/lib/postgresql/data/pgdata -p 5432:5432 postgres:9.5.0
Remove schmer_db folder to clear all data and start from scratch.
The registry service can be run using sbt:
sbt "project registry" ~reStart