GridScale alternatives and similar packages
Based on the "Big Data" category.
Alternatively, view GridScale alternatives based on common mentions on social networks and blogs.
-
-
-
-
Deeplearning4J
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn... -
-
-
-
Reactive-kafka
Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka. -
-
-
-
-
-
-
-
-
-
-
Schemer
Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API. -
-
Spark Utils
Basic framework utilities to quickly start writing production ready Apache Spark applications -
-
CodeRabbit: AI Code Reviews for Developers
* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest.
Do you think we are missing an alternative of GridScale or a related project?
README
GridScale
GridScale is a scala library for accessing various file and batch systems. For the time being it supports:
- Remote SSH servers,
- PBS clusters,
- SLURM clusters,
- SGE clusters,
- OAR clusters,
- Condor flocks
- HTTP file lists,
- IPFS nodes,
- EGI computing grid via DIRAC pilot jobs system.
Licence
GridScale is licensed under the [GNU Affero GPLv3](LICENSE.md) software license.
Build
GridScale builds with sbt.
Use the compile and/or package task to build all the modules.
Imports
In order to use gridscale you should import the namespace corresponding to the job system you want to use:
import gridscale.pbs._
SBT
GridScale is cross compiled against serveral versions of scala. To use on of its modules add a dependency like:
libraryDependencies += "fr.iscpif.gridscale" %% "pbs" % version
Examples
Up to date examples are available in the [example directory](examples/).
Development
GridScale can be generated locally using:
sbt publish-local
To release in one step, use:
sbt 'release with-defaults'
*Note that all licence references and agreements mentioned in the GridScale README section above
are relevant to that project's source code only.