LynxKite v1.5.0 Release Notes
-
- Kite configuration setting
YARN_NUM_EXECUTORS
is replaced by the more generalNUM_EXECUTORS
which applies to the standalone spark cluster setup as well. - Reorganized operation categories. We hope you find them more logical.
- The Batch processing API is now ready for use. It allows you to run a sequence of operations from the command line. For more details see the Batch processing API section in the manual.
- Richer progress indicator.
- LynxKite on EC2 will now always use ephemeral HDFS to store data. This data is lost if you
stop
ordestroy
the cluster. Use the news3copy
command if you want to save the data to S3. (The data does not have to be restored from S3 to HDFS. It will be read directly from S3.) This also means significant performance improvements for EC2 clusters. - User passwords can now be changed.
- New operation Metagraph is useful for debugging and perhaps also for demos.
- Added an experimental tool for cleaning up old data. It is accessible as
/#/cleaner
. - The title and tagline on the splash page can be customized through the
KITE_TITLE
andKITE_TAGLINE
variables in.kiterc
. - A large number of stability and performance improvements.
- tags.journal files will not grow large anymore.
- Kite configuration setting