LynxKite v1.5.0 Release Notes

    • Kite configuration setting YARN_NUM_EXECUTORS is replaced by the more general NUM_EXECUTORS which applies to the standalone spark cluster setup as well.
    • Reorganized operation categories. We hope you find them more logical.
    • The Batch processing API is now ready for use. It allows you to run a sequence of operations from the command line. For more details see the Batch processing API section in the manual.
    • Richer progress indicator.
    • LynxKite on EC2 will now always use ephemeral HDFS to store data. This data is lost if you stop or destroy the cluster. Use the new s3copy command if you want to save the data to S3. (The data does not have to be restored from S3 to HDFS. It will be read directly from S3.) This also means significant performance improvements for EC2 clusters.
    • User passwords can now be changed.
    • New operation Metagraph is useful for debugging and perhaps also for demos.
    • Added an experimental tool for cleaning up old data. It is accessible as /#/cleaner.
    • The title and tagline on the splash page can be customized through the KITE_TITLE and KITE_TAGLINE variables in .kiterc.
    • A large number of stability and performance improvements.
    • tags.journal files will not grow large anymore.