Cylc (“silk”) is a workflow engine for cycling systems
Use cases include:
Running successive cycles of an environmental forecasting system.
Splitting long model integrations into many smaller chunks, with associated processing tasks for each chunk.
Running successive steps in some multi-task iterative process, such as for optimizing model parameters.
Processing a series of datasets (potentially concurrently, to the extent possible) as they are generated or received.
Cylc was originally developed for operational environmental forecasting at NIWA by Dr Hilary Oliver - however it is not specialized to forecasting in any way. It is now an Open Source collaboration involving NIWA, Met Office, and others. It is available under the GPL v3 license.
If you use Cylc to automate your workflows, please cite Cylc in your publications.