What can execute CWL descriptions? §

CWL provides a solution to describing portable, re-usable workflows while also being workflow-engine and vendor-neutral. CWL has gained much traction and is currently widely supported in practice. In addition to the Free and Open Source implementations, certain platforms/engines have in-development or partial support for CWL as well.

Some workflow users require the maintenance and risk-mitigation guarantees offered by commercial operations. There are multiple commercially supported systems that support CWL for executing workflows and they are available from vendors such as Curii (Arvados), DNAnexus, IBM (IBM® Spectrum LSF), Illumina (Illumina Connected Analytics), and Seven Bridges Genomics.

Wide adoption benefits from our principles: CWL offers conformance tests, but the CWL community does not yet test or certify CWL implementations, or specific technology stacks. Instead, plaform/service providers self-certify support for CWL, based on a particular technology configuration they deploy and maintain.

In Production §

Software Description Self-Reported Compliance Platform support
cwltool Reference implementation of CWL CWL v1.0 - v1.2 Linux, OS X, Windows, local execution only
Arvados Distributed computing platform for data analysis on massive data sets. Using CWL on Arvados CWL v1.0 - v1.2 Required AWS, GCP, Azure, Slurm, LSF
Toil Toil is a workflow engine entirely written in Python. CWL v1.0 - v1.2 AWS, Azure, GCP, Grid Engine, HTCondor, LSF, Mesos, OpenStack, Slurm, PBS/Torque
CWL-Airflow Package to run CWL workflows in Apache-Airflow (supported by BioWardrobe Team, CCHMC) CWL v1.0 - v1.2 Linux, OS X
StreamFlow Workflow Management System for hybrid HPC-Cloud infrastructures CWL v1.0 - v1.2 Required
(and nearly all optional features)
Kubernetes, HPC with Singularity (PBS, Slurm), Occam, multi-node SSH, local-only (Docker, Singularity)

Partial implementations §

Software Description Self-Reported Compliance Platform support
ep3 Extremely Pluggable Pipeline Processor CWL v1.0 Required local
REANA RE usable ANAlyses CWL v1.0 Required Kubernetes
Xenon Run CWL workflows using Xenon CWL v1.0 Xenon Conformance Required Percentage any Xenon backend: local, ssh, SLURM, Torque, Grid Engine
Galaxy Web-based platform for data intensive biomedical research.  
cwl-tes CWL engine backended by the GA4GH Task Execution API   Alicloud, AWS, Google, HPC, local, Spark, TES
Calrissian CWL Engine built for Kubernetes   Kubernetes
Mariner “The Gen3 Workflow Execution Service”, Apache 2.0 licensed, written in Go, also implements the GA4GH WES API   Kubernetes
Pegasus Pegasus Workflow Management System Partial support for importing CWL workflows is under development  

See also: an ongoing analysis of CWL Implementations by the BioExcel Center of Excellence.