.. role:: chocolate Welcome to JAWS --------------- .. figure:: /Figures/JAWS_2.png :scale: 100% Overview -------- JAWS (JGI Analysis Workflow Service) is a scalable and centralized workflow execution framework developed by the `DOE Joint Genome Institute `_ (JGI). It enables researchers to efficiently run complex computational workflows across multiple high-performance computing (HPC) resources. JAWS automates resource configuration, data transfer, and job scheduling, allowing users to focus on their scientific tasks while ensuring workflow reproducibility and scalability. Key Features ------------ - **Multi-Site Workflow Management:** JAWS orchestrates workflows across multiple sites, including `LabIT `_, `NERSC `_, `EMSL `_, and expanding to `ALCF `_ (Crux) and `OLCF `_ (Defiant). - **User-Friendly CLI and Python Library**: The JAWS Client provides a lightweight and efficient command-line interface (CLI) and Python library for seamless workflow submission, monitoring, and retrieval of results. - **Leverages Community-Supported Tools**: Uses `Cromwell `_, `Workflow Description Language (WDL) `_, `HTCondor `_, and containerization technologies like `Apptainer `_ and `Shifter `_. - **Data Transfer & Security**: Integrates `Globus `_ for secure and efficient data movement. - **User Support & Engagement**: Regular user meetings, workshops, and dedicated office hours. - **Performance Monitoring**: JAWS is integrated with Elasticsearch and Kibana to track job performance metrics, providing users with execution insights and efficiency. Getting Started with JAWS ------------------------- New to JAWS? Start by exploring: - :doc:`Why JAWS ` - :doc:`How JAWS Works ` - :doc:`Installation & Setup ` Ready to start? Whether you're writing your own workflows or running existing ones, here's how to dive in: - :doc:`Build Your Own WDL `: Learn how to create workflows using WDL, with tips and best practices for building robust and scalable pipelines. - :doc:`Run an Existing WDL in JAWS `: Start executing workflows with JAWS by following this quickstart guide. .. toctree:: :hidden: :name: extradoc :maxdepth: 1 :caption: Intro How JAWS Works Why use JAWS JAWS Video Library Getting Help FAQ .. toctree:: :hidden: :name: getstarted :maxdepth: 2 :caption: JAWS Configuring the JAWS Client Quickstart Example JAWS Commands JAWS Python Libray JAWS Teams JAWS Performance Metrics JAWS Notifications JAWS Fair-share Policies JAWS Guidelines JAWS Backend JAWS Refdata JAWS Troubleshooting .. toctree:: :hidden: :name: specsdoc :maxdepth: 1 :caption: General Resources Compute Resources Cromwell Best Practices for WDLs Working Examples JGI Subworkflows and Tasks Installing MySQL for Cromwell .. toctree:: :hidden: :name: wdldevelop :maxdepth: 3 :caption: Tutorials Lesson 1: Development Environment Lesson 2: Create Docker Container Lesson 3: Write a WDL Lesson 4: Defining the Input Data .. toctree:: :hidden: :name: release :maxdepth: 3 :caption: JAWS Release JAWS Release Notes .. toctree:: :hidden: :name: training :maxdepth: 2 :caption: JAWS Events Upcoming JAWS Events JAWS Events Archive .. toctree:: :hidden: :name: extras :maxdepth: 3 :caption: Extra Links Tutorial for Testing WDLs with Pytest