SCAILFIN

The main goal of the SCAILFIN project is to deploy artificial intelligence and likelihood-free inference (LFI) techniques and software using scalable cyberinfrastructure (CI) to be integrated into existing CI elements, such as the REANA system. Modular infrastructure has been constructed to support the running of extremely complex workflows on large HPC systems. These workflows can orchestrate the generation of data for the training of complex ML algorithms at scale.

Current activities include the development of back-end modules for the REANA system that enable it to generate sequences of jobs on a variety of HPC systems, including CORI at NERSC and various XSEDE machines. Various workflow languages are under investigation/implemention, including PARSL, MLFlow, CWL, and Yadage. The MadMiner package is in use to glue together the various aspects of the ML workflows.