Improving Data Generation process with Slurm and Singularity

Currently in the simulation design and research space, there exists a desire to use the power of HPC resources for data generation and analysis without the complexity that comes with manual preparation and submission of jobs. This presentation covers meeting this need by developing tools that can interact with Slurm, and other CLI components, to provide a streamlined process for preparing and submitting containerized jobs on the HPCMP system. The discussion will outline wrapper functionality around Slurm as well as container ingestion and preparation with Singularity. The Simulation of Federated Applications (SOFA) will also be introduced.

PRESENTER

Lambert, Brandon
blambert@anyarinc.com
850-739-3897

Anyar Inc.

CO-AUTHORS

Hagen, Dylan
dhagen@anyarinc.com

Burch, William
wburch@anyarinc.com

CATEGORY

Container Implementation/deployment

SYSTEMS USED

Reef and the DEWD box

SECRET

No