Running Precompiled Applications

While moving applications to HPCs may involve extensive modification of source code to be compiled on an HPC, some users need to run precompiled Linux applications on HPCs. Source may not be available and/or it is desirable to use the same binary applications to enable reproducible results or avoid the effort of building the software. At times, this works “out of the box”: install the application and run it. Other times, missing shared libraries, wrong library versions, graphical contexts, or even other programs mean that the application does not run. This talk covers recognizing what is missing or wrong and various methods of meeting missing dependencies. These various methods have each been used on multiple PET Mission Projects and include: • Finding and locally “installing” (extracting) pre-packaged shared object libraries and programs • Building missing libraries and programs • Using Singularity to meet dependencies or enable running programs meant for a different Linux distribution than the one on an HPC While Singularity may be a viable alternative in many cases, other methods may be simpler, involve less effort, and avoid the limitations of using containers. They are particularly useful for running GUI-based applications on the DSRC portals. HPCs are shared assets, and installing every potentially needed package is not possible. In particular, compute nodes are mostly targeted at background computing and may have a smaller set of installed packages.

IMPACT

Accomplishment: Ran multiple modeling and simulation frameworks and other software on HPCs without compiling source where the HPC did not have all required packages or had a different Linux distribution or version than that needed by the software. Result: Completed analysis that drives acquisition choices, enabled repeatable results across HPCs and local compute assets, enabled extending GUI use for setup and visualization, expanded HPC use into new fields, and provided test and evaluation of defense capabilities.

PRESENTER

Donnelly, Bob
bob.donnelly@gdit.com
667-228-5493

HPCMP PET, General Dynamics Information Technology

CATEGORY

Moving any existing, precompiled application to HPCs

SECONDARY CATEGORY

Mod, Sim & Analysis for Decision Making

SYSTEM(S) USED

Multiple HPCs at Unclassified and Secret levels