Running Precompiled Applications
While moving applications to HPCs may involve extensive modification of source code to be compiled on an HPC, some users need to run precompiled Linux applications on HPCs. Source may not be available and/or it is desirable to use the same binary applications to enable reproducible results or avoid the effort of building the software. At times, this works “out of the box”: install the application and run it. Other times, missing shared libraries, wrong library versions, graphical contexts, or even other programs mean that the application does not run. This talk covers recognizing what is missing or wrong and various methods of meeting missing dependencies. These various methods have each been used on multiple PET Mission Projects and include: • Finding and locally “installing” (extracting) pre-packaged shared object libraries and programs • Building missing libraries and programs • Using Singularity to meet dependencies or enable running programs meant for a different Linux distribution than the one on an HPC While Singularity may be a viable alternative in many cases, other methods may be simpler, involve less effort, and avoid the limitations of using containers. They are particularly useful for running GUI-based applications on the DSRC portals. HPCs are shared assets, and installing every potentially needed package is not possible. In particular, compute nodes are mostly targeted at background computing and may have a smaller set of installed packages.
IMPACT
Accomplishment: Ran multiple modeling and simulation frameworks and other software on HPCs without compiling source where the HPC did not have all required packages or had a different Linux distribution or version than that needed by the software. Result: Completed analysis that drives acquisition choices, enabled repeatable results across HPCs and local compute assets, enabled extending GUI use for setup and visualization, expanded HPC use into new fields, and provided test and evaluation of defense capabilities.
PRESENTER
Donnelly, Bob
bob.donnelly@gdit.com
667-228-5493HPCMP PET, General Dynamics Information Technology
CATEGORY
Moving any existing, precompiled application to HPCs
SECONDARY CATEGORY
Mod, Sim & Analysis for Decision Making
SYSTEM(S) USED
Multiple HPCs at Unclassified and Secret levels