Skip to content

Reply To: Multiple GPU compiler error: cannot find -lmpi_cxx: No such file or director

OpenLB – Open Source Lattice Boltzmann Code Forums on OpenLB General Topics Multiple GPU compiler error: cannot find -lmpi_cxx: No such file or director Reply To: Multiple GPU compiler error: cannot find -lmpi_cxx: No such file or director

#8757
Adrian
Keymaster

If you want to use nvcc directly for the entire compilation you quite likely will need to manually prescribe all MPI flags. Those are usually set by the mpicxx wrapper, you can get them for your environment using mpicxx --showme:compile resp. --showme:link. This is what is suggested in the config/gpu_openmpi.mk config (which I assume you started with?)

I would recommend to use the config/gpu_openmpi_mixed.mk as a starting point. You can compare config/gpu_horeka_nvidiahpc_mixed.mk to see how this looks like for a real world cluster.

I assume you already have selected the CUDA and MPI modules (with CUDA-awareness compiled in) for your cluster? If so I should be able to guide you to a working config given the output of mpicxx --showme and (optionally) the path to the CUDA module.

You may also be lucky and be able to use config/gpu_openmpi_mixed.mk basically unmodified if the cluster modules are set up well. This recently happened to me on the Karolina cluster at IT4I (unfortunately this is also the only cluster I encountered where all required modules were set up fully, removing the need for any manual flag twiddling).