Reply To: Multiple GPU on HPC Calculation Signal: Segmentation fault (11)
OpenLB – Open Source Lattice Boltzmann Code › Forums › on OpenLB › General Topics › Multiple GPU on HPC Calculation Signal: Segmentation fault (11) › Reply To: Multiple GPU on HPC Calculation Signal: Segmentation fault (11)
Dear Yuji,
I got the bugs under control and it runs on multiple GPUs, it was a problem with Dresden University of Technology’s HPC, the UCX CUDA needs to be loaded separately.
For my future colleagues using Dresden’s HPC, here is what needs to be set up:
You need to load the following packages:
ml release/23.04 GCC/11.3.0 OpenMPI/4.1.4 CUDA/11.7 UCX-CUDA
My configuration looks like this:
# Example of a build configuration for OpenLB 1.7 with CUDA and OpenMPI
CXX := nvcc -ccbin=mpicxx
CC := nvcc -ccbin=mpicc
CXXFLAGS := -O3
CXXFLAGS += -std=c++17
PARALLEL_MODE := MPI
#MPIFLAGS := -lmpi_cxx -lmpi
PLATFORMS := CPU_SISD GPU_CUDA
CUDA_ARCH := 70 #or 80 for Alpha
FLOATING_POINT_TYPE := Float
USE_EMBEDDED_DEPENDENCIES := ON