[thanhphatvt]

I’m sorry, I just fixed the link

[thanhphatvt]

Hi Adrian,
I tried with higher resolution, but the result is the same. As you can see in my result, I think at the peak, the error is quite high, I want to reduce the discrepancy at that peak.
I’ll try other collision model.
Thank you!

[thanhphatvt]

Hi Alex,
Thank you so much!
Let me try it.

[thanhphatvt]

Thank you so much!

[thanhphatvt]

Hi aseidler,
I have the same problem with you and could I ask how can you get your MPIFLAGS for your simulation?
Thanks

[thanhphatvt]

Hello,
I’m still on it but now I got this message when I make the file
“nvcc cavity3d.o -o cavity3d -lolbcore -L../../../external/lib -lmpi_cxx -lmpi -lpthread -lz -ltinyxml -lcuda -lcudadevrt -lcudart -L../../../build/lib
/usr/bin/ld: cannot find -lmpi_cxx: No such file or directory
collect2: error: ld returned 1 exit status
make: *** [../../../default.single.mk:38: cavity3d] Error 1
”
I know the message from the directory but last time I can run but now it has the problem. Could you help me in this situation?
Thanks

[thanhphatvt]

Yes, it’s laminar/cylinder3d case. This also happen when I remove and restart. I haven’t changed anything in the code.
I see this problem when I run with MPI by this command “”mpirun -np 4 bash -c ‘export CUDA_VISIBLE_DEVICES=${OMPI_COMM_WORLD_LOCAL_RANK}; ./cylinder3d'””
If I use ./cylinder3d, I can open the file normally.

Here is my workstation when I run with MPI:
| NVIDIA-SMI 470.239.06 Driver Version: 470.239.06 CUDA Version: 11.4 |
|——————————-+———————-+———————-+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 Tesla K80 Off | 00000000:05:00.0 Off | 0 |
| N/A 44C P0 57W / 149W | 369MiB / 11441MiB | 30% Default |
| | | N/A |
+——————————-+———————-+———————-+
| 1 Tesla K80 Off | 00000000:06:00.0 Off | 0 |
| N/A 36C P0 70W / 149W | 359MiB / 11441MiB | 27% Default |
| | | N/A |
+——————————-+———————-+———————-+
| 2 Tesla K80 Off | 00000000:09:00.0 Off | 0 |
| N/A 43C P0 59W / 149W | 369MiB / 11441MiB | 28% Default |
| | | N/A |
+——————————-+———————-+———————-+
| 3 Tesla K80 Off | 00000000:0A:00.0 Off | 0 |
| N/A 36C P0 71W / 149W | 359MiB / 11441MiB | 29% Default |
| | | N/A |
+——————————-+———————-+———————-+

+—————————————————————————–+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
| 0 N/A N/A 16351 C ./cylinder3d 366MiB |
| 1 N/A N/A 16352 C ./cylinder3d 356MiB |
| 2 N/A N/A 16353 C ./cylinder3d 366MiB |
| 3 N/A N/A 16355 C ./cylinder3d 356MiB

Thanks

[thanhphatvt]

Dear Adrian,
When I use the mpi with 2 GPUs for running the simulation and I got the problem with the results. I can not open the result with Paraview. Here is the errors in Paraview

ERROR: In vtkXMLParser.cxx, line 368
vtkXMLDataParser (000001E3D2A8DA40): Error parsing XML in stream at line 13, column 0, byte index 894: junk after document element

ERROR: In vtkXMLReader.cxx, line 576
vtkXMLImageDataReader (000001E3D2B3BFC0): Error parsing input file. ReadXMLInformation aborting.

ERROR: In vtkExecutive.cxx, line 730
vtkCompositeDataPipeline (000001E3CCEC9130): Algorithm vtkXMLImageDataReader (000001E3D2B3BFC0) returned failure for request: vtkInformation (000001E3CD00B1E0)
Debug: Off
Modified Time: 409141
Reference Count: 1
Registered Events: (none)
Request: REQUEST_INFORMATION
FORWARD_DIRECTION: 0
ALGORITHM_AFTER_FORWARD: 1

ERROR: In vtkXMLParser.cxx, line 368
vtkXMLDataParser (000001E3D2A8E610): Error parsing XML in stream at line 13, column 0, byte index 894: junk after document element

ERROR: In vtkXMLReader.cxx, line 576
vtkXMLImageDataReader (000001E3D2B3CE80): Error parsing input file. ReadXMLInformation aborting.

ERROR: In vtkExecutive.cxx, line 730
vtkCompositeDataPipeline (000001E3CCEC10F0): Algorithm vtkXMLImageDataReader (000001E3D2B3CE80) returned failure for request: vtkInformation (000001E3CD00D550)
ERROR: In vtkXMLParser.cxx, line 368
vtkXMLDataParser (000001E3D2A8DA40): Error parsing XML in stream at line 13, column 0, byte index 894: junk after document element

ERROR: In vtkXMLReader.cxx, line 576
vtkXMLImageDataReader (000001E3D2B3BFC0): Error parsing input file. ReadXMLInformation aborting.

ERROR: In vtkExecutive.cxx, line 730
vtkCompositeDataPipeline (000001E3CCEC9130): Algorithm vtkXMLImageDataReader (000001E3D2B3BFC0) returned failure for request: vtkInformation (000001E3CD00B1E0)
Debug: Off
Modified Time: 409141
Reference Count: 1
Registered Events: (none)
Request: REQUEST_INFORMATION
FORWARD_DIRECTION: 0
ALGORITHM_AFTER_FORWARD: 1

ERROR: In vtkXMLParser.cxx, line 368
vtkXMLDataParser (000001E3D2A8E610): Error parsing XML in stream at line 13, column 0, byte index 894: junk after document element

ERROR: In vtkXMLReader.cxx, line 576
vtkXMLImageDataReader (000001E3D2B3CE80): Error parsing input file. ReadXMLInformation aborting.

ERROR: In vtkExecutive.cxx, line 730
vtkCompositeDataPipeline (000001E3CCEC10F0): Algorithm vtkXMLImageDataReader (000001E3D2B3CE80) returned failure for request: vtkInformation (000001E3CD00D550)
Debug: Off
Modified Time: 409430
Reference Count: 1
Registered Events: (none)
Request: REQUEST_INFORMATION
FORWARD_DIRECTION: 0
ALGORITHM_AFTER_FORWARD: 1

What should I do in this situation? Or Did I make something wrong in the simulation?
Thank you Adrian!

[thanhphatvt]

Thank you so much. It’s my mistake. I miss one character in the command so it did not work
It’s working now.
Thank you

[thanhphatvt]

Hi Adrian,
Thank you for your help. I’ve solved my problem. I uninstalled open mpi and installed again. And now it can work normally. Thank you so much!

[thanhphatvt]

Yes I compiled in WSL.
For installing MPI, I used tech report for doing it.
I’ve already installed libopenmpi-dev
libopenmpi-dev is already the newest version (4.1.2-2ubuntu1).

[thanhphatvt]

Hello Adrian,
Thanks for your reply. Here is mpi version which I used
mpirun –version
mpirun (Open MPI) 4.1.2

Report bugs to http://www.open-mpi.org/community/help/

[thanhphatvt]

Hi Adrian,
The problem is like this. After I removed the line 78. Thank you
nvcc -c -o build/trees.o ./trees.c
nvcc -c -o build/zutil.o ./zutil.c
nvcc -c -o build/compress.o ./compress.c
nvcc -c -o build/uncompr.o ./uncompr.c
nvcc -c -o build/gzclose.o ./gzclose.c
nvcc -c -o build/gzlib.o ./gzlib.c
nvcc -c -o build/gzread.o ./gzread.c
nvcc -c -o build/gzwrite.o ./gzwrite.c
ar rc build//libz.a ./build/adler32.o ./build/crc32.o ./build/deflate.o ./build/infback.o ./build/inffast.o ./build/inflate.o ./build/inftrees.o ./build/trees.o ./build/zutil.o ./build/compress.o ./build/uncompr.o ./build/gzclose.o ./build/gzlib.o ./build/gzread.o ./build/gzwrite.o
make[2]: Leaving directory `/home/gigabyte_cuda_03/Downloads/olb-1.6r0/external/zlib’
cp zlib/build/libz.a lib/
make -C tinyxml
make[2]: Entering directory `/home/gigabyte_cuda_03/Downloads/olb-1.6r0/external/tinyxml’
nvcc -c tinystr.cpp -o build/tinystr.o
In file included from tinystr.cpp:32:0:
tinystr.h: In copy constructor ‘TiXmlString::TiXmlString(const TiXmlString&)’:
tinystr.h:82:50: error: ‘nullptr’ was not declared in this scope
TiXmlString ( const TiXmlString & copy) : rep_(nullptr)
^
tinystr.h: In constructor ‘TiXmlString::TiXmlString(const char*)’:
tinystr.h:89:58: error: ‘nullptr’ was not declared in this scope
TIXML_EXPLICIT TiXmlString ( const char * copy) : rep_(nullptr)
^
tinystr.h: In constructor ‘TiXmlString::TiXmlString(const char*, TiXmlString::size_type)’:
tinystr.h:96:72: error: ‘nullptr’ was not declared in this scope
TIXML_EXPLICIT TiXmlString ( const char * str, size_type len) : rep_(nullptr)
^
make[2]: *** [build/tinystr.o] Error 1
make[2]: Leaving directory `/home/gigabyte_cuda_03/Downloads/olb-1.6r0/external/tinyxml’
make[1]: *** [tinyxml] Error 2
make[1]: Leaving directory `/home/gigabyte_cuda_03/Downloads/olb-1.6r0/external’
make: *** [dependencies] Error 2

[thanhphatvt]

Hi Adrian,
Thanks for your reply. I use the cuda_arch value is 37. And also I use the cuda version is 11.
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2020 NVIDIA Corporation
Built on Wed_Jul_22_19:09:09_PDT_2020
Cuda compilation tools, release 11.0, V11.0.221
Build cuda_11.0_bu.TC445_37.28845127_0

Thank you so much!

[thanhphatvt]

Hi Adrian,
I had the same error but I use K80 card. Could you help me to solve it.
Command-line error #614: invalid error number in diagnostic control option: 20014
1 catastrophic error detected in this compilation.
Thank you so much!

[Author]

Posts