set OMP_NUM_THREADS for make checks

The best parameters for our ssu buildbot builder should ideally be:

OCT_TEST_NJOBS = 4 # Num threads/2
OMP_NUM_THREADS=1

Based on the email from Sebastian. Testing this and OCT_TEST_NJOBS = 8 and merging the faster variant.

marked this merge request as draft

Testing

ENV OMP_NUM_THREADS=1
ENV OCT_TEST_NJOBS=4

at http://mpsd-kartoffel.desy.de:8010/#/buildrequests/1261?redirect_to_build=true

#18 (closed) 2251.5 Total run-time of the testsuite: 00:37:20

added 1 commit

• 3b342c0e - set OCT_TEST_MPI_NPROCS=2

Compare with previous version

Testing 3b342c0e - set OCT_TEST_MPI_NPROCS=2 :

ENV OMP_NUM_THREADS=1
ENV OCT_TEST_NJOBS=4
ENV OCT_TEST_MPI_NPROCS=2

at http://mpsd-kartoffel.desy.de:8010/#/builders/14/builds/94

Total run-time of the testsuite: 00:43:29

added 1 commit

• 550c1ac4 - Update Dockerfile

Compare with previous version

Testing 550c1ac4 - all 2s:

ENV OMP_NUM_THREADS=2
ENV OCT_TEST_NJOBS=2
ENV OCT_TEST_MPI_NPROCS=2

at http://mpsd-kartoffel.desy.de:8010/#/buildrequests/1262?redirect_to_build=true Total run-time of the testsuite: 12:12:15

Testing 21352081 - Overbook like sebastians script:

ENV OMP_NUM_THREADS=8
ENV OCT_TEST_NJOBS=4
ENV OCT_TEST_MPI_NPROCS=1

at http://mpsd-kartoffel.desy.de:8010/#/buildrequests/1263?redirect_to_build=true

Total run-time of the testsuite: 01:44:00

added 1 commit

• 21352081 - Overbook like sebastians script

Compare with previous version

added 1 commit

• 7b05dbdf - NJOBS=8 others 1

Compare with previous version

Testing 7b05dbdf - NJOBS=8 others 1

ENV OMP_NUM_THREADS=1
ENV OCT_TEST_NJOBS=8
ENV OCT_TEST_MPI_NPROCS=1

at http://mpsd-kartoffel.desy.de:8010/#/buildrequests/1264?redirect_to_build=true

Total run-time of the testsuite: 00:29:27

added 1 commit

• beae3bcb - njobs=2 mpiprocs=4

Compare with previous version

testing beae3bcb - njobs=2 mpiprocs=4

ENV OMP_NUM_THREADS=1
ENV OCT_TEST_NJOBS=2
ENV OCT_TEST_MPI_NPROCS=4

http://mpsd-kartoffel.desy.de:8010/#/buildrequests/1265?redirect_to_build=true

Test never completed, got killed due to idle

ENV OMP_NUM_THREADS=1
ENV OCT_TEST_NJOBS=8
ENV OCT_TEST_MPI_NPROCS=1

seems to be the best configuration for our buildbot which took 00:29:27 minutes for the check short. Setting that as the default configuration in our docker images.

added 1 commit

• 098bbaab - set appropriate job variables for the shortest check-short on our machine

Compare with previous version

marked this merge request as ready

requested review from @henning.glawe

changed target branch from develop to dev-23a

OCT_TEST_MPI_NPROCS should be larger than 1, otherwise you are not testing MPI ;)

I think then the configuration:

ENV OMP_NUM_THREADS=1
ENV OCT_TEST_NJOBS=4
ENV OCT_TEST_MPI_NPROCS=2

That had a runtime of 43 minutes makes the most sense. Can we merge this configuration @henning.glawe ?

added 1 commit

• 1f748810 - set MPI_Tasks = 2 OCT_NJOBS=4 NUM_THREADS=1

Compare with previous version