OpenBSD port: running tests

[thyssentishman]

Hi,

I'm the maintainer of the OCCT port on OpenBSD and I'm trying to get test to work. On my last run we got the following results (from summary.html):

142    BAD          Known problem
265    FAILED       Test failed (regression)
1      IMPROVEMENT  Possible improvement (expected problem not detected)
5457   OK           Test passed OK
15217  SKIPPED      Test skipped due to lack of data file

I'm running the tests as follows:

/usr/local/bin/bash -c "source /path/to/env.sh && \
    CSF_TestScriptsPath=/path/to/tests/dir \
    /usr/local/bin/DRAWEXE -b -c 'pload ALL; testgrid -outdir /path/to/output/dir; exit;'"

Through the interface provided by the summary.html file, I was able to identify why some of these tests are failing, however, I don't want to run all tests again to test a fix. Is it possible to re-run only the failed tests? I have a copy of the test.log file, so I can get a list of the failed tests easily. Additionally, as you can see from the tests results, a lot of tests are skipped due to lack of data. Is this an issue on my side? We are fetching the latest release from the Github Releases and compiling with the following options:

CONFIGURE_ARGS +=	-DUSE_TK=ON \
			-DUSE_FREETYPE=ON \
			-DUSE_OPENGL=ON \
			-DUSE_TBB=OFF \
			-DUSE_GLES2=OFF \
			-DUSE_OPENVR=OFF \
			-DUSE_FREEIMAGE=OFF \
			-DUSE_FFMPEG=OFF \
			-DUSE_VTK=OFF \
			-DUSE_RAPIDJSON=OFF \
			-DUSE_DRACO=OFF \
			-DBUILD_SAMPLES_QT=OFF \
			-DINSTALL_DIR_RESOURCE="share/opencascade/src" \

Thank you.

[dpasukhi]

Hello, I assume, you do not use the CAD base, which is used for DRAW tests, the amount of skiped must be lower.
Please see the GitHub actions and their usage in GitHub workflow.
Restarting is possible, but even that, the tests on 4 cores takes onlt 20-30 min, it is not that long. In case if starting testgrid with warning, it means you do not build TCL with thread support.
Samples: https://github.com/Open-Cascade-SAS/OCCT/tree/master/.github/actions/run-tests
https://github.com/Open-Cascade-SAS/OCCT/tree/master/.github/actions/retest-failures

Also, to compleate tests, you need to enable draco, VTK, rapidjson, freetype and gles.