Resolve "Rework system tests"
What does this MR do?
Completely rework the system tests for more granular information and improved CI runtime.
Changes:
-
add custom make
targets for testing:-
test_dorie_exec
: simpledorie
wrapper test commands -
test_run_ode
: benchmarks against ODE solutions -
test_run_ref
: bechmarks against Muphi reference -
test_run_parallel
: Check if solutions of sequential and parallel execution are the same
-
-
Revamp ODE test: Fewer tests, narrow tolerances -
Remove -Werror
from debug configurations, but add tobuild:debug
. This build is allowed to fail now. -
Remove Parameter field correlation tests: We trust dune-randomfield
... -
Merge !33 (merged) into this -
Reduce error tolerances for ODE tests after merge -
Remove deploy
stage for now -
Fix default reference testing tolerances
Is there something that needs to be double checked?
No
Can this MR be accepted?
-
New pipeline passing
Related issues
Closes #46 (closed)
Edited by Lukas Riedel