Skip to content

Resolve "Rework system tests"

Lukas Riedel requested to merge 46-rework-system-tests into master

What does this MR do?

Completely rework the system tests for more granular information and improved CI runtime.

Changes:

  • add custom make targets for testing:
    • test_dorie_exec: simple dorie wrapper test commands
    • test_run_ode: benchmarks against ODE solutions
    • test_run_ref: bechmarks against Muphi reference
    • test_run_parallel: Check if solutions of sequential and parallel execution are the same
  • Revamp ODE test: Fewer tests, narrow tolerances
  • Remove -Werror from debug configurations, but add to build:debug. This build is allowed to fail now.
  • Remove Parameter field correlation tests: We trust dune-randomfield ...
  • Merge !33 (merged) into this
  • Reduce error tolerances for ODE tests after merge
  • Remove deploy stage for now
  • Fix default reference testing tolerances

Is there something that needs to be double checked?

No

Can this MR be accepted?

  • New pipeline passing

Related issues

Closes #46 (closed)

Edited by Lukas Riedel

Merge request reports