VTK tests take a long time in CI

I just noticed that the VTK tests take a long time in the CI system (more than 10 minutes in total for each target). Is there something we can do about that (smaller grids or maybe build those tests with optimization)? Running those tests takes more than third of the overall time required for compiling + running...