Parallel unit testing fails

[houstonhaynes]

Parallel unit testing fails

Issue #276 | Created by @gbaydin | 2021-02-22 02:11:42 UTC |

I have seen some tests fail when I add the attribute [<Parallelizable(ParallelScope.All)>] to all tests (docs here: https://docs.nunit.org/articles/nunit/writing-tests/attributes/parallelizable.html ).

I haven't confirmed this yet, but I suspect that the failure is because of a lack of thread safety in things like dsharp.config, dsharp.seed, etc. and perhaps due to the ComboInfo testing mechanism. It would be good to check the reasons and make the tests run in parallel.

---

Comment by @dsyme | 2021-02-22 16:01:18 UTC

I reckon this is expected - there are some tests which explicitly test the setting and resetting of the global configurations.

I think we need those tests, so I guess the solution would be to set Parallelizable and explicitly mark some tests as non-parallelizable.