catch3
Progmasoft Catch3: an independently maintained C++17 test framework with a parallel runner, property checks, snapshots and structured results.
Clonegit clone https://git.progmasoft.com/catch3
Document that the default test run order is now random
- Commit
bdc634e9f1be010a7fe9558053215c9a18f23a24- Author
- Martin Hořeňovský ·
- Parents
2a8a8a721051
Changes
docs/command-line.md | 12 +++++++++--- 1 file changed, 9 insertions(+), 3 deletions(-) diff --git a/docs/command-line.md b/docs/command-line.md index 18c4eeaf..6096802e 100644 --- a/docs/command-line.md +++ b/docs/command-line.md @@ -398,18 +398,24 @@ use test specs to filter this list down to what you want first. Test cases are ordered one of three ways: ### decl -Declaration order (this is the default order if no --order argument is provided). +Declaration order. + Tests in the same translation unit are sorted using their declaration orders, different TUs are sorted in an implementation (linking) dependent order. ### lex -Lexicographic order. Tests are sorted by their name, their tags are ignored. +Lexicographic order. + +Tests are sorted by their name, their tags are ignored. ### rand +Randomized order. The default order. + +> Randomized order has been made default in Catch2 X.Y.Z -Randomly ordered. The order is dependent on Catch2's random seed (see +The order is dependent on Catch2's random seed (see [`--rng-seed`](#rng-seed)), and is subset invariant. What this means is that as long as the random seed is fixed, running only some tests (e.g. via tag) does not change their relative order.