diff options
| author | Martin Hořeňovský | 2022-04-19 10:32:13 +0200 |
|---|---|---|
| committer | Martin Hořeňovský | 2022-04-19 10:32:13 +0200 |
| commit | 17a04f88d90d3687bd561e89dab40e4ba6a55b83 (patch) | |
| tree | 76ccd8e074c7ed3e63cc7fa34be219cdb8a86627 /tests/SelfTest | |
| parent | 90e69050505ff210ca29e1c9e8feaf598de4fc74 (diff) | |
| download | catch3-17a04f88d90d3687bd561e89dab40e4ba6a55b83.tar.gz | |
Always report rng seed from builtin reporters
Not all reporters use a format that supports this, so TeamCity
and Automake reporters still do not report it. The console
reporter now reports it even on successful runs, where before
it only reported the rng seed in the header, which was showed
either for failed run, or for run with `-s`.
CLoses #2065
Diffstat (limited to 'tests/SelfTest')
10 files changed, 12 insertions, 8 deletions
diff --git a/tests/SelfTest/Baselines/compact.sw.approved.txt b/tests/SelfTest/Baselines/compact.sw.approved.txt index 03a07f53..bf9482c6 100644 --- a/tests/SelfTest/Baselines/compact.sw.approved.txt +++ b/tests/SelfTest/Baselines/compact.sw.approved.txt @@ -1,3 +1,5 @@ +Filters: ~[!nonportable]~[!benchmark]~[approvals] * +RNG seed: 1 Misc.tests.cpp:<line number>: passed: with 1 message: 'yay' Compilation.tests.cpp:<line number>: passed: y.v == 0 for: 0 == 0 Compilation.tests.cpp:<line number>: passed: 0 == y.v for: 0 == 0 diff --git a/tests/SelfTest/Baselines/compact.sw.multi.approved.txt b/tests/SelfTest/Baselines/compact.sw.multi.approved.txt index 105789c9..a94192eb 100644 --- a/tests/SelfTest/Baselines/compact.sw.multi.approved.txt +++ b/tests/SelfTest/Baselines/compact.sw.multi.approved.txt @@ -1,3 +1,5 @@ +Filters: ~[!nonportable]~[!benchmark]~[approvals] * +RNG seed: 1 Misc.tests.cpp:<line number>: passed: with 1 message: 'yay' Compilation.tests.cpp:<line number>: passed: y.v == 0 for: 0 == 0 Compilation.tests.cpp:<line number>: passed: 0 == y.v for: 0 == 0 diff --git a/tests/SelfTest/Baselines/console.std.approved.txt b/tests/SelfTest/Baselines/console.std.approved.txt index a6847cdf..c85a9203 100644 --- a/tests/SelfTest/Baselines/console.std.approved.txt +++ b/tests/SelfTest/Baselines/console.std.approved.txt @@ -1,11 +1,10 @@ Filters: ~[!nonportable]~[!benchmark]~[approvals] * +Randomness seeded to: 1 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ <exe-name> is a <version> host application. Run with -? for options -Randomness seeded to: 1 - ------------------------------------------------------------------------------- #1455 - INFO and WARN can start with a linebreak ------------------------------------------------------------------------------- diff --git a/tests/SelfTest/Baselines/console.sw.approved.txt b/tests/SelfTest/Baselines/console.sw.approved.txt index 66706e13..8bb1c3db 100644 --- a/tests/SelfTest/Baselines/console.sw.approved.txt +++ b/tests/SelfTest/Baselines/console.sw.approved.txt @@ -1,11 +1,10 @@ Filters: ~[!nonportable]~[!benchmark]~[approvals] * +Randomness seeded to: 1 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ <exe-name> is a <version> host application. Run with -? for options -Randomness seeded to: 1 - ------------------------------------------------------------------------------- # A test name that starts with a # ------------------------------------------------------------------------------- diff --git a/tests/SelfTest/Baselines/console.sw.multi.approved.txt b/tests/SelfTest/Baselines/console.sw.multi.approved.txt index 08b16228..a64c56a5 100644 --- a/tests/SelfTest/Baselines/console.sw.multi.approved.txt +++ b/tests/SelfTest/Baselines/console.sw.multi.approved.txt @@ -1,11 +1,10 @@ Filters: ~[!nonportable]~[!benchmark]~[approvals] * +Randomness seeded to: 1 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ <exe-name> is a <version> host application. Run with -? for options -Randomness seeded to: 1 - ------------------------------------------------------------------------------- # A test name that starts with a # ------------------------------------------------------------------------------- diff --git a/tests/SelfTest/Baselines/console.swa4.approved.txt b/tests/SelfTest/Baselines/console.swa4.approved.txt index 8b4b4c13..c25719d8 100644 --- a/tests/SelfTest/Baselines/console.swa4.approved.txt +++ b/tests/SelfTest/Baselines/console.swa4.approved.txt @@ -1,11 +1,10 @@ Filters: ~[!nonportable]~[!benchmark]~[approvals] * +Randomness seeded to: 1 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ <exe-name> is a <version> host application. Run with -? for options -Randomness seeded to: 1 - ------------------------------------------------------------------------------- # A test name that starts with a # ------------------------------------------------------------------------------- diff --git a/tests/SelfTest/Baselines/sonarqube.sw.approved.txt b/tests/SelfTest/Baselines/sonarqube.sw.approved.txt index 83b5d3cb..f2ec6f49 100644 --- a/tests/SelfTest/Baselines/sonarqube.sw.approved.txt +++ b/tests/SelfTest/Baselines/sonarqube.sw.approved.txt @@ -1,4 +1,5 @@ <?xml version="1.0" encoding="UTF-8"?> +<!-- rng-seed=1 --> <testExecutions version="1"loose text artifact > <file path="tests/<exe-name>/IntrospectiveTests/Clara.tests.cpp"> diff --git a/tests/SelfTest/Baselines/sonarqube.sw.multi.approved.txt b/tests/SelfTest/Baselines/sonarqube.sw.multi.approved.txt index 2723afe8..98cb8b7d 100644 --- a/tests/SelfTest/Baselines/sonarqube.sw.multi.approved.txt +++ b/tests/SelfTest/Baselines/sonarqube.sw.multi.approved.txt @@ -1,4 +1,5 @@ <?xml version="1.0" encoding="UTF-8"?> +<!-- rng-seed=1 --> <testExecutions version="1"> <file path="tests/<exe-name>/IntrospectiveTests/Clara.tests.cpp"> <testCase name="Clara::Arg supports single-arg parse the way Opt does" duration="{duration}"/> diff --git a/tests/SelfTest/Baselines/tap.sw.approved.txt b/tests/SelfTest/Baselines/tap.sw.approved.txt index 2f375905..a2e69782 100644 --- a/tests/SelfTest/Baselines/tap.sw.approved.txt +++ b/tests/SelfTest/Baselines/tap.sw.approved.txt @@ -1,3 +1,4 @@ +# rng-seed: 1 # # A test name that starts with a # ok {test-number} - with 1 message: 'yay' # #1027: Bitfields can be captured diff --git a/tests/SelfTest/Baselines/tap.sw.multi.approved.txt b/tests/SelfTest/Baselines/tap.sw.multi.approved.txt index 2c5790b4..69d85c7a 100644 --- a/tests/SelfTest/Baselines/tap.sw.multi.approved.txt +++ b/tests/SelfTest/Baselines/tap.sw.multi.approved.txt @@ -1,3 +1,4 @@ +# rng-seed: 1 # # A test name that starts with a # ok {test-number} - with 1 message: 'yay' # #1027: Bitfields can be captured |