Progmasoft Git

catch3

Progmasoft Catch3: an independently maintained C++17 test framework with a parallel runner, property checks, snapshots and structured results.

Clonegit clone https://git.progmasoft.com/catch3

Updated baselines to include NoAssertions warning

Commit
db48a6dfdafcc970eac39f085526a12c23a2fd9b
Author
Phil Nash ·
Parents
5497cd816f93

Files · Download .tar.gz

Changes

 projects/SelfTest/Baselines/results.txt | 141 ++++++++++++++++++++++++++++----
 1 file changed, 126 insertions(+), 15 deletions(-)

diff --git a/projects/SelfTest/Baselines/results.txt b/projects/SelfTest/Baselines/results.txt
index d95928bc..5a43a3c2 100644
--- a/projects/SelfTest/Baselines/results.txt
+++ b/projects/SelfTest/Baselines/results.txt
@@ -196,12 +196,12 @@
 [Running: ./succeeding/conditions/ptr]
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ConditionTests.cpp:285: p == __null succeeded for: __null == 0
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ConditionTests.cpp:286: p == pNULL succeeded for: __null == __null
-/Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ConditionTests.cpp:291: p != __null succeeded for: 0x7fff516500f8 != 0
-/Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ConditionTests.cpp:294: cp != __null succeeded for: 0x7fff516500f8 != 0
-/Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ConditionTests.cpp:297: cpc != __null succeeded for: 0x7fff516500f8 != 0
+/Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ConditionTests.cpp:291: p != __null succeeded for: 0x7fff54a840d8 != 0
+/Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ConditionTests.cpp:294: cp != __null succeeded for: 0x7fff54a840d8 != 0
+/Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ConditionTests.cpp:297: cpc != __null succeeded for: 0x7fff54a840d8 != 0
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ConditionTests.cpp:299: returnsNull() == __null succeeded for: {null string} == 0
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ConditionTests.cpp:300: returnsConstNull() == __null succeeded for: {null string} == 0
-/Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ConditionTests.cpp:302: __null != p succeeded for: 0 != 0x7fff516500f8
+/Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ConditionTests.cpp:302: __null != p succeeded for: 0 != 0x7fff54a840d8
 [Finished: './succeeding/conditions/ptr' All tests passed (8 assertions in 1 test case)]
 
 [Running: ./succeeding/conditions/not]
@@ -247,6 +247,12 @@
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ExceptionTests.cpp:60: {Unknown expression after this line} failed with unexpected exception with message: 'unexpected exception'
 [Finished: './failing/exceptions/implicit/2' 1 test case failed (1 of 2 assertions failed)]
 
+[Running: ./succeeding/exceptions/implicit]
+
+No assertions in test case, './succeeding/exceptions/implicit'
+
+[Finished: './succeeding/exceptions/implicit' 1 test case failed (1 assertion failed)]
+
 [Running: ./failing/exceptions/custom]
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ExceptionTests.cpp:102: Unexpected exception with message: 'custom exception'
 [Finished: './failing/exceptions/custom' 1 test case failed (1 assertion failed)]
@@ -264,11 +270,20 @@
 [Finished: './failing/exceptions/custom/double' 1 test case failed (1 assertion failed)]
 
 [Running: ./failing/exceptions/in-section]
+
+[Started section: 'the section']
+[Started section: 'the section2']
+
+No assertions in section, 'the section2'
+
+[End of section: 'the section2' 1 assertion failed]
+
+[End of section: 'the section' 1 assertion failed]
+
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ExceptionTests.cpp:132: Unexpected exception with message: 'Exception from section'
-[Finished: './failing/exceptions/in-section' 1 test case failed (1 assertion failed)]
+[Finished: './failing/exceptions/in-section' 1 test case failed (All 2 assertions failed)]
 
 [Running: ./succeeding/exceptions/error messages]
-
 [Started section: 'custom, unexpected']
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/ExceptionTests.cpp:152: runner.getLog() Contains( "custom exception" ) succeeded for: 
 "\[g] ./failing/exceptions/custom
@@ -460,7 +475,10 @@
 
 [Running: ./succeeding/message]
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/MessageTests.cpp:14: [warning: this is a warning]
-[Finished: './succeeding/message' No tests ran]
+
+No assertions in test case, './succeeding/message'
+
+[Finished: './succeeding/message' 1 test case failed (1 assertion failed)]
 
 [Running: ./failing/message/info/1]
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/MessageTests.cpp:19: [info: this message should be logged]
@@ -493,7 +511,22 @@
 
 [Finished: './failing/message/sections' 1 test case failed (All 2 assertions failed)]
 Message from section one
+
+[Running: ./succeeding/message/sections/stdout]
+[Started section: 'one']
+
+No assertions in section, 'one'
+
+[End of section: 'one' 1 assertion failed]
+
 Message from section two
+[Started section: 'two']
+
+No assertions in section, 'two'
+
+[End of section: 'two' 1 assertion failed]
+
+[Finished: './succeeding/message/sections/stdout' 1 test case failed (All 2 assertions failed)]
 
 [Running: ./mixed/message/scoped]
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/MessageTests.cpp:82: i < 10 succeeded for: 0 < 10
@@ -513,7 +546,10 @@ Message from section two
 
 [Running: ./succeeding/nofail]
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/MessageTests.cpp:88: 1 == 2 failed - but was ok
-[Finished: './succeeding/nofail' No tests ran]
+
+No assertions in test case, './succeeding/nofail'
+
+[Finished: './succeeding/nofail' 1 test case failed (1 assertion failed)]
 
 [Running: ./succeeding/Misc/Sections]
 [Started section: 's1']
@@ -563,6 +599,33 @@ Message from section two
 
 [Finished: './mixed/Misc/Sections/nested2' 1 test case failed (1 of 3 assertions failed)]
 
+[Running: ./Sections/nested/a/b]
+[Started section: 'c']
+[Started section: 'd (leaf)']
+
+No assertions in section, 'd (leaf)'
+
+[End of section: 'd (leaf)' 1 assertion failed]
+
+[End of section: 'c' 1 assertion failed]
+
+[Started section: 'c']
+[Started section: 'e (leaf)']
+
+No assertions in section, 'e (leaf)'
+
+[End of section: 'e (leaf)' 1 assertion failed]
+
+[End of section: 'c' 1 assertion failed]
+
+[Started section: 'f (leaf)']
+
+No assertions in section, 'f (leaf)'
+
+[End of section: 'f (leaf)' 1 assertion failed]
+
+[Finished: './Sections/nested/a/b' 1 test case failed (All 3 assertions failed)]
+
 [Running: Sections/nested3]
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/MiscTests.cpp:119: runner.getLog() == "\\[g] ./Sections/nested/a/b\n" " \\[tc] ./Sections/nested/a/b\n" "  \\ [s] c\n" "   \\ [s] d (leaf)\n" "   / [s] d (leaf)\n" "  / [s] c\n" "  \\ [s] c\n" "   \\ [s] e (leaf)\n" "   / [s] e (leaf)\n" "  / [s] c\n" "  \\ [s] c\n" "  / [s] c\n" "  \\ [s] f (leaf)\n" "  / [s] f (leaf)\n" " /[tc] ./Sections/nested/a/b\n" "/[g] ./Sections/nested/a/b\n" succeeded for: 
 
@@ -632,6 +695,12 @@ Message from section two
 [Finished: './mixed/Misc/loops' 1 test case failed (6 of 8 assertions failed)]
 Some information
 
+[Running: ./succeeding/Misc/stdout,stderr]
+
+No assertions in test case, './succeeding/Misc/stdout,stderr'
+
+[Finished: './succeeding/Misc/stdout,stderr' 1 test case failed (1 assertion failed)]
+
 [Running: ./succeeding/Misc/null strings]
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/MiscTests.cpp:163: makeString( false ) != static_cast<char*>(__null) succeeded for: "valid string" != {null string}
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/MiscTests.cpp:164: makeString( true ) == static_cast<char*>(__null) succeeded for: {null string} == {null string}
@@ -663,6 +732,21 @@ Some information
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/MiscTests.cpp:208: testCheckedElse( false ) failed for: false
 [Finished: './failing/checkedelse' 1 test case failed (All 2 assertions failed)]
 
+[Running: ./misc/xmlentitycheck]
+[Started section: 'embedded xml']
+
+No assertions in section, 'embedded xml'
+
+[End of section: 'embedded xml' 1 assertion failed]
+
+[Started section: 'encoded chars']
+
+No assertions in section, 'encoded chars'
+
+[End of section: 'encoded chars' 1 assertion failed]
+
+[Finished: './misc/xmlentitycheck' 1 test case failed (All 2 assertions failed)]
+
 [Running: ./manual/onechar]
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/MiscTests.cpp:225: [info: 3]
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/MiscTests.cpp:226: false failed
@@ -728,9 +812,30 @@ Some information
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/MiscTests.cpp:300: Factorial(10) == 3628800 succeeded for: 0x375f00 == 3628800
 [Finished: 'example/factorial' All tests passed (5 assertions in 1 test case)]
 
+[Running: empty]
+
+No assertions in test case, 'empty'
+
+[Finished: 'empty' 1 test case failed (1 assertion failed)]
+
 [Running: Nice descriptive name]
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/MiscTests.cpp:309: [warning: This one ran]
-[Finished: 'Nice descriptive name' No tests ran]
+
+No assertions in test case, 'Nice descriptive name'
+
+[Finished: 'Nice descriptive name' 1 test case failed (1 assertion failed)]
+
+[Running: first tag]
+
+No assertions in test case, 'first tag'
+
+[Finished: 'first tag' 1 test case failed (1 assertion failed)]
+
+[Running: second tag]
+
+No assertions in test case, 'second tag'
+
+[Finished: 'second tag' 1 test case failed (1 assertion failed)]
 
 [Running: selftest/main]
 [Started section: 'selftest/expected result']
@@ -1163,14 +1268,20 @@ Some information
 
 [Running: ./inprogress/failing/Tricky/trailing expression]
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/TrickyTests.cpp:55: [warning: Uncomment the code in this test to check that it gives a sensible compiler error]
-[Finished: './inprogress/failing/Tricky/trailing expression' No tests ran]
+
+No assertions in test case, './inprogress/failing/Tricky/trailing expression'
+
+[Finished: './inprogress/failing/Tricky/trailing expression' 1 test case failed (1 assertion failed)]
 
 [Running: ./inprogress/failing/Tricky/compound lhs]
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/TrickyTests.cpp:71: [warning: Uncomment the code in this test to check that it gives a sensible compiler error]
-[Finished: './inprogress/failing/Tricky/compound lhs' No tests ran]
+
+No assertions in test case, './inprogress/failing/Tricky/compound lhs'
+
+[Finished: './inprogress/failing/Tricky/compound lhs' 1 test case failed (1 assertion failed)]
 
 [Running: ./failing/Tricky/non streamable type]
-/Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/TrickyTests.cpp:95: &o1 == &o2 failed for: 0x7fff516508d8 == 0x7fff516508d0
+/Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/TrickyTests.cpp:95: &o1 == &o2 failed for: 0x7fff54a848b8 == 0x7fff54a848b0
 /Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/TrickyTests.cpp:96: o1 == o2 failed for: {?} == {?}
 [Finished: './failing/Tricky/non streamable type' 1 test case failed (All 2 assertions failed)]
 
@@ -1196,7 +1307,7 @@ Some information
 [Finished: './succeeding/enum/bits' All tests passed (1 assertion in 1 test case)]
 
 [Running: ./succeeding/boolean member]
-/Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/TrickyTests.cpp:239: obj.prop != __null succeeded for: 0x7fff516508d0 != 0
+/Users/Phil/Dev/OSS/Catch/projects/XCode4/CatchSelfTest/CatchSelfTest/../../../SelfTest/TrickyTests.cpp:239: obj.prop != __null succeeded for: 0x7fff54a848b0 != 0
 [Finished: './succeeding/boolean member' All tests passed (1 assertion in 1 test case)]
 
 [Running: ./succeeding/unimplemented static bool]
@@ -1243,8 +1354,8 @@ Some information
 [End of section: 'This stuff exists' 1 assertion passed]
 
 [Finished: 'scenario name' All tests passed (1 assertion in 1 test case)]
-[End of group: '~dummy'. 32 of 97 test cases failed (85 of 595 assertions failed)]
+[End of group: '~dummy'. 45 of 97 test cases failed (103 of 613 assertions failed)]
 
 
-[Testing completed. 32 of 97 test cases failed (85 of 595 assertions failed)]
+[Testing completed. 45 of 97 test cases failed (103 of 613 assertions failed)]