catch3/tests/TestScripts, branch v3.0.0-preview3 Progmasoft Catch3: an independently maintained C++17 test framework with a parallel runner, property checks, snapshots and structured results. Fix how testRandomOrder.py builds tag arguments 2020-07-26T08:51:55+00:00 Martin Hořeňovský 2020-07-11T19:31:08+00:00 250d9b9c72219cc196e971356705af6fd24b6ed2 






Refactor tests for duration reporting threshold
2020-07-26T08:47:58+00:00

Martin Hořeňovský

2020-07-06T18:02:20+00:00

e6d947f6d4f84713637da5e5b37cd1f84b925403












Add --min-duration option
2020-07-26T08:47:53+00:00

John Bytheway

2020-04-13T12:34:27+00:00

80b0d6975c1582d03436ba82146983d557b0a1a6

A test runner already has a --durations option to print durations.
However, this isn't entirely satisfactory.

When there are many tests, this produces output spam which makes it hard
to find the test failure output.  Nevertheless, it is helpful to be
informed of tests which are unusually slow.

Therefore, introduce a new option --min-duration that causes all
durations above a certain threshold to be printed.  This allows slow
tests to be visible without mentioning every test.





A test runner already has a --durations option to print durations.
However, this isn't entirely satisfactory.

When there are many tests, this produces output spam which makes it hard
to find the test failure output.  Nevertheless, it is helpful to be
informed of tests which are unusually slow.

Therefore, introduce a new option --min-duration that causes all
durations above a certain threshold to be printed.  This allows slow
tests to be visible without mentioning every test.







Randomize test for subset invariant random ordering of tests
2020-05-01T12:45:36+00:00

Martin Hořeňovský

2020-04-14T14:38:07+00:00

9b5fc9eaeacbe0bac5575824368c4a693a9a58a1

Also removed the iterative checking that seeds 1-100 do not create
the same output, because it used too much runtime.





Also removed the iterative checking that seeds 1-100 do not create
the same output, because it used too much runtime.







Add test for consistent random ordering
2020-05-01T12:30:01+00:00

John Bytheway

2020-04-10T21:25:13+00:00

630ba2627802f2832929dc52d3a69ddc83546959

-- Fixed up during cherrypicking





-- Fixed up during cherrypicking