Using filter -sc does not work properly?

[yudi-azvd]

Description

As described in the docs it should be possible to run only specified subcases using the flag -sc. But when I use it, all tests are executed. I know the subcases were registered/compiled because they are the only ones printing something on the screen and If I list tests cases or subscases everything is listed fine. I also tried --subcase.

Steps to reproduce

-sc="*the*" (the is present in both subcases ) and --subcase="*vectors*" did not work for me. I used the following examples from the docs.

TEST_CASE("vectors can be sized and resized") {
    std::vector<int> v(5);

    REQUIRE(v.size() == 5);
    REQUIRE(v.capacity() >= 5);

    SUBCASE("adding to the vector increases it's size") {
        v.push_back(1);

        CHECK(v.size() == 6);
        CHECK(v.capacity() >= 6);
    }
    SUBCASE("reserving increases just the capacity") {
        v.reserve(6);

        CHECK(v.size() == 5);
        CHECK(v.capacity() >= 6);
    }
}

Extra information

• doctest version: v2.4.5
• Operating System: Ubuntu 18.04
• Compiler+version: gcc 7.5

2nd extra

doctest is an awesome framework! thank you for your effort :)

[yudi-azvd]

Ok... after some experimentation I realized that -sc only filters subcases. Test cases which do not include the filtered subcase will still be executed. Is that correct? Is that the intended behavior?

I thought -sc would only run subcases filtered by it. Reading the docs on -tc and -sc made me think this way.

[onqtam]

Ok... after some experimentation I realized that -sc only filters subcases. Test cases which do not include the filtered subcase will still be executed. Is that correct? Is that the intended behavior?

I thought -sc would only run subcases filtered by it. Reading the docs on -tc and -sc made me think this way.

yes, -sc filters only subcases - -tc should be used alongside it if you want to filter test cases too. There's no way to know what subcases exist without actually executing all test cases.

I will add a note in the docs that subcase filtering does not affect test case filtering.

And glad you like the framework! :)

[yudi-azvd]

Thanks xD