[FEA]: Add support for tests that compile, but fail at runtime

[ahendriksen]

Is this a duplicate?

• I confirmed there appear to be no duplicate issues for this request and that I agree to the Code of Conduct

Area

libcu++

Is your feature request related to a problem? Please describe.

In review, an additional test was requested that should compile successfully, but fails at runtime.

• fail tests checking that the APIs fail on non-supported state spaces

Originally posted by @gonzalobg in #358 (review)

Describe the solution you'd like

Add .runfail.cpp test type that is tested to compile correctly and to fail at runtime.

Describe alternatives you've considered

Naively, ff you want to test for success, you can also test for failure. There is one case where this is not true though and that is when we want the code to correctly assert when preconditions are not met.

Additional context

No response

[jrhemstad]

Could we use XFAIL: * in lit for this?

https://llvm.org/docs/TestingGuide.html#constraining-test-execution

[jrhemstad]

Ah, I suppose the difference is that you want to assert that it compiles successfully and fails during execution. @wmaxey or @miscco would need to confirm, but I think XFAIL will "succeed" even if it fails to compile.

[ahendriksen]

Exactly.

…

________________________________ From: Jake Hemstad ***@***.***> Sent: Thursday, September 7, 2023 10:51 PM To: NVIDIA/cccl ***@***.***> Cc: Allard Hendriksen ***@***.***>; Author ***@***.***> Subject: Re: [NVIDIA/cccl] [FEA]: Add support for tests that compile, but fail at runtime (Issue #417) Ah, I suppose the difference is that you want to assert that it compiles successfully and fails during execution. @wmaxey<https://github.com/wmaxey> or @miscco<https://github.com/miscco> would need to confirm, but I think XFAIL will "succeed" even if it fails to compile. — Reply to this email directly, view it on GitHub<#417 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AA72YFRRBTZH6DFAJG2D4FDXZIXWDANCNFSM6AAAAAA4POAK6A>. You are receiving this because you authored the thread.Message ID: ***@***.***>

----------------------------------------------------------------------------------- NVIDIA GmbH Wuerselen Amtsgericht Aachen HRB 8361 Managing Directors: Michael Ching, Donald Robertson, Rebecca Peters and Ludwig von Reiche

----------------------------------------------------------------------------------- This email message is for the sole use of the intended recipient(s) and may contain confidential information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. -----------------------------------------------------------------------------------