NVTX range helpers

[achirkin]

Moves the helpers for NVTX ranges from cuml with minor additions.

Also adds the helpers to couple places in the codebase - as a way of testing the new feature.

[cjnolet]

I'm really happy to host this in RAFT and hopeful other consumers might also be able to make use of it. Mostly minor things and my thoughts on the macro usage.

[cjnolet]

Also tagging some folks from cugraph for their thoughts about the macro

Cc @seunghwak @ChuckHastings @BradReesWork @afender

[cjnolet]

Changes look great, I just found one more very small thing as I was doing my final review.

[achirkin]

As @teju85 suggested, I probably should also remove the versions of the helpers that synchronize cuda streams. The reason is that modern nsys profiler can map the ranges on gpu streams well, but addition of the lots of synchronize calls may bias the profiler/performance overview. @cjnolet, @wphicks do you have any objections to that?

[cjnolet]

If this is the case with all the ctk versions supported by rapids (Eg ctk 11+) then it's fine with me. Probably better not to modify the performance while we are trying to measure the performance.

[wphicks]

No objections here. Makes sense!

[wphicks]

Since no one else has a strong opinion on the macro issue, I say it's better to be biased toward approving and we should move ahead. Let's take care of the stream synchronization issue and @cjnolet's last note on namespacing, then this looks good as far as I'm concerned.

[achirkin]

All done, thanks for the input!

Note, I also added a template parameter Domain, which should allow an easy way to customize the NVTX domain message in downstream projects/applications.

One creates a domain by declaring a struct (anywhere):

raft/cpp/include/raft/common/nvtx.hpp

Lines 32 to 34 in d8357b2

	struct raft {
	static constexpr char const* name{"raft"};
	};

And this is how to use it:

raft/cpp/include/raft/linalg/svd.cuh

Lines 67 to 68 in d8357b2

	common::nvtx::range<common::nvtx::domain::raft> fun_scope(
	"raft::linalg::svdQR(%d, %d)", n_rows, n_cols);

[cjnolet]

The changes look great, Artem. Thanks for moving this to raft and improving it!

[cjnolet]

Just a little side note: the usage links are great but it would also be nice to have usage examples right in the doxygen.

[achirkin]

rerun tests

[cjnolet]

@gpucibot merge