Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[REVIEW] Use device_buffer in tSNE, fix limitation on number of rows #2548

Merged
merged 6 commits into from
Jul 22, 2020

Conversation

zbjornson
Copy link
Contributor

@zbjornson zbjornson commented Jul 11, 2020

It's tempting to add operator value_type*() { return _data; } to buffer_base so that they can implicitly convert to T* and not have to use .data() everywhere. Not sure if that would reduce type safety too much?

Commits separated into logical units for easier review.

Fixes #2402 (i.e. #1101)
Includes a big chunk of #1356
Fixes #1753

@zbjornson zbjornson requested a review from a team as a code owner July 11, 2020 23:15
@GPUtester
Copy link
Contributor

Can one of the admins verify this patch?

@zbjornson zbjornson force-pushed the bug-tsne-cleanup branch 2 times, most recently from 3d87fdd to 82b3847 Compare July 11, 2020 23:18
@zbjornson zbjornson changed the title Use device_buffer in tSNE [REVIEW] Use device_buffer in tSNE Jul 11, 2020
Copy link
Member

@cjnolet cjnolet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for implementing this cleanup. Overall it looks great. I found a few only a couple very minor things.

cpp/src/tsne/barnes_hut.cuh Outdated Show resolved Hide resolved
cpp/src/tsne/barnes_hut.cuh Show resolved Hide resolved
cpp/src/tsne/barnes_hut.cuh Outdated Show resolved Hide resolved
cpp/src/tsne/barnes_hut.cuh Outdated Show resolved Hide resolved
@JohnZed
Copy link
Contributor

JohnZed commented Jul 13, 2020

ok to test

@dantegd dantegd added 4 - Waiting on Author Waiting for author to respond to review CUDA / C++ CUDA issue Tech Debt Issues related to debt labels Jul 14, 2020
@zbjornson zbjornson force-pushed the bug-tsne-cleanup branch 2 times, most recently from 639eaf9 to f018549 Compare July 16, 2020 00:11
@zbjornson
Copy link
Contributor Author

zbjornson commented Jul 16, 2020

@cjnolet thank you for the review. Sorry for the back and forth on buffer/pointer style. Hope I got what you mean.


The CI failure looks unrelated to this PR. The same failures are happening in other PRs (e.g. #2560).

@dantegd
Copy link
Member

dantegd commented Jul 16, 2020

rerun tests

@dantegd
Copy link
Member

dantegd commented Jul 16, 2020

@zbjornson the unrelated CI issue has been fixed now, so things should be fine now for running tests for the PR

@zbjornson zbjornson changed the title [REVIEW] Use device_buffer in tSNE [REVIEW] Use device_buffer in tSNE, fix limitation on number of rows Jul 17, 2020
Copy link
Member

@cjnolet cjnolet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great. Just two minor things and it'll be ready to go, pending CI.

CHANGELOG.md Outdated Show resolved Hide resolved
cpp/src_prims/sparse/coo.cuh Show resolved Hide resolved
@zbjornson zbjornson requested a review from a team as a code owner July 21, 2020 22:36
@cjnolet cjnolet added 4 - Waiting on Reviewer Waiting for reviewer to review or respond and removed 4 - Waiting on Author Waiting for author to respond to review labels Jul 22, 2020
Copy link
Member

@cjnolet cjnolet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks again for these contributions!

@cjnolet cjnolet merged commit 5d4ea79 into rapidsai:branch-0.15 Jul 22, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
4 - Waiting on Reviewer Waiting for reviewer to review or respond CUDA / C++ CUDA issue Tech Debt Issues related to debt
Projects
None yet
5 participants