Skip to content

[REVIEW] HDBSCAN - #3821

Merged
rapids-bot[bot] merged 209 commits into
NVIDIA:branch-21.06from
cjnolet:fea-020-hdbscan_py
Jun 3, 2021
Merged

[REVIEW] HDBSCAN#3821
rapids-bot[bot] merged 209 commits into
NVIDIA:branch-21.06from
cjnolet:fea-020-hdbscan_py

Conversation

@cjnolet

@cjnolet cjnolet commented May 3, 2021

Copy link
Copy Markdown
Collaborator

We had originally tried to ease the review process by separating the Python and CUDA/C++ layer code for HDBSCAN (see #3773), and for the most part we have been separating the commits, however this made it very cumbersome to keep cherry-picking commits backwards so we abandoned #3773 and continued working on this PR.

@tfeher tfeher left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @cjnolet and @divyegala for the updates!

Please add a link to the API documentation. Apart from that I have only a few minor comments left, after that we shall be good to go.

Comment thread cpp/cmake/thirdparty/get_raft.cmake Outdated
Comment thread cpp/include/cuml/cluster/hdbscan.hpp Outdated
Comment thread cpp/src/hdbscan/detail/reachability.cuh Outdated
Comment thread cpp/src/hdbscan/detail/reachability.cuh Outdated
Comment thread cpp/src/hdbscan/detail/reachability_faiss.cuh Outdated
Comment thread cpp/src/hdbscan/detail/kernels/condense.cuh Outdated
Comment thread cpp/include/cuml/cluster/hdbscan.hpp

@tfeher tfeher left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the updates, the PR looks good to me!

@cjnolet
cjnolet requested a review from a team as a code owner May 29, 2021 00:14
@github-actions github-actions Bot added the conda conda issue label May 29, 2021

@dantegd dantegd left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Everything looks good from me too, just requested adding an item to the follow ups issue (if it’s not already there). Once hdbscan python package is in integration we should be good to merge.

dtype=dtype,
memptr=mem_ptr)).to_output('numpy')

def _construct_condensed_tree_attribute(self, ptr, dtype="int32"):

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add the item of trying this as a property, I think it can be a follow up nice to have but not indispensable (and need to think about the getattr…)

@dantegd dantegd left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Totally missed the conda change, which goes hand in hand with adding hdbscan to the rapids-build meta package

Comment thread conda/recipes/cuml/meta.yaml Outdated
@cjnolet

cjnolet commented May 29, 2021

Copy link
Copy Markdown
Collaborator Author

Can you add the item of trying this as a property, I think it can be a follow up nice to have but not indispensable (and need to think about the getattr…)

@dantegd, absolutely I'd like to use a lazy-loaded property here. I initially tried this as a lazy-populated property (using @property) but I kept getting an error in __hasattr__ of the base class and I couldn't figure out a good way to make it work. It is very possible that I was doing something wrong, though, and I would prefer to use that pattern if we can get it to work.

@cjnolet

cjnolet commented Jun 1, 2021

Copy link
Copy Markdown
Collaborator Author

Added item to our follow-on task to revisit the property / lazy-loaded members for plotting objects: #3879 (comment)

@github-actions github-actions Bot removed the conda conda issue label Jun 1, 2021
@cjnolet

cjnolet commented Jun 1, 2021

Copy link
Copy Markdown
Collaborator Author

PR to add hdbscan package to rapids-build-env for tests: rapidsai/integration#288

@cjnolet cjnolet added 5 - Ready to Merge Testing and reviews complete, ready to merge and removed 3 - Ready for Review Ready for review by team labels Jun 1, 2021
@ajschmidt8

Copy link
Copy Markdown
Member

Removing ops-codeowners from the required reviews since it doesn't seem there are any file changes that we're responsible for. Feel free to add us back if necessary.

@ajschmidt8
ajschmidt8 removed the request for review from a team June 1, 2021 20:00
@dantegd

dantegd commented Jun 2, 2021

Copy link
Copy Markdown
Contributor

rerun tests

1 similar comment
@dantegd

dantegd commented Jun 2, 2021

Copy link
Copy Markdown
Contributor

rerun tests

@dantegd

dantegd commented Jun 2, 2021

Copy link
Copy Markdown
Contributor

@gpucibot merge

@cjnolet

cjnolet commented Jun 2, 2021

Copy link
Copy Markdown
Collaborator Author

Going to try again in hopes the changes to the integration repo just weren't picked up in time.

@cjnolet

cjnolet commented Jun 2, 2021

Copy link
Copy Markdown
Collaborator Author

rerun tests

1 similar comment
@cjnolet

cjnolet commented Jun 2, 2021

Copy link
Copy Markdown
Collaborator Author

rerun tests

@codecov-commenter

Copy link
Copy Markdown

Codecov Report

❗ No coverage uploaded for pull request base (branch-21.06@92484fb). Click here to learn what that means.
The diff coverage is n/a.

Impacted file tree graph

@@               Coverage Diff               @@
##             branch-21.06    #3821   +/-   ##
===============================================
  Coverage                ?   85.13%           
===============================================
  Files                   ?      230           
  Lines                   ?    18138           
  Branches                ?        0           
===============================================
  Hits                    ?    15441           
  Misses                  ?     2697           
  Partials                ?        0           
Flag Coverage Δ
dask 47.80% <0.00%> (?)
non-dask 77.49% <0.00%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.


Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 92484fb...1519478. Read the comment docs.

@rapids-bot
rapids-bot Bot merged commit 870c7ee into NVIDIA:branch-21.06 Jun 3, 2021
vimarsh6739 pushed a commit to vimarsh6739/cuml that referenced this pull request Oct 9, 2023
We had originally tried to ease the review process by separating the Python and CUDA/C++ layer code for HDBSCAN (see NVIDIA#3773), and for the most part we have been separating the commits, however this made it very cumbersome to keep cherry-picking commits backwards so we abandoned NVIDIA#3773 and continued working on this PR.

Authors:
  - Corey J. Nolet (https://github.com/cjnolet)
  - Divye Gala (https://github.com/divyegala)

Approvers:
  - Tamas Bela Feher (https://github.com/tfeher)
  - Dante Gama Dessavre (https://github.com/dantegd)

URL: NVIDIA#3821
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

5 - Ready to Merge Testing and reviews complete, ready to merge CMake CUDA/C++ Cython / Python Cython or Python issue feature request New feature or request New Algorithm For tracking new algorithms that will be added to our existing collection non-breaking Non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants