Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HDDS-5418. Let Recon send reregisterCommand to Datanodes if DatanodeDetails changed #2392

Merged
merged 8 commits into from
Jul 23, 2021

Conversation

symious
Copy link
Contributor

@symious symious commented Jul 7, 2021

What changes were proposed in this pull request?

Currently the "DatanodeDetails" are stored in Recon's local DB. Once a datanode has registered the content of DatanodeDetails won't be changed.

We met a scenario that datanodes' hostname is changed after running a while in Ozone cluster, the hostname in Recon's UI will still show the old hostnames.

This ticket proposes to send "reregisterCommand" to datanodes if the information of the datanode is changed.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-5418

How was this patch tested?

Unit test

@symious
Copy link
Contributor Author

symious commented Jul 8, 2021

@avijayanhwx Could you help to check this PR?

@symious symious changed the title HDDS-5418. Let Recon send reregisterCommand to Datanodes if DatanodeDetails changed WIP: HDDS-5418. Let Recon send reregisterCommand to Datanodes if DatanodeDetails changed Jul 14, 2021
@avijayanhwx
Copy link
Contributor

@symious Are you still working on more changes in this PR? I see the title as 'WIP'.

@symious
Copy link
Contributor Author

symious commented Jul 15, 2021

@avijayanhwx I did some changes on the commit to show more information like version, setup, etc.
Since the information is stored in NodeStateMap and doesn't support updates on this information, I think it's better to maintain an in-memory collection to store the updated datanodeDetails, besides I used the information from the in-memory collection to display on the Recon UI.

@symious symious changed the title WIP: HDDS-5418. Let Recon send reregisterCommand to Datanodes if DatanodeDetails changed HDDS-5418. Let Recon send reregisterCommand to Datanodes if DatanodeDetails changed Jul 15, 2021
Copy link
Contributor

@avijayanhwx avijayanhwx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the explanations @symious. We can revisit the columns in UI if necessary.

@avijayanhwx avijayanhwx merged commit 2759a9f into apache:master Jul 23, 2021
errose28 added a commit to errose28/ozone that referenced this pull request Jul 30, 2021
* master: (48 commits)
  HDDS-5514. Skip check for UNHEALTHY containers for datanode finalize. (apache#2469)
  HDDS-5279. OFS mkdir -p does not work when Volume is not pre-created (apache#2412)
  HDDS-5328. Remove delete container command from admin CLI (apache#2456)
  HDDS-5382. Increase default container report interval to 60 mins (apache#2363)
  HDDS-5378 Add APIs to retrieve Namespace Summary from Recon (apache#2417)
  HDDS-5466. Refactor BlockOutputStream. (apache#2442)
  HDDS-5465. Delete redundant code when set、add and remove bucket acl (apache#2439)
  HDDS-5184. Use separate DB profile for Datanodes. (apache#2214)
  HDDS-5494. Reduce retry in Kubernetes test (apache#2461)
  HDDS-5414. Data buffers incorrectly filtered for Ozone Insight (apache#2387)
  HDDS-5450. Avoid refresh pipeline for S3 headObject (apache#2431)
  HDDS-5500. New k3s version breaks kubernetes test (apache#2464)
  HDDS-5489. Install OS-specific flekszible (apache#2462)
  Multi-raft style placement with permutations for offline data generator (apache#2434)
  HDDS-5484. Intermittent failure in TestReplicationManager#testMovePrerequisites (apache#2454)
  HDDS-5443 Create and then recreate a bucket with a randomized name (apache#2436)
  HDDS-5492. Disable failing kubernetes test (apache#2459)
  HDDS-4330. Bootstrap new OM node (apache#1494)
  HDDS-5418. Let Recon send reregisterCommand to Datanodes if DatanodeDetails changed (apache#2392)
  HDDS-5479. s3g bucket list failed when there is non-english key name. (apache#2450)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants