Skip to content

Conversation

@ayushtkn
Copy link
Member

What changes were proposed in this pull request?

Add acl related metrics in OM

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-4441

How was this patch tested?

Added UT

@ayushtkn ayushtkn merged commit f3c8900 into apache:master Nov 12, 2020
@ayushtkn
Copy link
Member Author

Thanx @jojochuang for the review!!!

@cxorm
Copy link
Member

cxorm commented Nov 12, 2020

Thanks @ayushtkn for the contribution.

IMHO the setAcl, removeAcl and addAcl are write-operation, the metrics should be updated in OMRequest instead of OzoneManager.
(For example, when we set acl of some volume, we should update the metric in OMVolumeSetAclRequest)

I think we could do it in a new jira.
Could you be so kind as to file a jira to update it ? (Feel free to correct me if I miss something, thanks)

@ayushtkn
Copy link
Member Author

ayushtkn commented Nov 12, 2020

Thanx @cxorm I will raise one jira for that. But I didn't actually catch what to do.
createDirectory, createFile are also write calls, for them the metrics are also updated in OM.
I couldn't find any metrics instance itself in OMVolumeSetAclRequest and why we can't update the metrics in OM?
And the metrics being updated is OMMetrics, So, that should track statistics of OM only?

@cxorm
Copy link
Member

cxorm commented Nov 12, 2020

createDirectory, createFile are also write calls, for them the metrics are also updated in OM.
I couldn't find any metrics instance itself in OMVolumeSetAclRequest and why we can't update the metrics in OM?

Yeah it's a good question,
for OMHA, actually the write-operation of OzoneManager is processed by OMRequest instead of OzoneManager.
(The write calls in OzoneManager is deprecated, but the code is not removed.)

And the metrics being updated is OMMetrics, So, that should track statistics of OM only?

Right, it is used to track statistics of OM (But the write calls of OM is processed by OMRequest.)

@ayushtkn
Copy link
Member Author

Ohh, Means for HA, the code flow is separate. I thought OzoneManager like the NamenodeRpcServer. It should be mentioned somewhere it is only for Non-HA :-(
Well, Thanx @cxorm for the explanation. I have tried to handle this for HA, in an Addendum PR - #1584

Please have a look

@bharatviswa504
Copy link
Contributor

bharatviswa504 commented Nov 12, 2020

For HA/non-HA new code is being used for write requests.

I belive there is a cleanup jira to remove the older methods.

@cxorm
Copy link
Member

cxorm commented Nov 13, 2020

Thanks @bharatviswa504 , and yes I mean non-HA/ HA is using new code.
(Sorry for misleading it)

errose28 added a commit to errose28/ozone that referenced this pull request Nov 18, 2020
* master: (53 commits)
  HDDS-4458. Fix Max Transaction ID value in OM. (apache#1585)
  HDDS-4442. Disable the location information of audit logger to reduce overhead (apache#1567)
  HDDS-4441. Add metrics for ACL related operations.(Addendum for HA). (apache#1584)
  HDDS-4081. Create ZH translation of StorageContainerManager.md in doc. (apache#1558)
  HDDS-4080. Create ZH translation of OzoneManager.md in doc. (apache#1541)
  HDDS-4079. Create ZH translation of Containers.md in doc. (apache#1539)
  HDDS-4184. Add Features menu for Chinese document. (apache#1547)
  HDDS-4235. Ozone client FS path validation is not present in OFS. (apache#1582)
  HDDS-4338. Fix the issue that SCM web UI banner shows "HDFS SCM". (apache#1583)
  HDDS-4337. Implement RocksDB options cache for new datanode DB utilities. (apache#1544)
  HDDS-4083. Create ZH translation of Recon.md in doc (apache#1575)
  HDDS-4453. Replicate closed container for random selected datanodes. (apache#1574)
  HDDS-4408: terminate Datanode when Datanode State Machine Thread got uncaught exception. (apache#1533)
  HDDS-4443. Recon: Using Mysql database throws exception and fails startup (apache#1570)
  HDDS-4315. Use Epoch to generate unique ObjectIDs (apache#1480)
  HDDS-4455. Fix typo in README.md doc (apache#1578)
  HDDS-4441. Add metrics for ACL related operations. (apache#1571)
  HDDS-4437. Avoid unnecessary builder conversion in setting volume Quota/Owner request (apache#1564)
  HDDS-4417. Simplify Ozone client code with configuration object (apache#1542)
  HDDS-4363. Add metric to track the number of RocksDB open/close operations. (apache#1530)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants