Skip to content

Conversation

@jojochuang
Copy link
Contributor

@jojochuang jojochuang commented Feb 23, 2024

What changes were proposed in this pull request?

Add client side trace spans to ofs file system APIs and input/output stream APIs.

Select screenshots:

input stream read()
Screenshot 2024-02-23 at 10 31 43 AM

outputstream hsyc
Screenshot 2024-02-23 at 5 03 42 PM

file system contentSummary API
Screenshot 2024-02-23 at 10 43 46 AM

file system create file API
Screenshot 2024-02-23 at 5 06 45 PM

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-10268

How was this patch tested?

Tested in a dev cluster.

@jojochuang jojochuang changed the title Hdds 10268 HDDS-10268. [hsync] Add OpenTracing traces to client side read path Feb 23, 2024
@kerneltime
Copy link
Contributor

Thanks for this change! Looking at the read chart, 50% of the latency is from getting block information which is redundant as DN can calculate the chunk and offset to read. Hope this one gets picked up soon https://issues.apache.org/jira/browse/HDDS-10338

@kerneltime kerneltime requested a review from duongkame February 24, 2024 00:04
@kerneltime
Copy link
Contributor

cc @tanvipenumudy

@jojochuang jojochuang added the hbase HBase on Ozone support label Feb 26, 2024
Change-Id: I9c23acda58dfdd07508e1f7742865dc8679156e4
Change-Id: I06a8f5a0342ed53e08174090a4922f8785e06a0d
@jojochuang jojochuang marked this pull request as ready for review March 21, 2024 05:42
@jojochuang jojochuang requested review from ChenSammi and smengcl April 4, 2024 03:43
Copy link
Contributor

@smengcl smengcl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @jojochuang for adding the new spans and tags. lgtm

jojochuang and others added 2 commits April 9, 2024 14:54
Change-Id: I6888d0ba3fa8366f04e1d065a83b8f7af5c134ff
@smengcl
Copy link
Contributor

smengcl commented Apr 9, 2024

Retriggered CI

@adoroszlai
Copy link
Contributor

@duongkame @kerneltime @tanvipenumudy please review

@smengcl smengcl merged commit cedb459 into apache:master Apr 10, 2024
@smengcl
Copy link
Contributor

smengcl commented Apr 10, 2024

Thanks @jojochuang for the patch.

jojochuang added a commit to jojochuang/ozone that referenced this pull request May 29, 2024
…pache#6262)

(cherry picked from commit cedb459)

 Conflicts:
	hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/RootedOzoneFileSystem.java

Change-Id: Icc8735a213cbd95b0ae65b50f506ad4ac2caa5ad
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

hbase HBase on Ozone support

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants