Skip to content

Conversation

@jojochuang
Copy link
Contributor

@jojochuang jojochuang commented Apr 20, 2024

(cherry picked from commit 509c970)

What changes were proposed in this pull request?

HDDS-10442. [hsync] Add a Freon tool to measure client to DataNode round-trip latency (#6297)

Please describe your PR in detail:

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-10442

How was this patch tested?

Unit tests, Freon integration tests.

…und-trip latency (apache#6297)

(cherry picked from commit 509c970)

 Conflicts:
	hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/protocolPB/ContainerCommandResponseBuilders.java
	hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/storage/ContainerProtocolCalls.java
	hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/audit/DNAction.java
	hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/impl/HddsDispatcher.java
	hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/KeyValueHandler.java
	hadoop-hdds/interface-client/src/main/proto/DatanodeClientProtocol.proto
	hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/OmRPCLoadGenerator.java

Change-Id: Icbd75e38f6ea39604390627398750a3218e51937
@jojochuang jojochuang requested a review from kerneltime April 20, 2024 00:52
@jojochuang
Copy link
Contributor Author

cc: @kerneltime @duongkame

Kind of surprised by the amount of conflicts.


StreamInit = 19;
StreamWrite = 20;
FinalizeBlock = 21;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the master is not ready for this field.

Change-Id: Id69212bdb46bab81805c301fc711ed496e249c42
@jojochuang
Copy link
Contributor Author

I'm not sure what's going on with the latest one. The logs are corrupt, can't see what went wrong.
Maybe it's the gaps in the protobuf ids. Let me give it a try.

Change-Id: Iebeeaf18fc1df11671bf8530e7855c69604407ed
@jojochuang jojochuang requested a review from kerneltime April 23, 2024 19:54
@jojochuang
Copy link
Contributor Author

test is green.

@kerneltime kerneltime merged commit dec977b into apache:master Apr 23, 2024
@kerneltime
Copy link
Contributor

kerneltime commented Apr 23, 2024

Thanks @jojochuang for this cool extension.

jojochuang added a commit to jojochuang/ozone that referenced this pull request May 29, 2024
…und-trip latency (apache#6297) (apache#6562)

* HDDS-10442. [hsync] Add a Freon tool to measure client to DataNode round-trip latency (apache#6297)

(cherry picked from commit 509c970)
(cherry picked from commit dec977b)

 Conflicts:
	hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/protocolPB/ContainerCommandResponseBuilders.java
	hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/storage/ContainerProtocolCalls.java
	hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/audit/DNAction.java
	hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/impl/HddsDispatcher.java
	hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/KeyValueHandler.java
	hadoop-hdds/interface-client/src/main/proto/DatanodeClientProtocol.proto
	hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/DNRPCLoadGenerator.java

Change-Id: I07755d356dc5ce8f87c62476f49e7c91549bd93b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants