Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ISSUE #570] ASoC connect runtime optimization: CLI #622

Merged
merged 8 commits into from
Sep 20, 2020

Conversation

Dreaouth
Copy link
Contributor

What is the purpose of the change

XXXXX

Brief changelog

XX

Verifying this change

XXXX

Follow this checklist to help us incorporate your contribution quickly and easily. Notice, it would be helpful if you could finish the following 5 checklist(the last one is not necessary)before request the community to review your PR.

  • Make sure there is a Github issue filed for the change (usually before you start working on it). Trivial changes like typos do not require a Github issue. Your pull request should address just this issue, without pulling in other changes - one PR resolves one issue.
  • Format the pull request title like [ISSUE #123] Fix UnknownException when host config not exist. Each commit in the pull request should have a meaningful subject line and body.
  • Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
  • Write necessary unit-test(over 80% coverage) to verify your logic correction, more mock a little better when cross module dependency exist. If the new feature or significant change is committed, please remember to add integration-test in test module.
  • Run mvn -B clean apache-rat:check findbugs:findbugs checkstyle:checkstyle to make sure basic checks pass. Run mvn clean install -DskipITs to make sure unit-test pass. Run mvn clean test-compile failsafe:integration-test to make sure integration-test pass.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

}
return "";
}
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(Optional) newline here

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated all


与RocketMQ中的mqadmin类似,使用简洁的CLI命令实现增加,删除,查看connector等功能

在rocketmq-connect\tools目录下,运行`sh connectAdmin`
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AFAIK this might not be the newest directory

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated cli

</dependencies>


</project>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same here, optional

throw new SubCommandException(this.getClass().getSimpleName() + " command failed", e);
}
}
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

op

throw new SubCommandException(this.getClass().getSimpleName() + " command failed", e);
}
}
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

op

}
return "";
}
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

op

httpPort=8081

# RocketMQ Connect Runtime Addr
httpAddr=localhost
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

op

<scope>runtime</scope>
</dependencySet>
</dependencySets>
</assembly>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

op

@@ -136,6 +136,7 @@ public KeyValue configs() {
try {
Collection<SourceDataEntry> toSendEntries = sourceTask.poll();
if (null != toSendEntries && toSendEntries.size() > 0) {
log.info("send records");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I left some very bad log conventions in the runtime and I apologize for that, but we need to try to make log messages clear ~ This might be a log added during debug process so we might not need it ~ I'll probably refactor the logs in externals (as some of them looks messy, with some needed logs missing) it would be great if you're willing to help :)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated

@@ -80,7 +80,6 @@ public void doRebalance() {
List<String> curAliveWorkers = clusterManagementService.getAllAliveWorkers();
Map<String, ConnectKeyValue> curConnectorConfigs = configManagementService.getConnectorConfigs();
Map<String, List<ConnectKeyValue>> curTaskConfigs = configManagementService.getTaskConfigs();
log.info("[ISSUE #2027] The connectorConfigs are:" + curConnectorConfigs.toString() + " with timestamp :" + System.currentTimeMillis());
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice job here~

@imaffe imaffe changed the base branch from master to develop September 14, 2020 09:16
@imaffe imaffe changed the base branch from develop to master September 14, 2020 09:19
@imaffe imaffe merged commit 5c48ed1 into apache:master Sep 20, 2020
odbozhou pushed a commit that referenced this pull request Mar 1, 2022
feature(rocketmq-runtime) add CLI support for rocketmq-connect-runtime

* Add CLI

* Fix checkstyle

* Optimize CLI structure

* Add README.md

* Rename CLI

* Update pom.xml

* Optimize the connectors and tasks format

* Fix newline format
odbozhou pushed a commit that referenced this pull request Mar 1, 2022
feature(rocketmq-runtime) add CLI support for rocketmq-connect-runtime

* Add CLI

* Fix checkstyle

* Optimize CLI structure

* Add README.md

* Rename CLI

* Update pom.xml

* Optimize the connectors and tasks format

* Fix newline format
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants