Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CONNECTOR] Add script to start hadoop #1438

Merged

Conversation

chaohengstudent
Copy link
Collaborator

related #1391

這是目前啟動腳本的方法

Namenode

./docker/start_namenode.sh [OPTIONS]

options 為 hdfs-site.xml參數

輸出

efe7d7da5fc3bb26f5efaf4314804bbb6d6b4350226603b92826b733ae1426bb
=================================================
jmx address: 192.168.103.44:12937/jmx
run /home/username/IdeaProjects/astraea/docker/start_datanode.sh fs.defaultFS=hdfs://namenode-12991:8020 to join datanode
=================================================

Datanode

./docker/start_datanode.sh fs.defaultFS=hdfs://namenode-12991:8020 [OPTIONS]

options 為 hdfs-site.xml參數

輸出

496ff7a8d17b6002310bbfd6d730fa8817fc58d022d1bb37c7f2725126a53857
=================================================
jmx address: 192.168.103.44:11641/jmx
=================================================

@chia7712
Copy link
Contributor

@chaohengstudent 請問可否一並提供doc文件?類似其他腳本

docker/start_namenode.sh Outdated Show resolved Hide resolved
@chia7712
Copy link
Contributor

https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cdh_ig_hdfs_mountable.html

另外請搭配這篇文章測試一下可行性,謝謝

docs/run_hadoop.md Outdated Show resolved Hide resolved
docs/run_hadoop.md Outdated Show resolved Hide resolved
docs/run_hadoop.md Outdated Show resolved Hide resolved
@chia7712
Copy link
Contributor

chia7712 commented Feb 1, 2023

@chaohengstudent 如果 hadoop-hdfs-fuse 還需要一點時間的話,我們先完成這隻PR

@chia7712
Copy link
Contributor

chia7712 commented Feb 1, 2023

@chaohengstudent 我上面留言的意思是fuse可以再下一隻PR完成

@chaohengstudent
Copy link
Collaborator Author

chaohengstudent 我上面留言的意思是fuse可以再下一隻PR完成

好的,fuse 的部份測試好會再開一支PR處理。

chia7712
chia7712 previously approved these changes Feb 1, 2023
docker/start_datanode.sh Outdated Show resolved Hide resolved
docker/start_datanode.sh Outdated Show resolved Hide resolved
@chia7712
Copy link
Contributor

chia7712 commented Feb 1, 2023

啊 我不小心按到 approve ,歹勢,還有一些問題請看一下

docker/start_hadoop.sh Outdated Show resolved Hide resolved
docker/start_hadoop.sh Outdated Show resolved Hide resolved
docker/start_hadoop.sh Outdated Show resolved Hide resolved
docker/start_hadoop.sh Outdated Show resolved Hide resolved
docker/start_hadoop.sh Outdated Show resolved Hide resolved
docker/start_hadoop.sh Outdated Show resolved Hide resolved
docker/start_hadoop.sh Outdated Show resolved Hide resolved
Copy link
Contributor

@chia7712 chia7712 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

趕快合併,我晚點會再測試一次

@chaohengstudent chaohengstudent merged commit a7fd917 into opensource4you:main Feb 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants