Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Llama Inference Template Code 제작 #78

Merged
merged 5 commits into from
May 18, 2024
Merged

Llama Inference Template Code 제작 #78

merged 5 commits into from
May 18, 2024

Conversation

jhM00n
Copy link

@jhM00n jhM00n commented May 18, 2024

No description provided.

@jhM00n jhM00n requested review from mh3ong and Kim-Yul May 18, 2024 15:42
@jhM00n jhM00n self-assigned this May 18, 2024
@jhM00n jhM00n changed the title GenAI Inference Template Code 제작 GenAI Inference Template Llama Code 제작 May 18, 2024
@jhM00n jhM00n changed the title GenAI Inference Template Llama Code 제작 Llama Inference Template Code 제작 May 18, 2024
Comment on lines 55 to 62
requests:
cpu: 2000m
memory: 2000M
nvidia.com/gpu: 1
limits:
cpu: 2000m
memory: 2000M
nvidia.com/gpu: 1
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CPU 1700m, Memory 3800M으로 변경해도 될듯.

memory: 2000M
nvidia.com/gpu: 1
nodeSelector:
karpenter.sh/nodepool: {node_pool_name}
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nodepool은 nodepool-1을 사용하는 것으로 결정.

@jhM00n
Copy link
Author

jhM00n commented May 18, 2024

수정 완료.

확인 후 merge 부탁드립니다.

Copy link

@Kim-Yul Kim-Yul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

내용 확인해봤는데 잘 적용된 것 같습니다.
다만 죄송한 건 무현님 코멘트에 따라 다시 수정할 수도 있다는 점.. 그리고 requirements.txt 파일이 수정될 수 있다는 점만 상기해주세요.
bb 고생하셨습니다.

@mh3ong mh3ong merged commit 9f6a0da into master May 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants