-
Notifications
You must be signed in to change notification settings - Fork 2.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
docs and simplification of cmd args #8979
Conversation
Signed-off-by: arendu <[email protected]>
jenkins |
for more information, see https://pre-commit.ci
num_doc_samples_per_dataset = [[None]] * len(data_cfg.doc_file_names) | ||
num_query_files = len(data_cfg.query_file_names) if data_cfg.query_file_names is not None else 0 | ||
num_doc_files = len(data_cfg.doc_file_names) if data_cfg.doc_file_names is not None else 0 | ||
num_query_samples_per_dataset = [[None]] * num_query_files |
Check notice
Code scanning / CodeQL
Unused local variable Note
num_query_files = len(data_cfg.query_file_names) if data_cfg.query_file_names is not None else 0 | ||
num_doc_files = len(data_cfg.doc_file_names) if data_cfg.doc_file_names is not None else 0 | ||
num_query_samples_per_dataset = [[None]] * num_query_files | ||
num_doc_samples_per_dataset = [[None]] * num_doc_files |
Check notice
Code scanning / CodeQL
Unused local variable Note
Signed-off-by: arendu <[email protected]>
Signed-off-by: arendu <[email protected]>
|
||
python3 /NeMo/examples/nlp/information_retrieval/megatron_gpt_embedding_finetuning.py \ | ||
exp_manager.exp_dir="PATH_TO_SAVE_LORA_WEIGHTS" \ | ||
model.global_batch_size=4 \ # exact choice for global batch size is data dependent typical values are in the rage of 32 to 128. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
rage -> range
Great doc @arendu , just a few typos to fix. Btw, I saw no Jenkins test, is cicd-main.yml the replacement? |
Signed-off-by: Adi Renduchintala <[email protected]>
Signed-off-by: arendu <[email protected]>
…DIA/NeMo into adithyare/docs_gpt_embedding
Signed-off-by: arendu <[email protected]>
Signed-off-by: Adi Renduchintala <[email protected]>
* docs and simplification of cmd args Signed-off-by: arendu <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * added cicd test Signed-off-by: arendu <[email protected]> * added cicd test is needs Signed-off-by: arendu <[email protected]> * Update information_retrieval.rst Signed-off-by: Adi Renduchintala <[email protected]> * updated to fix wrong file paths Signed-off-by: arendu <[email protected]> * update Signed-off-by: arendu <[email protected]> * Update cicd-main.yml Signed-off-by: Adi Renduchintala <[email protected]> --------- Signed-off-by: arendu <[email protected]> Signed-off-by: Adi Renduchintala <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Pablo Garay <[email protected]> Signed-off-by: Ao Tang <[email protected]>
* docs and simplification of cmd args Signed-off-by: arendu <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * added cicd test Signed-off-by: arendu <[email protected]> * added cicd test is needs Signed-off-by: arendu <[email protected]> * Update information_retrieval.rst Signed-off-by: Adi Renduchintala <[email protected]> * updated to fix wrong file paths Signed-off-by: arendu <[email protected]> * update Signed-off-by: arendu <[email protected]> * Update cicd-main.yml Signed-off-by: Adi Renduchintala <[email protected]> --------- Signed-off-by: arendu <[email protected]> Signed-off-by: Adi Renduchintala <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Pablo Garay <[email protected]>
What does this PR do ?
Add a one line overview of what this PR aims to accomplish.
Collection: [Note which collection this PR will affect]
Changelog
Usage
# Add a code snippet demonstrating how to use this
Jenkins CI
The Jenkins CI system has been replaced by GitHub Actions self-hosted runners.
There's no need to comment
jenkins
on the PR to trigger Jenkins CI.The GitHub Actions CI will run automatically when the PR is opened.
To run CI on an untrusted fork, a NeMo user with write access must click "Approve and run".
Before your PR is "Ready for review"
Pre checks:
PR Type:
If you haven't finished some of the above items you can still open "Draft" PR.
Who can review?
Anyone in the community is free to review the PR once the checks have passed.
Contributor guidelines contains specific people who can review PRs to various areas.
Additional Information