Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support push model to ModelScope community #5326

Open
wants to merge 10 commits into
base: main
Choose a base branch
from

Conversation

tastelikefeet
Copy link
Contributor

What does this PR do?

Support pushing trained models to ModelScope community.
This feature works when USE_MODELSCOPE_HUB set to true or 1.
Tested when USE_MODELSCOPE_HUB=0/1 both, ckpts can be pushed to HF or MS respectively.

Script:
examples/train_lora/llama3_lora_sft.yaml
Add config:
push_to_hub: true
hub_strategy: checkpoint/all_checkpoints/every_save
hub_model_id: xxx
hub_token: xxx (hf/ms token each)

Results:
HF not affected.
MS can be uploaded and tagged.

Before submitting

@tastelikefeet tastelikefeet changed the title Support push model to ModelScope community [WIP]Support push model to ModelScope community Sep 2, 2024
@tastelikefeet tastelikefeet changed the title [WIP]Support push model to ModelScope community Support push model to ModelScope community Sep 2, 2024
@hiyouga hiyouga added the pending This problem is yet to be addressed label Sep 2, 2024
…h_to_ms

* commit '1a3e6545b2e1d2dab01d2a257130a47da62e747a': (66 commits)
  Add qwen_vl to liger kernel supported list
  update wechat
  update the ROCm version to 6.2
  update ci
  set dev version
  remove windows in ci
  fix ci
  fix hiyouga#5411
  update accelerate ver for schedule_free optimizers
  fix mm plugin
  fix qwen2vl preprocess
  release v0.9.0 (real)
  fix constants
  release v0.9.0
  tiny fix
  update wechat
  update scripts
  support vllm 0.6.0
  fix test case
  add test case
  ...
@tastelikefeet
Copy link
Contributor Author

@hiyouga hi, can you help to review please when free

@hiyouga hiyouga self-requested a review September 25, 2024 14:52
@hiyouga
Copy link
Owner

hiyouga commented Sep 25, 2024

sure, I'll review this pr ASAP

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pending This problem is yet to be addressed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants