Skip to content

Latest commit

 

History

History
108 lines (78 loc) · 5.67 KB

README_EN.md

File metadata and controls

108 lines (78 loc) · 5.67 KB
Raw

中文 | English

Open-Chinese-LLaMA

Model License

This project is a Chinese large language model base generated through incremental pre-training on Chinese datasets based on LLaMA-7B.

Features

  • This project provides a Chinese pre-trained model obtained through Further-Pretrain, including Huggingface version weights.
  • Compared to the original LLaMA, this model has significantly improved Chinese understanding and generation capabilities, achieving outstanding results in various downstream tasks. See Evaluation for details.
  • This project provides tools for converting Huggingface version weights and Meta version weights.
  • Supports 🤗transformers, and provides command-line tools for easy model testing.

Contents

Model Download

Model Name Weight Type Download Link SHA256
Open-Chinese-LLaMA-7B-Patch Patch [🤗Huggingface]
[Baidu Cloud]
[Google Driver]		 SHA256

Usage Notes

Meta officially released LLaMA does not open-source weights. To comply with relevant licenses, the model released this time is of the patch type, and must be used in conjunction with the official original weights.

We provide a script for installing the patch. After obtaining the official weights through regular channels, you can install the patch as follows:

python tools/patch_model.py --base_model <path_or_name_to_original_model>
                            --patch_model openlmlab/open-chinese-llama-7b-patch
                            --base_model_format <hf_or_raw>

Note: The installation method of this patch is inplace installation, that is, the installed patch is the complete Huggingface version of this model weight, and you can use transformers to load the model.

Note: This script depends on OpenLMLab/collie, please install this framework using the following command:

pip install git+https://github.com/OpenLMLab/collie.git

Local Demo

For quick and easy model testing, we provide a command-line version of the demo. After successfully installing the patch according to Usage Notes, you can use the script to start an interactive interface:

python cli_demo.py --model openlmlab/open-chinese-llama-7b-patch
                   --devices 0
                   --max_length 1024
                   --do_sample true
                   --top_k 40
                   --top_p 0.8
                   --temperature 0.7
                   --penalty 1.02

Examples

Open-Chinese-LLaMA-7B on the left, original LLaMA on the right:

text generation
code generation
instructions (Note: None have been Instruct-tuning)

Evaluation

Open-Chinese-LLaMA-7B performs far better than the original LLaMA on various tasks in Chinese and English datasets. The evaluation results of this model on some datasets are given below (the following indicators are Accuracy, the bigger the better):

Dataset LLAMA 7B Open-Chinese-LLaMA-7B
OCNLI 31.5 45.5
CHID 25.87 71.47
TNEWS 8.70 26.78
CMRC 11.89 34.48
PIQA 79.8 77.31
HumanEval 10.5 14.63
MBPP 17.7 17.2
Average 26.57 41.05

Note: See Benchmark.md for full results

Model Format Conversion

The model generated by patch_model.py in this project is hf format which can be loaded by 🤗transformers. For convenience, we also provide a conversion tool between the official version model (raw) and hf:

python convert_model.py --model_path <path_or_name_to_your_hf_or_raw_model>
                        --source_format hf
                        --target_format raw
                        --target_path <path_you_want_to_save_the_converted_model>
                        --raw_parallel_degree 2
                        --raw_parallel_devices 0,1

Tip: When converting a model in raw format, you need to specify the tensor parallel size and corresponding device, and it can only be converted on a machine with a corresponding number of graphics cards.