Code

[LLM] support Qwen2#8338

Code

Merged

wawltor merged 51 commits intoPaddlePaddle:developPaddlePaddle/PaddleNLP:developfrom DrownFish19:dev_add_qwen1.5-moeDrownFish19/PaddleNLP:dev_add_qwen1.5-moeCopy head branch name to clipboardJun 11, 2024

+4,543-14

Commits

Commits on Apr 17, 2024

• add Qwen2Moe

  DrownFish19

  committed
  36ab9a7

  Copy full SHA for 36ab9a7

• update default config

  DrownFish19

  committed
  3913e11

  Copy full SHA for 3913e11

• Merge remote-tracking branch 'paddlenlp/develop' into dev_add_qwen1.5-moe

  DrownFish19

  committed
  0aa1aca

  Copy full SHA for 0aa1aca

Commits on Apr 18, 2024

• update QWen2Moe modeling

  DrownFish19

  committed
  a29e90d

  Copy full SHA for a29e90d

• update modeling

  DrownFish19

  committed
  d514dff

  Copy full SHA for d514dff

Commits on Apr 19, 2024

• update ckpt name

  DrownFish19

  committed
  1e98323

  Copy full SHA for 1e98323

Commits on Apr 22, 2024

• Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

  DrownFish19

  authored
  f81bb43

  Copy full SHA for f81bb43

Commits on Apr 25, 2024

• support same prefix model name for auto modeling

  DrownFish19

  committed
  37dd2d5

  Copy full SHA for 37dd2d5

• update qwen2moe testing

  DrownFish19

  committed
  d12938a

  Copy full SHA for d12938a

• update qwen2moe modeling and config

  DrownFish19

  committed
  8cc49fc

  Copy full SHA for 8cc49fc

• update qwen2moe import

  DrownFish19

  committed
  9c8222e

  Copy full SHA for 9c8222e

• fix mlp hidden_size

  DrownFish19

  committed
  4d6ff87

  Copy full SHA for 4d6ff87

• update qkv bias convert

  DrownFish19

  committed
  f350a2f

  Copy full SHA for f350a2f

• update modeling init_weight

  DrownFish19

  committed
  c53690d

  Copy full SHA for c53690d

• update _get_name_mappings

  DrownFish19

  committed
  9d12995

  Copy full SHA for 9d12995

• update _get_name_mappings and _init_weight

  DrownFish19

  committed
  dba0f74

  Copy full SHA for dba0f74

Commits on Apr 26, 2024

• add tokenizer

  DrownFish19

  committed
  e487606

  Copy full SHA for e487606

• update modeling

  DrownFish19

  committed
  cd9c753

  Copy full SHA for cd9c753

• update modeling

  DrownFish19

  committed
  10407c4

  Copy full SHA for 10407c4

• update tokenizer

  DrownFish19

  committed
  beb0f4c

  Copy full SHA for beb0f4c

Commits on Apr 28, 2024

• update modeling and tokenizer

  DrownFish19

  committed
  beefee9

  Copy full SHA for beefee9

• fix index_add_ error

  DrownFish19

  committed
  82ba345

  Copy full SHA for 82ba345

• Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

  DrownFish19

  authored
  d522ee4

  Copy full SHA for d522ee4

• fix

  DrownFish19

  committed
  4a1b2e3

  Copy full SHA for 4a1b2e3

• Merge branch 'dev_add_qwen1.5-moe' of github.com:DrownFish19/PaddleNLP into dev_add_qwen1.5-moe

  DrownFish19

  committed
  526a9db

  Copy full SHA for 526a9db

Commits on May 6, 2024

• Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

  DrownFish19

  authored
  0c9d5ec

  Copy full SHA for 0c9d5ec

• update comments

  DrownFish19

  committed
  2bb3aba

  Copy full SHA for 2bb3aba

Commits on May 10, 2024

• update lora weights

  DrownFish19

  committed
  f203983

  Copy full SHA for f203983

• add todo

  DrownFish19

  committed
  58af3ec

  Copy full SHA for 58af3ec

Commits on May 29, 2024

• Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

  DrownFish19

  authored
  c766eb5

  Copy full SHA for c766eb5

• update Copyright

  DrownFish19

  committed
  5ddc326

  Copy full SHA for 5ddc326

• update Moe to MoE

  DrownFish19

  committed
  de1db67

  Copy full SHA for de1db67

Commits on May 30, 2024

• Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

  DrownFish19

  authored
  10a194c

  Copy full SHA for 10a194c

• update comment

  DrownFish19

  committed
  87f0276

  Copy full SHA for 87f0276

Commits on May 31, 2024

• update Copyright

  DrownFish19

  committed
  8d9970b

  Copy full SHA for 8d9970b

Commits on Jun 3, 2024

• Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

  DrownFish19

  authored
  89994a6

  Copy full SHA for 89994a6

• update readme and json

  DrownFish19

  committed
  d57a5b1

  Copy full SHA for d57a5b1

• update __init__.py

  DrownFish19

  committed
  bfb65a1

  Copy full SHA for bfb65a1

Commits on Jun 4, 2024

• add qwen-1.5

  DrownFish19

  committed
  4b96dd0

  Copy full SHA for 4b96dd0

Commits on Jun 5, 2024

• update QWen to Qwen

  DrownFish19

  committed
  b274f12

  Copy full SHA for b274f12

• update Qwen2MoE to Qwen2Moe

  DrownFish19

  committed
  1054f06

  Copy full SHA for 1054f06

• update readme

  DrownFish19

  committed
  056b04c

  Copy full SHA for 056b04c

• update qwen2moe sft and lora json

  DrownFish19

  committed
  ab08c17

  Copy full SHA for ab08c17

• update qwen2moe base name

  DrownFish19

  committed
  ad02fdc

  Copy full SHA for ad02fdc

Commits on Jun 7, 2024

• update qwen2

  DrownFish19

  committed
  23e39fc

  Copy full SHA for 23e39fc

• update

  DrownFish19

  committed
  36b3897

  Copy full SHA for 36b3897

Commits on Jun 11, 2024

• Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

  DrownFish19

  authored
  6455445

  Copy full SHA for 6455445

• update readme

  DrownFish19

  committed
  b140df6

  Copy full SHA for b140df6

• Merge branch 'dev_add_qwen1.5-moe' of github.com:DrownFish19/PaddleNLP into dev_add_qwen1.5-moe

  DrownFish19

  committed
  c08c9a6

  Copy full SHA for c08c9a6

• update readme

  DrownFish19

  committed
  e6de5f3

  Copy full SHA for e6de5f3

• update readme

  DrownFish19

  committed
  48ae2ab

  Copy full SHA for 48ae2ab