Add convergence tests and trainer integration test for Qwen2

[Tcc0403]

Summary

Discussion

Add convergence tests and trainer integration test for Qwen2

Details

Qwen2's config and parameters are copied from test_cross_entropy.py.

I also added qwen2 mock in test_apply_liger_kernel_only_supported_model_type_called just in case. But are we going to add every new models from now on?

Testing Done

I don't have a GPU with enough memory, only run test_trainer_integration.py and test_transformers_monkey_patch.py.
Need others to help with make test.

• Hardware Type: RTX-3080-10G
• run make test to ensure correctness
• run make checkstyle to ensure code style
• run make test-convergence to ensure convergence

❯ pytest test/transformers/test_transformers_monkey_patch.py
============================================ test session starts =============================================
platform linux -- Python 3.10.12, pytest-8.3.2, pluggy-1.5.0
rootdir: /home/tcc/Liger-Kernel
collected 1 item

test/transformers/test_transformers_monkey_patch.py .                                                  [100%]

============================================= 1 passed in 1.72s ==============================================
❯ pytest test/transformers/test_trainer_integration.py
============================================ test session starts =============================================
platform linux -- Python 3.10.12, pytest-8.3.2, pluggy-1.5.0
rootdir: /home/tcc/Liger-Kernel
collected 3 items

test/transformers/test_trainer_integration.py ...                                                      [100%]

============================================= 3 passed in 1.84s ==============================================

❯ make checkstyle
flake8 .; flake8_status=$?; \
isort .; isort_status=$?; \
black .; black_status=$?; \
if [ $flake8_status -ne 0 ] || [ $isort_status -ne 0 ] || [ $black_status -ne 0 ]; then \
        exit 1; \
fi
Skipped 2 files
All done! ✨ 🍰 ✨
52 files left unchanged.

❯ make test-convergence
HF_DATASETS_OFFLINE=1 pytest --disable-warnings test/convergence
============================================ test session starts =============================================
platform linux -- Python 3.10.12, pytest-8.3.2, pluggy-1.5.0
rootdir: /home/tcc/Liger-Kernel
collected 12 items

test/convergence/test_mini_models.py ........                                                          [ 66%]
test/convergence/test_mini_models_no_logits.py ....                                                    [100%]

======================================= 12 passed in 81.23s (0:01:21) ========================================

[ByronHsu]

Are you in discord? https://discord.gg/nSeNms8u. Please say hi!

[ByronHsu]

the test cannot scale. i will make a change.

[ByronHsu]

please solve the conflict

[Tcc0403]

Solved the conflict and deleted qwen from integration test!

[ByronHsu]

cc @shivam15s to refactor the test to a for loop