Polish test/ and others

[ByronHsu]

Summary

as title

Testing Done

• run make test to ensure correctness
• run make checkstyle to ensure code style
• run make test-convergence to ensure convergence

jobuser [ ~/Liger-Kernel ]$ make checkstyle && make test && make test-convergence
flake8 .; flake8_status=$?; \
isort .; isort_status=$?; \
black .; black_status=$?; \
if [ $flake8_status -ne 0 ] || [ $isort_status -ne 0 ] || [ $black_status -ne 0 ]; then \
        exit 1; \
fi
Skipped 1 files
All done! ✨ 🍰 ✨
45 files left unchanged.
pytest --disable-warnings test/ --ignore=test/convergence
================================================================================================== test session starts ===================================================================================================
platform linux -- Python 3.10.14, pytest-7.1.2, pluggy-1.0.0
rootdir: /home/jobuser/Liger-Kernel
plugins: lipy-config-base-30.6.1, lipy-fabric-35.2.3, lipy-test-8.0.52, datadir-1.3.1, lipy-mp-34.4.191
collected 111 items                                                                                                                                                                                                      

test/transformers/test_cross_entropy.py ..........................................................                                                                                                                 [ 52%]
test/transformers/test_fused_linear_cross_entropy.py ......                                                                                                                                                        [ 57%]
test/transformers/test_geglu.py ........                                                                                                                                                                           [ 64%]
test/transformers/test_rms_norm.py ................                                                                                                                                                                [ 79%]
test/transformers/test_rope.py ............                                                                                                                                                                        [ 90%]
test/transformers/test_swiglu.py ........                                                                                                                                                                          [ 97%]
test/transformers/test_transformers_monkey_patch.py .                                                                                                                                                              [ 98%]
test/triton/test_triton_monkey_patch.py ..                                                                                                                                                                         [100%]

============================================================================================= 111 passed in 60.64s (0:01:00) =============================================================================================
HF_DATASETS_OFFLINE=1 pytest --disable-warnings test/convergence
================================================================================================== test session starts ===================================================================================================
platform linux -- Python 3.10.14, pytest-7.1.2, pluggy-1.0.0
rootdir: /home/jobuser/Liger-Kernel
plugins: lipy-config-base-30.6.1, lipy-fabric-35.2.3, lipy-test-8.0.52, datadir-1.3.1, lipy-mp-34.4.191
collected 8 items                                                                                                                                                                                                        

test/convergence/test_mini_models.py ......                                                                                                                                                                        [ 75%]
test/convergence/test_mini_models_no_logits.py ..                                                                                                                                                                  [100%]

============================================================================================== 8 passed in 95.88s (0:01:35) ==============================================================================================