feat: add granitemoeshared and granitemoehybrid to multipack

[NanoCode012]

Description

Make sure to install axolotl-ai-cloud/ml-cross-entropy#24

Motivation and Context

How has this been tested?

Screenshots (if appropriate)

Types of changes

Social Handles (Optional)

Summary by CodeRabbit

• New Features
  • Added support for two new model variants, expanding the range of supported model configurations for multipack processing.

[coderabbitai]

📝 Walkthrough

Walkthrough

This pull request adds two new model type identifiers—"granitemoeshared" and "granitemoehybrid"—to the SUPPORTED_MULTIPACK_MODEL_TYPES list in the multipack monkeypatch module, extending support for Granite model variants.

Changes

Cohort / File(s)	Summary
Adding Granite model type identifiers src/axolotl/monkeypatch/multipack.py	Added "granitemoeshared" and "granitemoehybrid" to SUPPORTED_MULTIPACK_MODEL_TYPES list

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~5–10 minutes

• Verify that "granitemoeshared" and "granitemoehybrid" are the correct model type identifiers
• Ensure consistency with how other model types are named and registered in the list

Possibly related PRs

• Feat: add qwen3_vl, qwen3_vl_moe, granitemoeshared, granitemoehybrid, and upgraded all cce patches #3178: Adds the same model type identifiers (granitemoeshared and granitemoehybrid) to supported multipack model types.

Suggested labels

ready to merge

Suggested reviewers

• winglian
• SalmanMohammadi

Pre-merge checks and finishing touches

✅ Passed checks (3 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title directly and specifically describes the main change: adding two new model type strings (granitemoeshared and granitemoehybrid) to the supported multipack model types.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

✨ Finishing touches

• 📝 Generate docstrings

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment
• Commit unit tests in branch feat/granitehybrid

---

📜 Recent review details

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 58d67bf and 1075291.

📒 Files selected for processing (1)

• src/axolotl/monkeypatch/multipack.py (1 hunks)

⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (6)

• GitHub Check: PyTest (3.11, 2.8.0)
• GitHub Check: PyTest (3.11, 2.9.0)
• GitHub Check: PyTest (3.11, 2.7.1)
• GitHub Check: PyTest from Source Dist (3.11, 2.7.1)
• GitHub Check: PyTest from Source Dist (3.11, 2.8.0)
• GitHub Check: PyTest from Source Dist (3.11, 2.9.0)

🔇 Additional comments (1)

src/axolotl/monkeypatch/multipack.py (1)

41-42: Add Liger kernel support for new Granite MoE variants or clarify if intentional.

The new models granitemoeshared and granitemoehybrid are added to SUPPORTED_MULTIPACK_MODEL_TYPES, but they're missing from the Liger kernel integration in src/axolotl/integrations/liger/plugin.py. The existing granitemoe model has explicit Liger kernel support via apply_liger_kernel_to_granite() at lines 156–159.

If these new models are MoE variants (as their names suggest), they should receive the same treatment. Either:

• Add the new models to the Liger plugin's Granite MoE handling, or
• Clarify if Liger support is deferred to the dependency PR mentioned in the description

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!