Improve our mup implementation

[Quentin-Anthony]

• Deferred init support
• Implement remaining GPT mup params from paper

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

✅ Quentin-Anthony
❌ curt-tigges
_{You have signed the CLA already but the status is still pending? Let us recheck it.}