Hot fix regional compilation

[IlyasMoutawwakil]

What does this PR do?

Fixes # (issue)

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you make sure to update the documentation with your changes?
• Did you write any new necessary tests?

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[yafshar]

@IlyasMoutawwakil I am getting an error with this PR

[INFO|trainer.py:831] 2025-05-27 18:16:00,172 >>   Number of trainable parameters = 16,384,000
[rank0]: Traceback (most recent call last):
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/optimum/habana/transformers/trainer.py", line 2587, in _zero_model_grad
[rank0]:     model.zero_grad(set_to_none=set_to_none)
[rank0]: TypeError: DeepSpeedEngine.zero_grad() got an unexpected keyword argument 'set_to_none'

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "/root/optimum-habana/examples/language-modeling/run_lora_clm.py", line 990, in <module>
[rank0]:     main()
[rank0]:   File "/root/optimum-habana/examples/language-modeling/run_lora_clm.py", line 963, in main
[rank0]:     train_result = trainer.train(resume_from_checkpoint=training_args.resume_from_checkpoint)
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/optimum/habana/transformers/trainer.py", line 610, in train
[rank0]:     return inner_training_loop(
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/optimum/habana/transformers/trainer.py", line 882, in _inner_training_loop
[rank0]:     self._zero_model_grad(model)
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/optimum/habana/transformers/trainer.py", line 2590, in _zero_model_grad
[rank0]:     model.zero_grad()
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/deepspeed/runtime/engine.py", line 2119, in zero_grad
[rank0]:     for param_name, param in self.module.named_parameters():
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/deepspeed/runtime/engine.py", line 519, in __getattr__
[rank0]:     return getattr(self, name)
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/deepspeed/runtime/engine.py", line 519, in __getattr__
[rank0]:     return getattr(self, name)
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/deepspeed/runtime/engine.py", line 519, in __getattr__
[rank0]:     return getattr(self, name)
[rank0]:   [Previous line repeated 491 more times]
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/deepspeed/runtime/engine.py", line 518, in __getattr__
[rank0]:     if name in dir(self):
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 2972, in __dir__
[rank0]:     module_attrs = dir(self.__class__)
[rank0]: RecursionError: maximum recursion depth exceeded while calling a Python object

[yafshar]

with the latest fix there is no error for above example

[regisss]

LGTM