fix DataLoaderDispatcher issue in Gaudi

[sywangyi]

TRL SFT trainer has used IterableDataset and DataLoaderDispatcher will be called. The data shape/tensor will be broadcasted from rank 0 to other rank in DDP.

What does this PR do?

Fixes # (issue)

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you make sure to update the documentation with your changes?
• Did you write any new necessary tests?

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[sywangyi]

Traceback (most recent call last):
File "/intel-extension-for-transformers/optimum-habana/examples/trl_example/stack_llama_2/sft_llama2.py", line 184, in
trainer.train()
File "/usr/local/lib/python3.10/dist-packages/trl/trainer/sft_trainer.py", line 281, in train
output = super().train(*args, **kwargs)
File "/intel-extension-for-transformers/optimum-habana/optimum/habana/transformers/trainer.py", line 486, in train
return inner_training_loop(
File "/intel-extension-for-transformers/optimum-habana/optimum/habana/transformers/trainer.py", line 807, in _inner_training_loop
for step, inputs in enumerate(epoch_iterator):
File "/usr/local/lib/python3.10/dist-packages/accelerate/data_loader.py", line 664, in iter
raise ValueError(
ValueError: Batch does not contain any data (None). At the end of all iterable data available before expected stop iteration.
Traceback (most recent call last):
File "/intel-extension-for-transformers/optimum-habana/examples/trl_example/stack_llama_2/sft_llama2.py", line 184, in
trainer.train()
File "/usr/local/lib/python3.10/dist-packages/trl/trainer/sft_trainer.py", line 281, in train
output = super().train(*args, **kwargs)
File "/intel-extension-for-transformers/optimum-habana/optimum/habana/transformers/trainer.py", line 486, in train
return inner_training_loop(
File "/intel-extension-for-transformers/optimum-habana/optimum/habana/transformers/trainer.py", line 807, in _inner_training_loop
for step, inputs in enumerate(epoch_iterator):
File "/usr/local/lib/python3.10/dist-packages/accelerate/data_loader.py", line 664, in iter
raise ValueError(
ValueError: Batch does not contain any data (None). At the end of all iterable data available before expected stop iteration.

[regisss]

LGTM