[deps] Add safetensors dependency, see #2372

[tomaarsen]

Resolves #2372

Hello!

Pull Request overview

• Add safetensors dependency.

Details

#2372 mentions a case where the lack of this dependency prevents models from being loaded. Related is #2345 which should improve model loading, e.g. when a model is stored as a model.safetensors file.

• Tom Aarsen

[tomaarsen]

Additionally, increment transformers & huggingface_hub versions, and remove tokenizers dependency (as transformers will take care of that for us)

[tomaarsen]

transformers & huggingface_hub are being incremented in #2376

[tomaarsen]

transformers will need to be at least 4.32.0 due to #2345, and 4.32.0 onwards has safetensors as a dependency, so we don't need to explicitly specify it.

• Tom Aarsen