[ODSC-6682] Delete HF cache by default while registering models

[VipulMascarenhas]

Description

Issue

When a user registered a model in AI Quick Actions, the /dev/sdb drive space would get occupied and take up 100% of the space for some users. Currently, a cached-model folder is created when user does not set the local directory.

Solution

In this PR, we delete the model cache by default after a model is registered. The cached-model folder will also not be created, instead the artifacts of model named oracle/aqua-1t-mega-model will be written to the .cache/huggingface/hub/models--oracle--aqua-1t-mega-model/ folder. Once a model is successfully registered, the artifacts are removed from two places:

• local_dir if specified
• .cache/huggingface/hub/models--*/ folder that removes other relevant metadata and artifacts (if local_dir was not specifed)

If a user wishes to keep the artifacts, then they need to set delete_from_local as False explicitly.

Testing [WIP]

In Progress, will add some examples here.

Unit Tests

> python -m pytest -q tests/unitary/with_extras/aqua/test_cli.py tests/unitary/with_extras/aqua/test_model.py tests/unitary/with_extras/aqua/test_model_handler.py

======================================== test session starts ========================================
platform darwin -- Python 3.9.21, pytest-7.4.4, pluggy-1.5.0
rootdir: /Users/user/workspace/git/accelerated-data-science
configfile: pytest.ini
plugins: cov-6.0.0, Faker-33.1.0, anyio-4.6.2, dash-2.18.2, xdist-3.6.1
collected 62 items

tests/unitary/with_extras/aqua/test_cli.py ..............                                     [ 22%]
tests/unitary/with_extras/aqua/test_model.py ............................                     [ 67%]
tests/unitary/with_extras/aqua/test_model_handler.py ....................                     [100%]

======================================== 62 passed in 9.12s =========================================

[github-actions]

📌 Cov diff with main:

📌 Overall coverage:

[mrDzurb]

WOuldn't it be better to name it something like - cleanup_model_cache? I don't have a strong opinion, but delete_from_local doesn't sound intuitive for me.

[VipulMascarenhas]

now that you called it out, it does sounds a bit vague. I've updated the field to cleanup_model_cache.

[github-actions]

📌 Cov diff with main:

📌 Overall coverage: