Hosting model checkpoints on the Hugging Face hub

[edbeeching]

Hello, thank you for sharing these checkpoints with the community.

Would you be interested in hosting these checkpoints on the Hugging Face Model Hub?

In addition, we could also collaborate on the creation of a tool to visualize the agents live in the browser, similar to our proof of concept example.

[floringogianu]

Hi! Yes, that would be great. I'll take a look at what's required as I don't have much experience working with the Hugging Face hub api.

[edbeeching]

We have tutorials on the HF hub here.

If you are able to convert the checkpoints to StableBaselines3 models, we include a a push_to_hub() function in our hugging_face_sb3 fork.

I would be happy to provide any assitance if you need it.

[NathanGavenski]

Hi, @floringogianu. Do you have any updates on that? I'm trying to download the checkpoints from the link provided, and they keep failing for me. If there is any other source I could use, I'd love to help with this issue 😄

[floringogianu]

Hi @NathanGavenski, thanks for raising this up. I’ll be able to check if there are any issues with the storage later today.

Starting tomorrow I’ll also start uploading the models on Hugging Face. This should improve things.

[NathanGavenski]

For those trying to download the checkpoints and failing. I've managed to do so by using curl:

curl 'https://share.bitdefender.com/s/qCF7jFxkgx2qJeT/download?path=%2FMDQN_modern&files=Asteroids&downloadStartSecret=nyhw5aird3t' \
  -H 'authority: share.bitdefender.com' \
  -H 'accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9' \
  -H 'accept-language: en-US,en;q=0.9,pt-BR;q=0.8,pt;q=0.7' \
  -H 'cookie: __Host-nc_sameSiteCookielax=true; __Host-nc_sameSiteCookiestrict=true; oc_sessionPassphrase=4DsVVvG78%2BgdsXA6BXv5go9jgL3VFkh6BSz4ZOxkns4%2Frg1nkBk6U85UWa7Wfl4oqSTdfi85BjiLaXPBMS26RSxeVkpgKHu%2Fh6OhkwWpHfqKhFzScgPq0AmYiqo9HdCY; oc27vvt0q0o7=h8umj9gld7rin1cgseair121e3; __cflb=02DiuJPy8DgWkB3KaGVJ2zozpakTBtvjpjxJbwgDWBYcU; cp%3A5232029519211759d9b92a624e88df97%3Asession%3Aid=e96ad929650f3118f8d1dd78bfc7fab9; cp%3Amanual%3Acb-fv%3Aclose=Yes' \
  -H 'cp-extension-installed: Yes' \
  -H 'referer: https://share.bitdefender.com/s/qCF7jFxkgx2qJeT?path=%2FMDQN_modern' \
  -H 'sec-ch-ua: " Not A;Brand";v="99", "Chromium";v="102", "Google Chrome";v="102"' \
  -H 'sec-ch-ua-mobile: ?0' \
  -H 'sec-ch-ua-platform: "Windows"' \
  -H 'sec-fetch-dest: document' \
  -H 'sec-fetch-mode: navigate' \
  -H 'sec-fetch-site: same-origin' \
  -H 'sec-fetch-user: ?1' \
  -H 'upgrade-insecure-requests: 1' \
  -H 'user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/102.0.0.0 Safari/537.36' \
  --compressed \
  --output asteroids.zip

This command is an example of the asteroids checkpoint.
For other checkpoints, it needs to change the File parameter, or the path has to change for the whole folder.

[floringogianu]

Just a small update, for anyone having difficulties downloading the checkpoints. They've been hosted on google storage for a few months now and it's much more easier to download specific checkpoints, see: https://github.com/floringogianu/atari-agents?tab=readme-ov-file#installation