How to reduce the remote-raw directory usage ?

[bhzhu203]

I see that when using Remote Backend , the "remote-raw" directory is created automatically .And it will become more and more biger ,even ls/rm command can not list . EXHAUST_PATH is the same as it.

1.Is there something limilation can limit the usage ?
2. Does the remote-raw directory store the one time downloaded files ? or can be reused?
3. Does the remote-raw/EXHAUST_PATH directory can keep the hot data and delete the cold data ?

Thanks

[n0vad3v]

1. Currently no.
2. Files inside remote-raw are the same as in origin, will be reused if the origin's file hasn't changed.
3. No. Currently a workaround is to create crontab to automatically delete files created > x days.

[BennyThink]

We may add limitation of directory(remote-raw, exhaust) in next major version

[greenhost87]

@n0vad3v About crontab for cleaning - is enough to clean remote-raw, exhaust or clean also must clean metadata folders?

[BennyThink]

remove-raw and exhaust are enough.

[BennyThink]

0 0 * * * find /path/to/your/webp/exhaust/ -type f -ctime +1 -exec rm {} \;

[n0vad3v]

Hi @bhzhu203 ,We've released version 0.12.0 which contains a configuration called MAX_CACHE_SIZE that will automatically clean local files if local cache directories' size are larger than setting value, please give it a shot if you're interested. 😇
https://github.com/webp-sh/webp_server_go/releases/tag/0.12.0

Documentation: https://docs.webp.sh/usage/configuration/