Update hub datasets with webhook
Webhook invalidation of community datasets (hf.co):
- [x] setup a webhook on hf.co for datasets creation, update, deletion -> waiting for https://github.com/huggingface/moon-landing/issues/1344
- [x] add an endpoint to listen to the webhook
- [x] parse the webhook to find which caches should be invalidated
- [x] refresh these caches
- [x] document added in moonrise mongo db
Update hub datasets with webhook: Webhook invalidation of community datasets (hf.co):
- [x] setup a webhook on hf.co for datasets creation, update, deletion -> waiting for https://github.com/huggingface/moon-landing/issues/1344
- [x] add an endpoint to listen to the webhook
- [x] parse the webhook to find which caches should be invalidated
- [x] refresh these caches
- [x] document added in moonrise mongo db