Search service with local storage
Part of https://github.com/huggingface/dataset-viewer/issues/2593
When migrating to local storage, from dataset-viewer side, it is just needs to:
- [x] Point to the local storage
- [x] Change replicas and uvicornNumWorkers according to AWS instance type provisioned by the infra team (r6id.8xlarge)
- [x] Unmount all references to volumeDuckDBIndex
- [x] Move cleanDuckdbIndexCache cron job to run inside search service pod and reduce time interval from 3 days to something shorter
- [x] In search service, return  and error if storage is out of space

From infra side I think it is required to:
- [x] Change AWS instance type (r6id.8xlarge)
- [x] Mechanism to redirect requests to the same pod -> https://github.com/huggingface/dataset-viewer/pull/2708/files

![image](https://github.com/huggingface/dataset-viewer/assets/5564745/da7e9d33-797b-4ce3-8ae1-4db1f7091648)


Does it sound like a plan? @rtrompier @severo @lhoestq 
Search service with local storage: Part of https://github.com/huggingface/dataset-viewer/issues/2593
When migrating to local storage, from dataset-viewer side, it is just needs to:
- [x] Point to the local storage
- [x] Change replicas and uvicornNumWorkers according to AWS instance type provisioned by the infra team (r6id.8xlarge)
- [x] Unmount all references to volumeDuckDBIndex
- [x] Move cleanDuckdbIndexCache cron job to run inside search service pod and reduce time interval from 3 days to something shorter
- [x] In search service, return  and error if storage is out of space

From infra side I think it is required to:
- [x] Change AWS instance type (r6id.8xlarge)
- [x] Mechanism to redirect requests to the same pod -> https://github.com/huggingface/dataset-viewer/pull/2708/files

![image](https://github.com/huggingface/dataset-viewer/assets/5564745/da7e9d33-797b-4ce3-8ae1-4db1f7091648)


Does it sound like a plan? @rtrompier @severo @lhoestq 