Convert downloads cleaning task into a parallel process in search service
Context: https://github.com/huggingface/dataset-viewer/pull/2701#discussion_r1562223865
Instead of doing a random cleaning when the user performs a request, make the process run in parallel to the Starlette app.
Convert downloads cleaning task into a parallel process in search service: Context: https://github.com/huggingface/dataset-viewer/pull/2701#discussion_r1562223865
Instead of doing a random cleaning when the user performs a request, make the process run in parallel to the Starlette app.