Try FTS index in local storage
Before trying to change to local disks for duckdb index files, I would like to confirm whether it speeds up the response for some datasets analyzed in https://github.com/huggingface/dataset-viewer/issues/2593.

**wikimedia/wikipedia-20231101.en-train** (Medium size: 9.1 GB) =  ~17 seconds
**MohamedRashad/Arabic-CivitAi-Images - default - train** (Small size: 580 MB) =  ~4 seconds
 **jp1924/VIsualQuestionAnswering - default - train** (Big size: 23 GB) =  ~42 seconds
**asoria/search_test - default - train** (Small: 27 MB)  =  ~2 seconds

All of these indexes will occupy something like 33 GB, which is not a problem for our current pods with 40 GB free. I will manually delete after each test and then rollback.
Try FTS index in local storage: Before trying to change to local disks for duckdb index files, I would like to confirm whether it speeds up the response for some datasets analyzed in https://github.com/huggingface/dataset-viewer/issues/2593.

**wikimedia/wikipedia-20231101.en-train** (Medium size: 9.1 GB) =  ~17 seconds
**MohamedRashad/Arabic-CivitAi-Images - default - train** (Small size: 580 MB) =  ~4 seconds
 **jp1924/VIsualQuestionAnswering - default - train** (Big size: 23 GB) =  ~42 seconds
**asoria/search_test - default - train** (Small: 27 MB)  =  ~2 seconds

All of these indexes will occupy something like 33 GB, which is not a problem for our current pods with 40 GB free. I will manually delete after each test and then rollback.