New parent job runner for cached data
Currently, we have datasets_based_job_runner but we need a new one that only creates a chance folder without modifying the datasets library config.
Context https://github.com/huggingface/datasets-server/pull/1296#discussion_r1232512427
New parent job runner for cached data: Currently, we have datasets_based_job_runner but we need a new one that only creates a chance folder without modifying the datasets library config.
Context https://github.com/huggingface/datasets-server/pull/1296#discussion_r1232512427