WIP - Adding dataset--split-names aggregation worker
For https://github.com/huggingface/datasets-server/issues/734 we need a way to compute /splits based the new worker's cache /split-names-from-streaming and /split-names-from-dataset-info.
The new worker name will be `dataset--split-names` (Following new nomenclature https://github.com/huggingface/datasets-server/issues/867).
This is a WIP to achieve a new more robust response for /splits.
Depends on https://github.com/huggingface/datasets-server/pull/909
Pending tasks:
- [ ] Unit test for new worker

WIP - Adding dataset--split-names aggregation worker: For https://github.com/huggingface/datasets-server/issues/734 we need a way to compute /splits based the new worker's cache /split-names-from-streaming and /split-names-from-dataset-info.
The new worker name will be `dataset--split-names` (Following new nomenclature https://github.com/huggingface/datasets-server/issues/867).
This is a WIP to achieve a new more robust response for /splits.
Depends on https://github.com/huggingface/datasets-server/pull/909
Pending tasks:
- [ ] Unit test for new worker
