feat: Part #3: Adding "partition" granularity level logic
First part of approach # 2 of https://github.com/huggingface/datasets-server/issues/1087
Adding a new granularity level - "Partition", will imply to also have a new field in Job and Cache.
Depends on https://github.com/huggingface/datasets-server/pull/1263, https://github.com/huggingface/datasets-server/pull/1259
and https://github.com/huggingface/datasets-server/pull/1260
feat: Part #3: Adding "partition" granularity level logic: First part of approach # 2 of https://github.com/huggingface/datasets-server/issues/1087
Adding a new granularity level - "Partition", will imply to also have a new field in Job and Cache.
Depends on https://github.com/huggingface/datasets-server/pull/1263, https://github.com/huggingface/datasets-server/pull/1259
and https://github.com/huggingface/datasets-server/pull/1260