Add partial cache entries for fan-in jobs
Following discussion in https://github.com/huggingface/datasets-server/pull/900

I don't have a strong opinion on the name of the key we should store between "partial", "completeness" or others.
Therefore feel free to recommend another name or value type if you have better ideas.

I just like "partial" better because by default a job is not partial, so we just need to specify it when needed.
EDIT: actually switched yo 'progress' - a value between 0. and 1. (with 1. = complete)
Add partial cache entries for fan-in jobs: Following discussion in https://github.com/huggingface/datasets-server/pull/900

I don't have a strong opinion on the name of the key we should store between "partial", "completeness" or others.
Therefore feel free to recommend another name or value type if you have better ideas.

I just like "partial" better because by default a job is not partial, so we just need to specify it when needed.
EDIT: actually switched yo 'progress' - a value between 0. and 1. (with 1. = complete)