Run the backfill script in parallel?
The backfilll script is very slow (one dataset at a time) and also it breaks due to OOM (https://cd.internal.huggingface.tech/applications/argo-cd/datasets-server-prod?view=pods&node=%2FPod%2Fdatasets-server%2Fprod-datasets-server-job-backfill-28412480-2n9ps%2F0)

Maybe we could run the loop iterations in parallel, and also allocate more memory to the pod
Run the backfill script in parallel?: The backfilll script is very slow (one dataset at a time) and also it breaks due to OOM (https://cd.internal.huggingface.tech/applications/argo-cd/datasets-server-prod?view=pods&node=%2FPod%2Fdatasets-server%2Fprod-datasets-server-job-backfill-28412480-2n9ps%2F0)

Maybe we could run the loop iterations in parallel, and also allocate more memory to the pod