Reduce the number of redundant calls to the Hub in job runners
We could save a lot of requests to the Hub (done through huggingface_hub) by memoïzing the results (or using a client that resp.

See an extract of the logs for /first-rows on glue:

```
DEBUG: 2023-03-21 10:49:34,444 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:36,261 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:49:36,263 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:38,080 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:38,083 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:39,903 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:39,906 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:41,716 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:41,771 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:43,599 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:49:43,602 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:45,417 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:45,420 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:47,237 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:47,240 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:49,049 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:49,104 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:50,932 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:49:50,934 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:52,750 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:52,754 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:54,585 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:54,588 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:56,401 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:56,456 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:58,285 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:49:58,287 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:00,109 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:00,112 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:01,932 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:01,935 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:03,744 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:03,800 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:05,620 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:50:05,623 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:07,440 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:07,443 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:09,259 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:09,262 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:11,079 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:11,134 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:12,957 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:50:12,960 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:14,783 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:14,786 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:16,607 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:16,611 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:18,436 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:18,491 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:20,314 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:50:20,316 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:22,123 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:22,126 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:23,941 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:23,945 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:25,770 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:25,825 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:27,640 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:50:27,642 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
```

It makes no sense to fetch the same resources again and again.
Reduce the number of redundant calls to the Hub in job runners: We could save a lot of requests to the Hub (done through huggingface_hub) by memoïzing the results (or using a client that resp.

See an extract of the logs for /first-rows on glue:

```
DEBUG: 2023-03-21 10:49:34,444 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:36,261 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:49:36,263 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:38,080 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:38,083 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:39,903 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:39,906 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:41,716 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:41,771 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:43,599 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:49:43,602 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:45,417 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:45,420 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:47,237 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:47,240 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:49,049 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:49,104 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:50,932 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:49:50,934 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:52,750 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:52,754 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:54,585 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:54,588 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:56,401 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:49:56,456 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:49:58,285 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:49:58,287 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:00,109 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:00,112 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:01,932 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:01,935 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:03,744 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:03,800 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:05,620 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:50:05,623 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:07,440 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:07,443 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:09,259 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:09,262 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:11,079 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:11,134 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:12,957 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:50:12,960 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:14,783 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:14,786 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:16,607 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:16,611 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:18,436 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:18,491 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:20,314 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:50:20,316 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:22,123 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/glue.py HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:22,126 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:23,941 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/dataset_infos.json HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:23,945 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:25,770 - urllib3.connectionpool - https://huggingface.co:443 "HEAD /datasets/severo/glue/resolve/main/README.md HTTP/1.1" 200 0
DEBUG: 2023-03-21 10:50:25,825 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
DEBUG: 2023-03-21 10:50:27,640 - urllib3.connectionpool - https://huggingface.co:443 "GET /api/datasets/severo/glue HTTP/1.1" 200 4444
DEBUG: 2023-03-21 10:50:27,642 - urllib3.connectionpool - Starting new HTTPS connection (1): huggingface.co:443
```

It makes no sense to fetch the same resources again and again.