`/parquet-and-dataset-info` is processing datasets bigger than 5GB
e.g. right now it's processing https://huggingface.co/datasets/madrylab/imagenet-star/tree/main

![image](https://user-images.githubusercontent.com/42851186/223496629-750acc52-0f05-4fcf-b466-9cf89083a674.png)

Though I checked and `PARQUET_AND_DATASET_INFO_MAX_DATASET_SIZE` is defined by 
```
parquetAndDatasetInfo:
  maxDatasetSize: "5_000_000_000"
```
`/parquet-and-dataset-info` is processing datasets bigger than 5GB: e.g. right now it's processing https://huggingface.co/datasets/madrylab/imagenet-star/tree/main

![image](https://user-images.githubusercontent.com/42851186/223496629-750acc52-0f05-4fcf-b466-9cf89083a674.png)

Though I checked and `PARQUET_AND_DATASET_INFO_MAX_DATASET_SIZE` is defined by 
```
parquetAndDatasetInfo:
  maxDatasetSize: "5_000_000_000"
```