lower job priority if configs/splits exceed threashold
Fix for https://github.com/huggingface/datasets-server/issues/2048

I set MAX_CONFIGS_THRESHOLD_TO_LOWER_PRIORITY and MAX_SPLITS_THRESHOLD_TO_LOWER_PRIORITY constants = 500 but this could be changed if someone considers a better value.
I thought about the possibility of having these values as env variables but we would have to validate them and I don't think this is something we will be changing frequently.
 
lower job priority if configs/splits exceed threashold: Fix for https://github.com/huggingface/datasets-server/issues/2048

I set MAX_CONFIGS_THRESHOLD_TO_LOWER_PRIORITY and MAX_SPLITS_THRESHOLD_TO_LOWER_PRIORITY constants = 500 but this could be changed if someone considers a better value.
I thought about the possibility of having these values as env variables but we would have to validate them and I don't think this is something we will be changing frequently.
 