Remove /parquet-and-dataset-info job runner
Last step for https://github.com/huggingface/datasets-server/issues/735 and https://github.com/huggingface/datasets-server/issues/866

Now when we have config-level job runner `config-parquet-and-info`, we can drop dataset-level job runner as we don't need aggregation here.

TODO: 

- [x] migrations (remove from cache and job databases)
Remove /parquet-and-dataset-info job runner: Last step for https://github.com/huggingface/datasets-server/issues/735 and https://github.com/huggingface/datasets-server/issues/866

Now when we have config-level job runner `config-parquet-and-info`, we can drop dataset-level job runner as we don't need aggregation here.

TODO: 

- [x] migrations (remove from cache and job databases)