Stream convert to parquet
Allow to have datasets partially converted to parquet, like c4, refinedweb, oscar, etc.

Datasets above 5GB are streamed to generate 5GB (uncompressed) of parquet files.

## Implementation details

I implemented a context manager `limite_parquet_writes` that does some monkeypatching  in the `datasets` lib to stop the dataset generation at the right time. This is not the kind of features that would be implemented in the `datasets` library natively, so I'm convinced this is the easiest way to do it. I added a test for this helper to make sure it works as expected and keeps working in the future.

I'm also using the new path scheme `config/split/partial/SSSS.parquet`. I didn't change the scheme for regular parquet conversion though - it can be done later.

close https://github.com/huggingface/datasets-server/issues/1257
Stream convert to parquet: Allow to have datasets partially converted to parquet, like c4, refinedweb, oscar, etc.

Datasets above 5GB are streamed to generate 5GB (uncompressed) of parquet files.

## Implementation details

I implemented a context manager `limite_parquet_writes` that does some monkeypatching  in the `datasets` lib to stop the dataset generation at the right time. This is not the kind of features that would be implemented in the `datasets` library natively, so I'm convinced this is the easiest way to do it. I added a test for this helper to make sure it works as expected and keeps working in the future.

I'm also using the new path scheme `config/split/partial/SSSS.parquet`. I didn't change the scheme for regular parquet conversion though - it can be done later.

close https://github.com/huggingface/datasets-server/issues/1257