Limit the number of fields (columns) in /croissant
https://huggingface.co/datasets/mstz/arcene has 10K columns, and thus the /croissant response is 3.7MB (120K lines when the JSON is prettified).

We already limit the number of supported columns to 1K: https://github.com/huggingface/datasets-server/blob/main/chart/values.yaml#L204

We could apply the same limit, and mention it in the description of the recordset.

From Slack (internal): https://huggingface.slack.com/archives/C04L6P8KNQ5/p1705224717632239 
Limit the number of fields (columns) in /croissant: https://huggingface.co/datasets/mstz/arcene has 10K columns, and thus the /croissant response is 3.7MB (120K lines when the JSON is prettified).

We already limit the number of supported columns to 1K: https://github.com/huggingface/datasets-server/blob/main/chart/values.yaml#L204

We could apply the same limit, and mention it in the description of the recordset.

From Slack (internal): https://huggingface.slack.com/archives/C04L6P8KNQ5/p1705224717632239 