Set s3fs max_paths
Maybe can help to save some RAM in API workers (https://github.com/huggingface/dataset-viewer/issues/2395)

The S3FileSystem DirCache can grow indefinitely. It is used to store assets and cached assets (image/audio) for the viewer.
Set s3fs max_paths: Maybe can help to save some RAM in API workers (https://github.com/huggingface/dataset-viewer/issues/2395)

The S3FileSystem DirCache can grow indefinitely. It is used to store assets and cached assets (image/audio) for the viewer.