Replace /auth-check with GET /api/dataset/[dataset-name]
See https://github.com/huggingface/moon-landing/pull/3623#issuecomment-1205761679

Maybe HEAD requests will be allowed too, which would avoid downloading a payload we will not use.
Replace /auth-check with GET /api/dataset/[dataset-name]: See https://github.com/huggingface/moon-landing/pull/3623#issuecomment-1205761679

Maybe HEAD requests will be allowed too, which would avoid downloading a payload we will not use.