Spawning full scan
Closes https://github.com/huggingface/datasets-server/issues/1087
Included changes:
- Separate worker definition in chart for prod and dev in a dedicated one for spawning with max long running time set to 10 hrs
- Removing max rows scanning limitation
- Store in assets a csv file with list of opted in/out urls (Headers: url, column, row_idx, opt_in, opt_out) 

Spawning full scan: Closes https://github.com/huggingface/datasets-server/issues/1087
Included changes:
- Separate worker definition in chart for prod and dev in a dedicated one for spawning with max long running time set to 10 hrs
- Removing max rows scanning limitation
- Store in assets a csv file with list of opted in/out urls (Headers: url, column, row_idx, opt_in, opt_out) 
