Delete finished jobs immediately?
Currently, finished jobs are deleted after 7 days by an index. See https://github.com/huggingface/datasets-server/blob/259fd092c12d240d9b8d733c965c4b9362e90684/libs/libcommon/src/libcommon/queue.py#L144

But we never use the finished jobs, so:
- we could delete them immediately after finishing
- we could reduce the duration from 7 days to 1 hour (can be complementary to the previous action, to clean uncaught jobs)

For point 2, see https://github.com/huggingface/datasets-server/pull/1103

Stats:
- 9.805.591 jobs
- 13.345 are not finished! (0.1% of the jobs)
Delete finished jobs immediately?: Currently, finished jobs are deleted after 7 days by an index. See https://github.com/huggingface/datasets-server/blob/259fd092c12d240d9b8d733c965c4b9362e90684/libs/libcommon/src/libcommon/queue.py#L144

But we never use the finished jobs, so:
- we could delete them immediately after finishing
- we could reduce the duration from 7 days to 1 hour (can be complementary to the previous action, to clean uncaught jobs)

For point 2, see https://github.com/huggingface/datasets-server/pull/1103

Stats:
- 9.805.591 jobs
- 13.345 are not finished! (0.1% of the jobs)