Limit CPU usage on the default queue

Limit duration of submissions

• We should add an option in the .env file specifying a maximum execution time limit for jobs in the default queue (main queue of the platform). #1154

This way, the main queue could not get blocked by long jobs running in parallel. This would incentivize organizers to use their own queue if they want to make more ambitious benchmarks.

Limit submissions

• We need a cool down (e.g. 5 seconds) before being able to re-submit. This way we prevent submissions spamming. #1154

Feature suggestion moved from CodaLab to Codabench (https://github.com/codalab/codalab-competitions/issues/2949)

Limit parallel jobs

• New competition setting: number of parallel submissions allowed per participant.

This can be useful for a fair sharing of the resources within a competition.

• No limitation by default
• Minimal value: 1