Getting started with Codabench

Codabench is an upgraded version of the CodaLab Competitions plaform, allowing you to create either competitions or benchmarks. A benchmark is essentially an ever-lasting competition with multiple tasks, for which a participant can make multiple entries in the result table.

This getting started tutorial shows a simple example of how to create a competition. Advanced users should check fancier examples and the full documentation.

1. GET READY

   • Create a Codabench account (if not done yet)
   • Download the sample competition and the sample submission.
   • Do not unzip them.

2. CREATE A COMPETITION

   • From the front page of Codabench, in the top menu, go to the Benchmark > Management
   • Click the green Upload button at the top right.
   • Upload the (zipped) sample competition bundle => this will create your competition. It should look like THIS.

3. MAKE CHANGES

   • Click on the Edit gray button at the top the enter the editor.
   • Make small changes:
     • change the logo in the Details tab to another png of jpg file.
     • change the end date in the Phases tab: if the competition is terminated, you will not be able to make submissions.
   • Save your changes and verify that they have become effective.

4. MAKE A SUBMISSION

   • In your competition page, go to the tab My submissions
   • Submit the (zipped) sample submission bundle you downloaded.
   • When your submission finishes, go to the Result tab to check it shows up on the leaderboard.
     • Warning: in some competitions, submissions successfully processed do not automatically get pushed to the leaderboard,

5. PUBLISH YOUR COMPETITION - If you want to make your competition visible to all, you must publish it by checking the Publish box at the very bottom of the editor Details page. - If you publish your competition, it should now be visible when you are not logged in, at the URL of your competition page.

You are done with this simple tutorial. Next, check the more advanced tutorial.