Home

Welcome to the Chalab wiki!

Chalab is a tool, which helps you design data science or machine learning challenges. A step-by-step Wizard guides you through the process. When you are done, you can compile your challenge as a self-contained zip file (competition bundle) and upload it to a challenge platform. Currently, only Codalab accepts competition bundles created by Chalab.

Mini challenge tutorial

Your point of entry into Chalab is the Wizard Home Page, which allows you to select a challenge to edit or create a new challenge. You are then led to the Wizard page allowing you to Design a challenge, one step at a time! Conveniently, you may use as template challenges previously created by others (i.e. there is a lot of information already filled in that provides you with further guidance). To understand how to select or create a template, see the Profile and the Group pages.

The Chalab challenge design includes 6 steps:

Data:

You may pick a dataset

• Edit your dataset

Split:

Metric:

Protocol:

Baseline:

Documentation:

Data science challenges designed with Chalab propose supervised learning tasks of CLASSIFICATION or REGRESSION.

Documentation contents:

Data: