Update programs or data
In this page, you'll learn how to update critical elements of your benchmark like the scoring program or the reference data, while your benchmark is already up and running.
For a general overview of resources management, click here.
If order to update your programs or data, you have two approaches:
- A. Edit an existing Task (simpler and straightforward)
- B. Create a new Task
Let's see both approach in detail.
-
Make local changes to the elements you want to update: scoring program, ingestion program, input data and/or reference data.
-
Zip the new version of your program or data. Make sure to zip the files at the root of the archive, without zipping the folder structure.
- Go to Resources
- Go to "Datasets and Programs" and click on "Add Dataset/Program"
- Fill in the form: Name the new program or dataset, select the type (scoring program, input data, etc.), and select your ZIP file
Still on "Resources" page, go to the "Task" tab. Find the task you want to edit. In order to recognize it, make sure it is marked as "In Use", and click to see more information and make sure it is related to the right benchmark.
Then click on the pencil symbol to edit it:
Start typing the name of your new program or dataset in the corresponding field and select it, then save.
Done! Your task is updated and its new version will be triggered by new submissions. You don't need to update the benchmark/competition for the change to take effect.
First, upload the new versions of your program and/or dataset. To that end, follow steps 1. and 2. presented above.
- Go to "Resources" > "Task" > "Create Task"
- Fill in all fields: Name, Description, Scoring program, (optionally: Ingestion program, Reference data, Input data)
- Once your task is created, go to the editor of your challenge
- Go to "Phases" and edit the relevant phase
- Select your new task and save
Done! Your benchmark is now ready to run your new task for future submissions.