v2.7.2

Changes:

• Increase Multiple Choice task rate from 0.05 to 0.2.
• Add a signature to wandb runs to verify their authenticity.

v2.7.1

Changes

• Add multi-GPU support.

v2.7.0

Changes

• New multi-choice benchmarking task;
• Refactor changes (.env config-based, decoupled parts of the code);
• Poetry setup;
• Only 5 tasks are included: QA, DateQA, Summary, MultiChoice, Organic.

v2.6.2

What's Changed

Check for reference data for summarization before generating the challenge.

Full Changelog: v2.6.0...v2.6.2

v2.6.0

What's Changed

• Organic Scoring by @dbobrenko in #309

Full Changelog: v2.5.1...v2.6.0

v2.5.1

What's Changed

• Reduce timeout to 15 seconds by @bkb2135 in #277
• feat: Add PM2 installation commands to install.sh for streamlined setup by @minopeef in #270
• update logging to use python rather than loguru by @minopeef in #274

New Contributors

• @minopeef made their first contribution in #270

Full Changelog: v.2.5.0...v2.5.1

v2.5.0

What's Changed

• Prevent multi-turn followups on translation and sentiment by @bkb2135 in #262
• Improve the prompt quality for multi-turn conversation by @bkb2135 in #266
• Hotfix/autorun readme by @p-ferreira in #259
• Features/bittensor upgrade by @p-ferreira in #261
• Improve mining template by @p-ferreira in #256
• Update README.md for miners by @bkb2135 in #272
• Hotfix/reduce miner resync by @bkb2135 in #271

Full Changelog: v2.4.2...v.2.5.0

v2.4.2

What's Changed

• Hotfix/increase timeout by @bkb2135 in #257

Full Changelog: v2.4.1...v2.4.2

v2.4.1

What's Changed

• Hotfix - latest bittensor version integration issues by @p-ferreira and @bkb2135 #254

Full Changelog: v2.4.0...v2.4.1

v2.4.0

What's Changed

• Remerge main into pre-staging by @bkb2135 in #225
• Minor vllm optimization, code style fixes by @dbobrenko in #236
• Update miner requirements, increase storage by @dbobrenko in #237
• Merge main into pre-staging by @bkb2135 in #247
• Fix repeated tasks on CUDA OOM by @dbobrenko in #243
• Fix Llama3 miner 4bit flag, update requirements, etc by @dbobrenko in #235
• Features/discourage base miners by @bkb2135 in #244
• Bittensor 7.0.0, vllm 0.4.2 upgrade by @dbobrenko in #246
• Update forward.py by @steffencruz in #251
• Increase miner sampling for each step by @bkb2135 in #249
• Features/streaming penalty by @p-ferreira in #234

Full Changelog: v2.3.1...v2.4.0