Skip to content

feat: Add Forge as LLM provider#18

Open
Yiiii0 wants to merge 1 commit intoOpenGVLab:mainfrom
Yiiii0:feature/forge-20260308-042045
Open

feat: Add Forge as LLM provider#18
Yiiii0 wants to merge 1 commit intoOpenGVLab:mainfrom
Yiiii0:feature/forge-20260308-042045

Conversation

@Yiiii0
Copy link

@Yiiii0 Yiiii0 commented Mar 9, 2026

Summary

Adds Forge API support to ScaleCUA by extending the OpenAI engine classes to auto-detect and route through Forge when FORGE_API_KEY is set. Applied to both evaluation and playground directories.

Changes

  • evaluation/WebArenaLiteV2/core/engine.py: Added _resolve_openai_config() helper for Forge/OpenAI credential resolution
  • evaluation/WebArenaLiteV2/core/mllm.py: Added "forge" to engine type mapping
  • evaluation/WebArenaLiteV2/envs/web/webarena/evaluation/vab_helper_functions.py: Updated OpenAI client initialization with Forge support
  • playground/core/engine.py: Mirrored engine changes from evaluation
  • playground/core/mllm.py: Mirrored mllm changes from evaluation
  • playground/envs/web/ubuntu_web_setup/scripts/util.py: Updated client initialization with Forge support

Usage

# Set environment variable — Forge is used automatically when set
export FORGE_API_KEY="your-forge-api-key"
# export FORGE_API_BASE="https://api.forge.tensorblock.co/v1"  # optional

Test Evidence

All existing tests pass. When FORGE_API_KEY is not set, behavior is identical to upstream.

I work at TensorBlock and will help maintain this integration.


About Forge

Forge is an open-source middleware service for unified AI model provider management. It routes requests across 40+ AI providers with access to thousands of models through a single OpenAI-compatible API.

## Changes

- Automated integration updates from manager loop.

Files modified:
evaluation/WebArenaLiteV2/core/engine.py
evaluation/WebArenaLiteV2/core/mllm.py
evaluation/WebArenaLiteV2/envs/web/webarena/evaluation/vab_helper_functions.py
playground/core/engine.py
playground/core/mllm.py
playground/envs/web/ubuntu_web_setup/scripts/util.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant