Search results

Can not download MM-Math and DynaMath and Math-V dataset from the default links

Status: Open.

#1190 In open-compass/VLMEvalKit;

· ShuaiLyu0110 opened on Aug 2, 2025

ImportError: cannot import name 'auto_split_flag' from 'vlmeval.smp'(/root/autodl-tmp/EVAL_BASE_MODELS/VLMEvalKit/vlmeval/smp/__init__.py)

Status: Open.

#1189 In open-compass/VLMEvalKit;

· wonderNefelibata opened on Aug 2, 2025

mvbench bug

Status: Open.

#1186 In open-compass/VLMEvalKit;

· AmazingCreator-lmx opened on Jul 28, 2025

[BUG] dataset parameter not passed when using config.json with MMMUProDataset

Status: Open.

#1185 In open-compass/VLMEvalKit;

· javilonso opened on Jul 28, 2025

OutOfMemory issue with Qwen2.5-VL (3B, 7B)

Status: Open.

#1183 In open-compass/VLMEvalKit;

· LizaLarina opened on Jul 28, 2025

Provide faster evaluation for vlmevalkit

Status: Open.

#1181 In open-compass/VLMEvalKit;

· warmsnow-sh opened on Jul 27, 2025

评测InternVL3-8B报错, AttributeError: 'InternVLModel' object has no attribute 'chat'

Status: Open.

#1174 In open-compass/VLMEvalKit;

· rocket2q19 opened on Jul 22, 2025

Dataset GMAI-MMBench_VAL is not working

Status: Open.

#1173 In open-compass/VLMEvalKit;

· chandrabhuma opened on Jul 21, 2025

Add Pixtral-12B HuggingFace Version

Status: Open.

#1168 In open-compass/VLMEvalKit;

· JVal123 opened on Jul 16, 2025

请问代码对哪些安装包的版本是强依赖的？

Status: Open.

#1159 In open-compass/VLMEvalKit;

· liangbo99 opened on Jul 14, 2025

是否支持部署模型，再通过接入api服务的形式测评？或者是否支持NPU环境测评？

Status: Open.

#1158 In open-compass/VLMEvalKit;

· FWLamb opened on Jul 14, 2025

目前是否支持音频数据集的评测

Status: Open.

#1153 In open-compass/VLMEvalKit;

· casillas1111 opened on Jul 11, 2025