* Update qwen2.py

* Update mllama.py

fix the bug for reading dict

* Update qwen2_vl.py

fix the bug for reading dict

* fix qwen2_5_vl.py readdict error

---------

Co-authored-by: zxy <[email protected]>

* docs: update ascend docs for docker running

* ci: fix mdformat linting

* fix get_ppl

* remove useless code

* remove debug logs

* Add gemma3 text model

* Add gemma vl

* update doc

* add tp

* fix doc

* readmes

* bump version to v0.7.2

* bump version to v0.7.2

* remote print

* fix activation grid oversize

* optimize

* fix quant fp8

…ble with empty text (InternLM#3283)

* add spaces between special token to interactive endpoint

* empty input

* add env var to control timeout

* update

* update

* fix lint

* refactor attn param

* fix lint

* fix build

* fix ut

* use creator to create rope_param

* reuse parse func

* fix ut

* fix comments

* update name

* fix dynamic

* fix deepseekv2 yarn

* use single dataclass

* fix loading workspace model

* better dist context

* can not exit

* multinode support

* better exception

* refactor

* fix local rank

* replace group

* fix dist

* remove useless code

* remove finish flag

* refactor engine and model agent

* uni executor

* wip

* tp

* fix

* less async

* circle buf

* event per block

* fast mp

* fix error handler

* remove safe wait

* context in model agent

* fix on stop

* check before init

* fix tp close

* ray ver0

* fix close

* fix remote code

* optimize ray

* better checker and logger

* pack tensor

* auto check dist

* fix mp gloo

* add timer tools

* better scheduler

* fix mp hang

* fix mp

* fix chat

* less output

* merge main

* optimize ray get output

* remove nsight runtime env

* dag

* optimize mp & lint

* optimize mp

* add base workerwrapper

* fix gather, update flags

* better return mask

* add choice

* enable mp,ray with worldsize=1

* fix mp exit

* fix mp vlm

* chat exit

* add docs

* lint

* doc

* dp check

* fix blocked fp8 moe

* remove mask

* support dp, async

* remove debug line

* fix model tp

* support sync execute

* fix chat stopwords

* refactor chat

* add warmup

* disable warmup

* dp support

* fix ut, merge main, force eager

* support qwen2/internlm2/internlm3

* support blocked fp8 all gather

* add more model support

* fix exit

* fix merge

* fix sync long context

* support process group on ray

* change dp master addr and master port

* update log level

* support moe tp

* fix tp1 dp2

* fix

* fix

* wait handle

* remove flag

* ensure execute order

* remove import

* add serve args

* force eager

* add deep gemm with tma pre allocated

* add comment

* add comment

* dispatch

* no use_deep_gemm arg

* remove DeepGemmBlockedF8

* missed op type

* latest get_best_config

* add a line of debug

* update

* update

* update

* update timeout

* update

* update

* update

* update

* updaste

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

---------

Co-authored-by: zhulinJulia24 <[email protected]>

* comm abstraction

* add custom

* fused rms norm

* refactor

* push-based kernel

* optimize for small hidden dims

* integration

* clean up

* export options & fix things

* allgather2d & VMM allocation

* optimize allgather2d

* remove obsolete comm utils

* handle non-multi-gpu build

* fix lint

* fix lint

* avoid using mscclpp repo (some deps are not needed)

* fix lint

* fix nccl version & clean up deps

* fix lint

* custom -> native

* rename

* fix p-lora

* fix lm head

* log fatal exception explicitly

* initial data parallel support

* sync dp + tp

* mixed `d*t0 | t1`

* refactor

* refactor

* fix ut

* refactor

* asymmetrical allreduce

* fix

* fix nccl<2.18

* fix

* fix

* fix

* fix

* fix converter

* fix converter

* fix tp for converted model

* fix tp for converted model

* assert tp size loading from workspace