Skip to content

[llama4][auxiliary-loss-free load balancing] update expert_bias without backward hooks#1304

Open
hann-wang wants to merge 2 commits intopytorch:mainfrom
hann-wang:han/pr_llama4_no_aux_balancing
Open

[llama4][auxiliary-loss-free load balancing] update expert_bias without backward hooks#1304
hann-wang wants to merge 2 commits intopytorch:mainfrom
hann-wang:han/pr_llama4_no_aux_balancing

Commits

Commits on Jun 16, 2025