Skip to content

From NVIDIA Megatron-LM for visibility#18

Open
RaymondLi0 wants to merge 6451 commits intobigcode-project:multi-query-attentionfrom
NVIDIA:main
Open

From NVIDIA Megatron-LM for visibility#18
RaymondLi0 wants to merge 6451 commits intobigcode-project:multi-query-attentionfrom
NVIDIA:main

Conversation

@RaymondLi0
Copy link
Collaborator

@RaymondLi0 RaymondLi0 commented Jan 24, 2023

No description provided.

@RaymondLi0 RaymondLi0 changed the base branch from multi-query-attention to before-merge June 20, 2023 20:12
@RaymondLi0 RaymondLi0 changed the base branch from before-merge to multi-query-attention June 20, 2023 20:12
ko3n1g and others added 28 commits February 4, 2026 22:23
@ko3n1g
ci(hotfix): Skopeo copy
e24767f 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
ci(hotfix): Add skopeo
d959620 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@sancha
Reapply "Add MTP support for hybrid models (#2363)" (#3207)
9d71cb1
@Phlip79
Fix uv install for GH actions (#3259)
b043863
@janEbert @yaox12
Update the project structure in README (#3251)
dd7d141 
Co-authored-by: Xin Yao <xiny@nvidia.com>
@github-actions
chore: rotate oncall schedule
1f6d8c2
@BestJuly @rj42
@yaox12 @juntaowww
Cherry-pick: Fix mtp_num_layers and clip_qk issues (#2581, #2776) (#3075
1b11076 
)

Co-authored-by: rj42 <lbkzman@gmail.com>
Co-authored-by: Xin Yao <xiny@nvidia.com>
Co-authored-by: Juntao Wang <juntaow@nvidia.com>
@mathemakitten @ko3n1g
RL: training cudagraphs functional test (#3235)
111a2a0 
Co-authored-by: oliver könig <okoenig@nvidia.com>
@Wohox @Phlip79
[Main] fix cg missing wgrad hook (#3074)
1934391 
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
@nschank @chrisgrimm @yaox12
Avoid .cuda call on meta device in LanguageModel (#3202)
801f12f 
Co-authored-by: Chris Grimm <chris@reflection.ai>
Co-authored-by: Xin Yao <xiny@nvidia.com>
@ChenhanYu
Nano QAT/D fix with sft tokenizer and datasets (#3254)
347ad21
@github-actions
Update copy-pr-bot.yaml [skip ci]
3c0a4f3
@dimapihtar
fix checkpointing error message (#3203)
0434f87 
Signed-off-by: dimapihtar <dpihtar@gmail.com>
@ko3n1g
Revert "fix checkpointing error message (#3203)" (#3283)
8379d43
@ko3n1g
Reapply "fix checkpointing error message (#3203)" (#3283) (#3285)
e2e5a6a
@ko3n1g
docs: Add changelog for 0.15.3 (#3286)
a116ce3 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@chtruong814
ci: Set throughput tests as flaky (#3301)
4376cc5 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@ko3n1g
chore: Move GB200 tests to nightly (#3302)
f92460b 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@nschank @ko3n1g @yashaswikarnati
Ensure type-checker understands use of Submodules in bert_model (#3256)
cfbe9b5 
Co-authored-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Yashaswi Karnati <144376261+yashaswikarnati@users.noreply.github.com>
@nschank @chrisgrimm
@ericharper @yaox12 @chtruong814
Override extra_repr instead of __repr__ (#3200)
a63d045 
Co-authored-by: Chris Grimm <chris@reflection.ai>
Co-authored-by: Eric Harper <eharper@nvidia.com>
Co-authored-by: Xin Yao <xiny@nvidia.com>
Co-authored-by: Charlie Truong <chtruong@nvidia.com>
@nschank @yaox12 @chtruong814
Replace ModuleSpec with Protocols for LayerNorm submodules (#3090)
f68c7c1 
Co-authored-by: Xin Yao <xiny@nvidia.com>
Co-authored-by: Charlie Truong <chtruong@nvidia.com>
@ko3n1g
chore: Remove gpt_grpo_tp2tp1_pp4pp2_dp8_583m_throughputtest
2f99ee8 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@wdykas
Non colocated refit (#3213)
e3ae6e4 
Co-authored-by: root <root@gpu-h100-0348.cm.cluster>
Co-authored-by: root <root@gpu-h100-0193.cm.cluster>
Co-authored-by: root <root@gpu-h100-0082.cm.cluster>
Co-authored-by: root <root@gpu-h100-0495.cm.cluster>
Co-authored-by: William Dykas <wdykas@cw-pdx-cs-001-vscode-02.cm.cluster>
Co-authored-by: root <root@gpu-h100-0213.cm.cluster>
Co-authored-by: root <root@gpu-h100-0435.cm.cluster>
Co-authored-by: root <root@gpu-h100-0188.cm.cluster>
Co-authored-by: root <root@gpu-h100-0032.cm.cluster>
Co-authored-by: root <root@gpu-h100-0023.cm.cluster>
Co-authored-by: root <root@gpu-h100-0368.cm.cluster>
Co-authored-by: root <root@gpu-h100-0203.cm.cluster>
Co-authored-by: root <root@gpu-h100-0229.cm.cluster>
Co-authored-by: root <root@gpu-h100-0123.cm.cluster>
Co-authored-by: root <root@gpu-h100-0217.cm.cluster>
Co-authored-by: root <root@gpu-h100-0496.cm.cluster>
Co-authored-by: root <root@gpu-h100-0261.cm.cluster>
@xiaoxi-wangfj @yaox12
Fuse permute+pad and unpermute+unpad ops for FP8/FP4 training (#2763)
554ce49 
Signed-off-by: xiaoxi-wangfj <690912414@qq.com>
Co-authored-by: Xin Yao <xiny@nvidia.com>
@shjwudp @yaox12
Add check to prevent MFSDP from numeric issue in gradient accumulate …
7cbbba2 
…fusion (#2904)

Co-authored-by: Xin Yao <xiny@nvidia.com>
@c1lovez1 @yaox12
update get_embedding_ranks and get_position_embedding_ranks docstrings (
c99c962 
#3223)

Co-authored-by: Xin Yao <xiny@nvidia.com>
@chtruong814
ci: Add secrets detector (#3180)
6d81e3d 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@skydoorkai @BestJuly
@ericharper @Phlip79
Param offset in _ParamAndGradBucket should be aligned (#3007)
a3ec4b0 
Signed-off-by: skydoorkai <htsantaclara@163.com>
Co-authored-by: lit <lit@nvidia.com>
Co-authored-by: Eric Harper <eharper@nvidia.com>
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
YangWang92 and others added 30 commits March 4, 2026 13:26
@YangWang92 @yaox12 @asolergi-nv
remove duplicate rerun_state_machine.set_mode(rerun_mode) (#3279)
4fa9b5a 
Co-authored-by: Xin Yao <xiny@nvidia.com>
Co-authored-by: Antoni-Joan Solergibert <asolergibert@nvidia.com>
@jeromeku @asolergi-nv
Correct indexing when cp_comms_type is a list (#3389)
d3a8584 
Co-authored-by: Antoni-Joan Solergibert <asolergibert@nvidia.com>
@tdene
Fix optional chat_completions returnables (#3519)
bfd160b
@ko3n1g
ci: Claude code review (#3704)
f84e84e 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
ci: Fix event payload (#3705)
bd1406f 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
ci: Use issue number (#3706)
33476ff 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
ci: Finalize Claude review (#3707)
fd21af4 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@thomasdhc
ci: Add codecov yml (#3455)
b1b4df6 
Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
@tdene @sidsingh-nvidia
Robust signaling for coordinator inference (#3563)
7ea354b 
Co-authored-by: Siddharth Singh <sidsingh@nvidia.com>
@WanZzzzzz @ko3n1g @kunlunl
Fix memory issue in mxfp8 model init (#3461)
f91c4bb 
Signed-off-by: qiyuw <qiyuw@nvidia.com>
Co-authored-by: qiyuw <qiyuw@nvidia.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Kunlun Li <94586211+kunlunl@users.noreply.github.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
c5d8f6b
@megnvidia
adding public_docs_features: True to get proper legal footer… (#3681)
fa6063d 
Signed-off-by: meg miranda <mmiranda@nvidia.com>
@mchrzanowski @claude @deepakn94
add --overlap-param-gather support for layer-wise optimizer. lots of …
a2381d8 
…unit tests. (#3524)

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Deepak Narayanan <dnarayanan@nvidia.com>
@ko3n1g
ci: Mount and enforce HF_HOME (#3700)
657d33b 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@santhnm2
Add flags for changing Mamba inference state tensor dtype (#3660)
da47e64 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@ko3n1g
chore: CLI launch internal CI (#3695)
94a903b 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@Phlip79
Change Review Process (#3659)
485428f
@ko3n1g
ci: Separate queues for internal/external contributors (#3718)
d1cce0c 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@Phlip79
Update to correct token (#3724)
6bd5c12
@ko3n1g
build: Bump to NGC PyTorch 26.02 (#3474)
f5b2ec0 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@Phlip79
Claude: use Opus 4.6 and auto-review on ready (#3727)
bb84493
@Phlip79
Claude to add complexity label (#3709)
41daf81
@santhnm2
Offload Flask frontend to separate process (#3648)
0d42bc6 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@hxbai
fix(moe): fix TE general_gemm API change (#3582)
d3528a2
@Phlip79
Review process fixes (#3728)
43df309
@ko3n1g
ci: Update golden values after PyT bump (#3733)
bde8264 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
chore: Use PAT for CLI Launcher (#3734)
a979332 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@rj42 @Phlip79
Print more verbose error message about incorrect `model_parallel_size…
bb451db 
…`. (#2639)

Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
@ko3n1g
ci: Add missing gitlab rule (#3735)
de63aa8 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@tomlifu
[main] Add TE CUDA Graph Support for Vision Encoder (#3293)
37ca715 
Signed-off-by: Lifu Zhang <lifuz@login-lyris01.lyris.clusters.nvidia.com>
Signed-off-by: Lifu Zhang <lifuz@login-lyris02.lyris.clusters.nvidia.com>
Co-authored-by: Lifu Zhang <lifuz@login-lyris01.lyris.clusters.nvidia.com>
Co-authored-by: Lifu Zhang <lifuz@login-lyris02.lyris.clusters.nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.