Skip to content

[Triton] Add blackwell version of FA #263

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

manman-ren
Copy link
Contributor

No description provided.

Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
@manman-ren manman-ren marked this pull request as ready for review July 3, 2025 17:28
@facebook-github-bot
Copy link
Contributor

@manman-ren has imported this pull request. If you are a Meta employee, you can view this in D77743107.

Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
@manman-ren manman-ren temporarily deployed to docker-s3-upload July 3, 2025 17:31 — with GitHub Actions Inactive
@manman-ren manman-ren temporarily deployed to docker-s3-upload July 3, 2025 17:31 — with GitHub Actions Inactive
@facebook-github-bot
Copy link
Contributor

@manman-ren has imported this pull request. If you are a Meta employee, you can view this in D77743107.

@xuzhao9
Copy link
Contributor

xuzhao9 commented Jul 3, 2025

Since this kernel is blackwell-specific, can we move this from flash_attention to blackwell_attentions?

https://github.com/pytorch-labs/tritonbench/blob/main/tritonbench/operators/blackwell_attentions/operator.py

@xuzhao9
Copy link
Contributor

xuzhao9 commented Jul 3, 2025

cc @y-sq

Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
@facebook-github-bot
Copy link
Contributor

@manman-ren has imported this pull request. If you are a Meta employee, you can view this in D77743107.

Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
@facebook-github-bot
Copy link
Contributor

@manman-ren has imported this pull request. If you are a Meta employee, you can view this in D77743107.

Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
@manman-ren manman-ren temporarily deployed to docker-s3-upload July 3, 2025 21:26 — with GitHub Actions Inactive
@manman-ren manman-ren temporarily deployed to docker-s3-upload July 3, 2025 21:26 — with GitHub Actions Inactive
@facebook-github-bot
Copy link
Contributor

@manman-ren has imported this pull request. If you are a Meta employee, you can view this in D77743107.

Copy link
Contributor

@xuzhao9 xuzhao9 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants