Search results

KV Replication for context parallel (Ring attention)

module: context parallel

questionFurther information is requestedFurther information is requested

Status: Open.

#1283 In pytorch/torchtitan;

· rghadia opened on Jun 11, 2025

[cp][flex_attention] integration test trial

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

module: context parallel

Status: Draft (not ready).

pytorch/torchtitannumber 1160

#1160 In pytorch/torchtitan;

· XilunWu opened on May 1, 2025

Context parallel on Turing GPUs?

module: context parallel

questionFurther information is requestedFurther information is requested

Status: Open.

#1034 In pytorch/torchtitan;

· dingqingy opened on Mar 31, 2025

[question]can't disable CP for specific (unsupported) SDPA op

enhancementNew feature or requestNew feature or request

module: context parallel

Status: Open.

#757 In pytorch/torchtitan;

· FindDefinition opened on Dec 20, 2024

Context parallelism understanding

module: context parallel

questionFurther information is requestedFurther information is requested

Status: Open.

#723 In pytorch/torchtitan;

· jinsong-mao opened on Dec 9, 2024