Update readme

ROCm · Jan 24, 2025 · d224ae8 · d224ae8
1 parent b97089e
commit d224ae8
Show file tree

Hide file tree

Showing 2 changed files with 6 additions and 6 deletions.
diff --git a/README.md b/README.md
@@ -137,16 +137,16 @@ These features are supported in Fwd and Bwd
 2) Variable sequence lengths
 3) Arbitrary Q and KV sequence lengths
 4) Arbitrary head sizes
+5) Multi and grouped query attention
+6) Dropout
+7) Rotary embeddings
 
 These features are supported in Fwd for now. We will add them to backward soon.
-1) Multi and grouped query attention
 2) ALiBi and matrix bias
 
 These features are in development
 1) Paged Attention 
 2) Sliding Window
-3) Rotary embeddings
-4) Dropout
 5) Performance Improvements
 
 #### Getting Started

diff --git a/flash_attn/flash_attn_triton_amd/README.md b/flash_attn/flash_attn_triton_amd/README.md
@@ -11,16 +11,16 @@ These features are supported in Fwd and Bwd
 2) Variable sequence lengths
 3) Arbitrary Q and KV sequence lengths
 4) Arbitrary head sizes
+5) Multi and grouped query attention
+6) Dropout
+7) Rotary embeddings
 
 These features are supported in Fwd for now. We will add them to backward soon.
-1) Multi and grouped query attention
 2) ALiBi and matrix bias
 
 These features are in development
 1) Paged Attention 
 2) Sliding Window
-3) Rotary embeddings
-4) Dropout
 5) Performance Improvements
 
 #### Getting Started