Skip to content

GaoXiangYa/KernelPractice

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

94 Commits
src
src
 
 
.clang-format
.clang-format
 
 
.clangd
.clangd
 
 
.gitignore
.gitignore
 
 
CMakeLists.txt
CMakeLists.txt
 
 
README.md
README.md
 
 

Repository files navigation

KernelPractice

Practice how to write high performance kernels

CUDA

  • FlashAttention
  • LayerNorm
  • RMSNorm
  • Split
  • Cat
  • Gemm
  • Gemv
  • SoftMax
  • Gelu
  • Silu
  • Swiglu
  • Add
  • Mul
  • Permute
  • LlamaRotatePosition2D
  • Reduce

CPU

  • FlashAttention
  • LayerNorm
  • RMSNorm
  • Split
  • Cat
  • Gemm
  • Gemv
  • SoftMax
  • Gelu
  • Silu
  • Swiglu
  • Add
  • Mul
  • Permute
  • LlamaRotatePosition2D
  • Reduce

OPENCL

  • FlashAttention
  • LayerNorm
  • RMSNorm
  • Split
  • Cat
  • Gemm
  • Gemv
  • SoftMax
  • Gelu
  • Silu
  • Swiglu
  • Add
  • Mul
  • Permute
  • LlamaRotatePosition2D
  • Reduce

About

Practice how to write high performance kernels

Resources

Readme
Activity

Stars

3 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

 
 
 

Contributors

Languages