Skip to content

Commit

Permalink
add flashattention2 to docker
Browse files Browse the repository at this point in the history
  • Loading branch information
natolambert committed Sep 6, 2024
1 parent 18bcf09 commit 79fa25d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ RUN pip install -e .
RUN chmod +x scripts/*

# this is just very slow
# RUN pip install flash-attn==2.5.0 --no-build-isolation
RUN pip install flash-attn==2.6.3 --no-build-isolation

# for olmo-instruct v1, weird install requirements
# RUN pip install ai2-olmo
Expand Down

0 comments on commit 79fa25d

Please sign in to comment.