File tree Expand file tree Collapse file tree 1 file changed +14
-1
lines changed
Expand file tree Collapse file tree 1 file changed +14
-1
lines changed Original file line number Diff line number Diff line change 11# llama-cpp-python cuBLAS wheels
22Wheels for llama-cpp-python compiled with cuBLAS support.
33
4+ Currently, only includes 0.1.62 and 0.1.66.
5+
46Requirements:
57- Windows and Linux x86_64
68- CUDA 11.6 - 12.1
79- CPython 3.7 - 3.11
810
9- -install instructions placeholder-
11+ Installation instructions:
12+ ---
13+ To install, you can use this command:
14+ ```
15+ python -m pip install llama-cpp-python==0.1.66+cu117 --find-links=https://jllllll.github.io/llama-cpp-python-cuBLAS-wheels/cu117
16+ ```
17+ This will install llama-cpp-python 0.1.66 for CUDA 11.7. You can change both instances of ` cu117 ` to change the CUDA version.
1018
19+ An example for installing 0.1.62 for CUDA 12.1:
20+ ```
21+ python -m pip install llama-cpp-python==0.1.62+cu121 --find-links=https://jllllll.github.io/llama-cpp-python-cuBLAS-wheels/cu121
22+ ```
23+ ---
1124### All wheels are compiled using GitHub Actions
You can’t perform that action at this time.
0 commit comments