We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 63ebf2e commit d769533Copy full SHA for d769533
README.md
@@ -43,13 +43,13 @@ Compute Platform version).
43
44
## How to
45
46
-Install dependencies, clone repo and run benchmark:
47
-
48
- pip install -r requirements.txt
+Clone repo, install dependencies, and run benchmark:
49
50
git clone https://github.com/turboderp/exllama
51
cd exllama
52
+ pip install -r requirements.txt
+
53
python test_benchmark_inference.py -d <path_to_model_files> -p -ppl
54
55
The CUDA extension is loaded at runtime so there's no need to install it separately. It will be compiled on the first
0 commit comments