Skip to content

Commit 0558dea

Browse files
committed
ExLlamaV2 announcement
1 parent 8a1d330 commit 0558dea

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

README.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -197,4 +197,7 @@ filenames. `model_init()` will detect multiple .safetensors files if given a mod
197197
various examples: `model_path = glob.glob(st_pattern)[0]` becomes simply `model_path = glob.glob(st_pattern)`. Also
198198
there's a little script in `util/shard.py` to split large .safetensors files. It also produces an index.json file for
199199
the sharded model, just for completeness, although ExLlama doesn't need it to read the shards. Note that the
200-
**safetensors dependency was bumped to version 0.3.2**.
200+
**safetensors dependency was bumped to version 0.3.2**.
201+
202+
**2023-08-12**: Preliminary, initial and tentative release of [ExLlamaV2](https://github.com/turboderp/exllamav2).
203+
It doesn't do all the things that ExLlamaV1 does, yet, but it's better at what it does do. So check it out!

0 commit comments

Comments
 (0)