v0.5.1

What's new in 0.5.1 (2023-09-26)

These are the changes in inference v0.5.1.

Enhancements

• ENH: Safe iterate stream of ggml model by @codingl2k1 in #449
• ENH: Skip download if model exists by @aresnow1 in #495

Documentation

• DOC: vLLM by @UranusSeven in #491

Full Changelog: v0.5.0...v0.5.1