Skip to content

tinkering projects with vlm embeddings and control vectors

License

Notifications You must be signed in to change notification settings

fblissjr/tinkering-with-vlms

Repository files navigation

tinkering-with-vlms

various tinkering scripts and tools for experimenting with vision‑language models (VLMs), with a focus on providing more control and consistency in llava-based models, primarily looking at control vectors and modifying a model’s weights directions and scales by layer.

License

While the code in here is MIT, it's heavily borrowed from other control vector / abliteration projects.

This license does not apply to xtuner, llava, llama, and hunyuanvideo models, which have their own licenses and terms here:

About

tinkering projects with vlm embeddings and control vectors

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages