Loading Local Large Language Model in DictTango

Steps to Use Local Large Language Model Files

1. Download the local large language model file and save it to your device.
2. In DictTango, add the AI service and select "Local Llama" as the service provider.
3. Add an AI prompt or directly click "AI Chat" on the home page.

Large Language Model Download Methods

1. You can use models from Ollama directly: https://ollama.com/library
2. TinyLlama 1.1B (f16, 2.2 GiB): Download here
3. Phi-2 7B (Q4_0, 1.6 GiB): Download here
4. Phi 2 DPO (Q3_K_M, 1.48 GiB): Download here