Loading Local Large Language Model in DictTango

Steps to Use Local Large Language Model Files

1. Download the local large language model file and save it to your device.
2. In DictTango, add the AI service and select "Local LLM" as the service provider.
3. Select the local LLM model file
4. Add an AI prompt or directly click "AI Chat" on the home page.

Youtube Instruction

Large Language Model Download Methods

• You can use models from Ollama directly: https://ollama.com/library
• Llama 3.2 1B : https://huggingface.co/bartowski/Llama-3.2-1B-Instruct-GGUF/blob/main/Llama-3.2-1B-Instruct-Q4_0_4_4.gguf
• Llama 3.2 3B : https://huggingface.co/bartowski/Llama-3.2-3B-Instruct-GGUF/blob/main/Llama-3.2-3B-Instruct-Q4_0_4_4.gguf
• QWen Coder: https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B-Instruct-GGUF/tree/main
• Deepseek R1: https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-1.5B-GGUF/tree/main