Skip to content

Issues: b4rtaz/distributed-llama

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

41 Open 32 Closed
41 Open 32 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

build error in termux
#154 opened Jan 29, 2025 by myan-o
Potential problem with dllama-api sometimes not seeing http request body?
#153 opened Jan 28, 2025 by jkeegan
2
It's slow.
#152 opened Jan 26, 2025 by myan-o
4
Weird bug where malformed API request causes model to analyze error message
#151 opened Jan 22, 2025 by jkeegan
2
Core dumped with ReadSocketException
#149 opened Jan 15, 2025 by kolchanov
8
how to convert gguf in your format?
#148 opened Jan 11, 2025 by lexasub
1
Feature request: models endpoint support in dllama-api
#146 opened Dec 24, 2024 by jkeegan
Work with cline
#145 opened Dec 22, 2024 by piotreq7
Unexpected Ċ, Ġ and D characters with Llama 3.3 Instruct 70b
#142 opened Dec 9, 2024 by lemmi
1
terminate called after throwing an instance of 'ReadSocketException' what(): std::exception Aborted
#140 opened Dec 6, 2024 by bartekmalysz94us
1
[Feature Request] Decouple the Prefill and Decode Stage
#138 opened Nov 17, 2024 by zhengpeirong
Android devices Support
#133 opened Oct 16, 2024 by qtyandhasee
5
Mixtral-8x7B don't work
#132 opened Oct 15, 2024 by MichaelFomenko
1
Model is not supported: llama3_2_3b_instruct_q40
#131 opened Oct 14, 2024 by Znbne
6
Feature Request - Add Sliding Window Memory Scheduling
#128 opened Oct 5, 2024 by githuba9f5404
Segmentation fault
#127 opened Oct 4, 2024 by YueZhan721
6
Tokenizer reported as incompatible tokenizer
#126 opened Sep 29, 2024 by elektroinformaciobiz
Output all are "!"
#121 opened Sep 4, 2024 by HysenX-LI
5
dllama-api & chat ui
#119 opened Aug 19, 2024 by twuerfl
Support for Gemma 2?
#115 opened Aug 4, 2024 by sdmorrey
2
[Feature Suggest] Support for AVX instruction set
#107 opened Jul 28, 2024 by mrlicmi
1
Segmentation Fault
#105 opened Jul 23, 2024 by dot-ammar
11
[Feature request] Kubernetes setup
#101 opened Jul 12, 2024 by kami4ka
dllama: src/commands.cpp:102: MultiHeadAttSlice::MultiHeadAttSlice(unsigned int, unsigned int, unsigned int, slice_index_t): Assertion `nHeads % nSlices == 0' failed.
#98 opened Jul 7, 2024 by EntusiastaIApy
3
[New Feature] Add new route for dllama api for embeding models
#96 opened Jul 1, 2024 by testing0mon21
5
ProTip! What’s not been updated in a month: updated:<2024-12-30.