System Prompt Library

[Rossi1337]

I use different models for different purpose. I realized that I would like to be able to switch quickly the "system prompt" for a model.
For example use one prompt for "Java Programming" and another one for "Flutter Programming", one for casual chatting and one to solve reasoning problems. With that you could give your models different personalities and switch between them.

My implementation idea is the following.
Add a feature to create a prompt library. Each of them should have a unique name and the "prompt text".
We could add a new page "Prompts" to manage these (create, edit, delete).
In the chat window next to the model selection we would then allow to select from a drop down list the "prompt" to use.
If none are in the library or nothing is selected we use the "default prompt" or if overriden the "model specific default prompt".

[WilliamKarolDiCioccio]

I agree with you. I was about to open a new discussion to understand which path to take. As you know docs search is a feature the app will provide. I was thinking of a "Vault" section to upload images, documents (pdf, plain text, code...) and eventually prompt templates. Those assets would be categorized and used for RAG or to provide general customization. Let me know what you think of my idea. Anyways I think it would be wise to delay that a bit, the app still needs some architectural refinements to make it more flexible and performant (rework providers according to a cleaner strategy and make some widgets like ChatMessage more readable). After that we can go on to the next development phase adding web (already done some research) and docs search

[Rossi1337]

For documents I would see it like this.
You drag a document into your chat and it is indexed on the fly into a "in memory" or embedded vector database. Then it will be available in your current chat session (via RAG).
If you start a new session all images and additional documents should be removed and the vectory store should be cleared.
I do not want to index all my local files or documents or something like that. I would do this on the fly for documents I want to work with. Not sure how fast this is.

[WilliamKarolDiCioccio]

@Rossi1337 I completed the exams with pretty good results 😎. I'll be back working on the app by tomorrow