Skip to content

Commit

Permalink
Deploy preview for PR 665 🛫
Browse files Browse the repository at this point in the history
  • Loading branch information
JonasHelming committed Nov 29, 2024
1 parent 2f79060 commit ad466f1
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 3 deletions.
2 changes: 1 addition & 1 deletion pr-previews/pr-665/docs/theia_ai/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -318,7 +318,7 @@ <h2 id="custom-llm-provider" style="position:relative;"><a href="#custom-llm-pro
<p>Please learn about the supported LLM providers at the example of the <a href="user_ai">Theia IDE</a>, which allows end users to configure the used LLM per agent. Of course, as a tool provider you can choose whether you provide this configurability to end users.</p>
<p>As a tool provider, you can also easily add support for other LLM APIs too. Please consider contributing any further LLM providers to the open source project, so that the community can benefit from increased compatibility and share the maintenance cost.</p>
<p>To support a specific LLM, you basically need to provide an implementation of the interface ‘LanguageModel’, which provides an abstraction between agents and the underlying LLM. This Language Model is then registered at the ‘LanguageModelRegistry’, to make it retrievable for agents, e.g. like this:</p>
<div class="gatsby-highlight" data-language="typescript"><pre class="language-typescript"><code class="language-typescript"><span class="token keyword">this</span><span class="token punctuation">.</span>languageModelRegistry<span class="token punctuation">.</span><span class="token function">addLanguageModels</span><span class="token punctuation">(</span><span class="token punctuation">[</span><span class="token keyword">new</span> <span class="token class-name">OllamaModel</span><span class="token punctuation">(</span><span class="token punctuation">)</span><span class="token punctuation">)</span><span class="token punctuation">;</span></code></pre></div>
<div class="gatsby-highlight" data-language="typescript"><pre class="language-typescript"><code class="language-typescript"><span class="token keyword">this</span><span class="token punctuation">.</span>languageModelRegistry<span class="token punctuation">.</span><span class="token function">addLanguageModels</span><span class="token punctuation">(</span><span class="token punctuation">[</span><span class="token keyword">new</span> <span class="token class-name">OllamaModel</span><span class="token punctuation">(</span><span class="token punctuation">)</span><span class="token punctuation">]</span><span class="token punctuation">)</span><span class="token punctuation">;</span></code></pre></div>
<p>If you want to allow the user to configure the LLM provider, e.g. change the URL or the available models, consider integrating your LLM provider with Theias preference system.</p>
<p>For further details, we recommend reviewing the available LLM provider in Theia AI:</p>
<ul>
Expand Down
2 changes: 1 addition & 1 deletion pr-previews/pr-665/page-data/docs/theia_ai/page-data.json

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion pr-previews/pr-665/support/index.html

Large diffs are not rendered by default.

0 comments on commit ad466f1

Please sign in to comment.