Skip to content

Commit 54b3b77

Browse files
[8.14] Adds LLM performance matrix doc to ESS & serverless (backport #5286) (#5295)
* Adds LLM performance matrix doc to ESS & serverless (#5286) * Adds LLM performance matrix doc to ESS & serverless * experimenting with matrix formatting * uses alternative matrix formatting * updates matrix format, adds alternative version * uses updated table format * updates ESS version of table * fixes table * removes outdated table formatting * Update docs/assistant/llm-performance-matrix.asciidoc Co-authored-by: Joe Peeples <[email protected]> * Update docs/serverless/assistant/llm-performance-matrix.mdx Co-authored-by: Joe Peeples <[email protected]> * Update docs/serverless/assistant/llm-performance-matrix.mdx Co-authored-by: Joe Peeples <[email protected]> * Update docs/assistant/llm-performance-matrix.asciidoc Co-authored-by: Joe Peeples <[email protected]> * Update docs/assistant/llm-performance-matrix.asciidoc Co-authored-by: natasha-moore-elastic <[email protected]> * Update docs/serverless/assistant/llm-performance-matrix.mdx Co-authored-by: natasha-moore-elastic <[email protected]> * Update docs/assistant/llm-performance-matrix.asciidoc --------- Co-authored-by: Joe Peeples <[email protected]> Co-authored-by: natasha-moore-elastic <[email protected]> (cherry picked from commit adb07fa) # Conflicts: # docs/serverless/serverless-security.docnav.json * remove serverless pages from backport branch * fixes build --------- Co-authored-by: Benjamin Ironside Goldstein <[email protected]> Co-authored-by: Benjamin Ironside Goldstein <[email protected]>
1 parent 2c31523 commit 54b3b77

File tree

2 files changed

+16
-0
lines changed

2 files changed

+16
-0
lines changed
Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
[[llm-performance-matrix]]
2+
= Large language model performance matrix
3+
4+
This table describes the performance of various large language models (LLMs) for different use cases in {elastic-sec}, based on our internal testing. To learn more about these use cases, refer to <<attack-discovery, Attack discovery>> or <<security-assistant, AI Assistant>>.
5+
6+
[cols="1,1,1,1,1,1,1", options="header"]
7+
|===
8+
| *Feature* | *Model* | | | | |
9+
| | *Claude 3: Opus* | *Claude 3: Sonnet* | *Claude 3: Haiku* | *GPT-4o* | *GPT-4 Turbo*| *GPT-4 32K*
10+
11+
| *Assistant - General* | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent
12+
| *Assistant - {esql} Generation*| Great | Great | Poor | Excellent | Poor | Excellent
13+
| *Assistant - Alert Questions* | Excellent | Excellent | Excellent | Excellent | Poor | Good (limited context)
14+
| *Attack discovery* | Excellent | Great | Poor | Poor | Good | Good (limited context)
15+
|===

docs/assistant/security-assistant.asciidoc

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -194,6 +194,7 @@ In addition to practical advice, AI Assistant can offer conceptual advice, tips,
194194

195195

196196
include::ai-alert-triage.asciidoc[leveloffset=+1]
197+
include::llm-performance-matrix.asciidoc[leveloffset=+1]
197198
include::azure-openai-setup.asciidoc[leveloffset=+1]
198199
include::connect-to-openai.asciidoc[leveloffset=+1]
199200
include::connect-to-bedrock.asciidoc[leveloffset=+1]

0 commit comments

Comments
 (0)