feat: Track eve turns as individual traces#2230
Conversation
Luca Forstner (lforst)
force-pushed
the
dum-e/cmrklcphn000a04l425jfoy2q
branch
from
6c3274d to
89921a6
Compare
Luca Forstner (lforst)
requested review from
Abhijeet Prasad (AbhiPrasad) and
Stephen Belanger (Qard)
Abhijeet Prasad (AbhiPrasad)
left a comment
Abhijeet Prasad (AbhiPrasad)
left a comment
There was a problem hiding this comment.
Do we not want to attach session id then?
| @@ -0,0 +1,5 @@ | |||
| --- | |||
| "braintrust": patch | |||
There was a problem hiding this comment.
| "braintrust": patch | |
| "braintrust": minor |
I noticed my clanker loves to do this too.
There was a problem hiding this comment.
That was actually me haha - whenever it has a generated name, I ran the changeset command myself.
I thought this was no API change and soon enough after introduction so that we can act like this is a patch - not sure? What would be the arguments for minor? I guess any sort of scorers/processors that depend on this shape. I'll change it.
Can add (albeit it is like very useless imo cause it is very much not exposed - only useful for cross referencing I guess) |
|
if we attach session id, we can run trace group scorers via aggregating on session id. It can also be used for to make topic facets better. |
2 participants
Currently we attach turns to existing traces as a "session". Going forward we generally want to have a trace per turn.