Skip to content

Commit 25c1368

Browse files
committedSep 26, 2024··
fix: file tool results flakiness in Windows test
Signed-off-by: Donnie Adams <[email protected]>
1 parent 1c2437a commit 25c1368

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed
 

‎tests/test_gptscript.py

+2-2
Original file line numberDiff line numberDiff line change
@@ -219,12 +219,12 @@ async def test_eval_tool_list(gptscript, tool_list):
219219
out = await run.text()
220220
assert out.strip() == "hello there", "Unexpected output from eval using a list of tools"
221221

222-
# In this case, we expect the total number of toolResults to be 1
222+
# In this case, we expect the total number of toolResults to be 1 or 2 depending on what the LLM tries to do.
223223
total_tool_results = 0
224224
for c in run.calls().values():
225225
total_tool_results += c.toolResults
226226

227-
assert total_tool_results == 1, "Unexpected number of toolResults"
227+
assert total_tool_results >= 1, "Unexpected number of toolResults"
228228

229229

230230
@pytest.mark.asyncio

0 commit comments

Comments
 (0)
Please sign in to comment.