Merge pull request #8 from madebygps/feature/azure-ai-evaluation

Add travel planning agent evaluation scripts in English and Spanish

Author: madebygps

.env.sample

@@ -9,4 +9,6 @@ OPENAI_MODEL=gpt-3.5-turbo
 # Configure for GitHub models: (GITHUB_TOKEN already exists inside Codespaces)
 GITHUB_MODEL=gpt-5-mini
 GITHUB_TOKEN=YOUR-GITHUB-PERSONAL-ACCESS-TOKEN
-OTEL_EXPORTER_OTLP_ENDPOINT=http://localhost:4317
+OTEL_EXPORTER_OTLP_ENDPOINT=http://localhost:4317
+# Optional: Set to log evaluation results to Azure AI Foundry for rich visualization
+AZURE_AI_PROJECT=https://YOUR-ACCOUNT.services.ai.azure.com/api/projects/YOUR-PROJECT

README.md

@@ -174,6 +174,7 @@ You can run the examples in this repository by executing the scripts in the `exa
 | [openai_tool_calling.py](examples/openai_tool_calling.py) | Tool calling with the low-level OpenAI SDK, showing manual tool dispatch. |
 | [workflow_basic.py](examples/workflow_basic.py) | A workflow-based agent. |
 | [agent_otel_aspire.py](examples/agent_otel_aspire.py) | An agent with OpenTelemetry tracing, metrics, and structured logs exported to the [Aspire Dashboard](https://aspire.dev/dashboard/standalone/). |
+| [agent_evaluation.py](examples/agent_evaluation.py) | Evaluate a travel planner agent using [Azure AI Evaluation](https://learn.microsoft.com/azure/ai-foundry/concepts/evaluation-evaluators/agent-evaluators) agent evaluators (IntentResolution, ToolCallAccuracy, TaskAdherence, ResponseCompleteness). Optionally set `AZURE_AI_PROJECT` in `.env` to log results to [Azure AI Foundry](https://learn.microsoft.com/azure/ai-foundry/how-to/develop/agent-evaluate-sdk). |
 
 ## Using the Aspire Dashboard for telemetry