Realtime Client Proposal#7285

Open

tarekgh wants to merge 71 commits intodotnet:mainfrom

tarekgh:RealtimeClientProposal

Commits on Feb 11, 2026

Realtime Client Proposal
Tarek Mahmoud Sayed
committed
Replace [Experimental("MEAI001")] with DiagnosticIds.Experiments.AIRealTime
Tarek Mahmoud Sayed
committed
Apply suggestions from code review

tarekgh
and
Copilot
authored
Remove AsIRealtimeClient extension method
Tarek Mahmoud Sayed
committed
Address PR review comments
Tarek Mahmoud Sayed
committed
Fix multiple issues found during code review
Tarek Mahmoud Sayed
committed

Commits on Feb 12, 2026

Remove duplicate internal FunctionInvocationStatus enum
Tarek Mahmoud Sayed
committed
Remove stale CreateToolsMap calls before the loop
Tarek Mahmoud Sayed
committed
Remove FunctionInvocationResultInternal; use public FunctionInvocationResult directly
Tarek Mahmoud Sayed
committed
Add IAsyncDisposable to IRealtimeSession; store and await receive task in OpenAIRealtimeSession
Tarek Mahmoud Sayed
committed
Revert API baseline JSON changes
Tarek Mahmoud Sayed
committed
Clarify audio/text token counts are subsets of Input/OutputTokenCount
Tarek Mahmoud Sayed
committed

Commits on Feb 13, 2026

Replace ToolChoiceMode enum with ChatToolMode for cross-modality consistency
Tarek Mahmoud Sayed
committed
Unify TranscriptionOptions across Realtime and SpeechToText
Tarek Mahmoud Sayed
committed
Use HasTopLevelMediaType instead of StartsWith for audio check
Tarek Mahmoud Sayed
committed

Commits on Feb 14, 2026

Add API compat suppressions for SpeechToTextOptions breaking changes
Tarek Mahmoud Sayed
committed
Replace string Eagerness with SemanticEagerness struct (ChatRole pattern)
Tarek Mahmoud Sayed
committed

Commits on Feb 22, 2026

Remove InternalsVisibleToTest from Microsoft.Extensions.AI.OpenAI

Tarek Mahmoud Sayed
and
Copilot
committed
Add RawRepresentationFactory to RealtimeSessionOptions
Tarek Mahmoud Sayed
committed
Remove OpenAI-specific tracing properties from RealtimeSessionOptions
Tarek Mahmoud Sayed
committed
Remove AIFunction/HostedMcpServerTool properties, use ChatToolMode
Tarek Mahmoud Sayed
committed
Improve XML docs for Usage on response and transcription messages
Tarek Mahmoud Sayed
committed
Remove leftover temp files
Tarek Mahmoud Sayed
committed
Improve ConversationId XML docs on RealtimeServerResponseCreatedMessage
Tarek Mahmoud Sayed
committed
Split Text/Audio properties on RealtimeServerOutputTextAudioMessage
Tarek Mahmoud Sayed
committed
Replace RealtimeServerMessageType enum with readonly struct
Tarek Mahmoud Sayed
committed
Move Parameter into ErrorContent.Details on error messages
Tarek Mahmoud Sayed
committed
Add RawRepresentation property to RealtimeContentItem
Tarek Mahmoud Sayed
committed
Rename Metadata to AdditionalProperties for consistency
Tarek Mahmoud Sayed
committed
Improve MaxOutputTokens XML docs to clarify modality scope
Tarek Mahmoud Sayed
committed
Improve XML docs on RealtimeClientResponseCreateMessage properties
Tarek Mahmoud Sayed
committed
Improve RealtimeClientResponseCreateMessage class-level XML doc
Tarek Mahmoud Sayed
committed
Rename EventId to MessageId for terminology consistency
Tarek Mahmoud Sayed
committed
Remove blank line between using directives in audio buffer messages
Tarek Mahmoud Sayed
committed

Commits on Feb 23, 2026

Rename RealtimeAudioFormat.Type to MediaType for consistency
Tarek Mahmoud Sayed
committed
Refactor IRealtimeSession: rename InjectClientMessageAsync to SendClientMessageAsync and remove updates parameter from GetStreamingResponseAsync

Tarek Mahmoud Sayed
and
Copilot
committed
Make RealtimeSessionOptions and related types immutable with init-only properties and IReadOnlyList
Tarek Mahmoud Sayed
committed
Fix XML doc param order, add null validation to constructors
Tarek Mahmoud Sayed
committed

Commits on Mar 3, 2026

Merge branch 'main' into RealtimeClientProposal
tarekgh
authored
OpenAI Realtime Provider using OpenAI SDK
Tarek Mahmoud Sayed
committed
Fix typo: add missing space in comment ('IDsince' -> 'ID since')
Tarek Mahmoud Sayed
committed
Make CreateSessionAsync return non-nullable IRealtimeSession
Tarek Mahmoud Sayed
committed

Commits on Mar 4, 2026

Remove SemanticEagerness from Abstractions; move eagerness to AdditionalProperties
Tarek Mahmoud Sayed
committed
Include CompatibilitySuppressions for SpeechToTextOptions API changes
Tarek Mahmoud Sayed
committed
Remove MCP-specific types from abstractions; add provider contract docs
Tarek Mahmoud Sayed
committed
Remove trailing blank line in RealtimeServerErrorMessage
Tarek Mahmoud Sayed
committed
Clarify ErrorMessageId XML doc to distinguish from base MessageId
Tarek Mahmoud Sayed
committed
Rename ErrorMessageId to OriginatingMessageId for clarity
Tarek Mahmoud Sayed
committed
Change ExcludeFromConversation from bool to bool? for provider-default consistency
Tarek Mahmoud Sayed
committed
Remove blank lines between Experimental attribute and class declaration
Tarek Mahmoud Sayed
committed
Add null validation to Content property setter
Tarek Mahmoud Sayed
committed
Make RealtimeAudioFormat.SampleRate non-nullable and remove misleading doc
Tarek Mahmoud Sayed
committed
Rename IRealtimeSession to IRealtimeClientSession and SendClientMessageAsync to SendAsync
Tarek Mahmoud Sayed
committed
Fix null DefaultConversationConfiguration when ExcludeFromConversation is unset
Tarek Mahmoud Sayed
committed

Commits on Mar 5, 2026

Remove IDisposable from IRealtimeClientSession, keep only IAsyncDisposable
Tarek Mahmoud Sayed
committed
Remove ConversationId from RealtimeServerResponseCreatedMessage
Tarek Mahmoud Sayed
committed
Rename ResponseCreateMessage and ConversationItemCreateMessage to CreateResponseMessage and CreateConversationItemMessage
Tarek Mahmoud Sayed
committed
Rename RealtimeContentItem to RealtimeConversationItem
Tarek Mahmoud Sayed
committed
Remove VoiceSpeed from RealtimeSessionOptions and use RawRepresentationFactory seed pattern
Tarek Mahmoud Sayed
committed
Remove UpdateAsync from IRealtimeClientSession, use message-based approach
Tarek Mahmoud Sayed
committed
Rename realtime session classes to include Client in name
Tarek Mahmoud Sayed
committed
Simplify DisposeAsyncCore to return ValueTask directly
Tarek Mahmoud Sayed
committed
Convert RealtimeSessionKind from enum to extensible string struct
Tarek Mahmoud Sayed
committed
Remove NoiseReductionOptions from abstraction
Tarek Mahmoud Sayed
committed
Remove VoiceActivityDetection hierarchy from abstraction
Tarek Mahmoud Sayed
committed

Commits on Mar 6, 2026

Remove AnonymousDelegatingRealtimeClientSession and anonymous Use overload
Tarek Mahmoud Sayed
committed
Fix JSON injection in MessageId by using JsonSerializer.Serialize
Tarek Mahmoud Sayed
committed
Remove meaningless duration metric from SendAsync in OTel session
Tarek Mahmoud Sayed
committed
Refactor builder to operate on IRealtimeClient instead of IRealtimeClientSession
Tarek Mahmoud Sayed
committed
Rename message classes: move RealtimeClient/RealtimeServer before Message
Tarek Mahmoud Sayed
committed
Merge branch 'upstream-main' into RealtimeClientProposal
Tarek Mahmoud Sayed
committed