Implement default in-memory store for ChatCompletionCache (#5188) #3855

Job	Run time
format	1m 9s
lint	1m 2s
mypy (./packages/autogen-core)	3m 17s
pyright (./packages/autogen-core)	1m 5s
mypy (./packages/autogen-magentic-one)	1m 18s
pyright (./packages/autogen-magentic-one)	58s
mypy (./packages/agbench)	1m 8s
pyright (./packages/agbench)	54s
mypy (./packages/autogen-ext)	2m 53s
pyright (./packages/autogen-ext)	1m 4s
mypy (./packages/autogen-agentchat)	1m 33s
docs (./packages/autogen-core)	1m 35s
pyright (./packages/autogen-agentchat)	57s
mypy (./packages/magentic-one-cli)	1m 23s
pyright (./packages/magentic-one-cli)	1m 0s
docs-example-check (./packages/autogen-core)	3m 9s
test (./packages/autogen-core)	1m 2s
test (./packages/autogen-magentic-one)	1m 47s
test (./packages/autogen-ext)	4m 13s
test (./packages/autogen-agentchat)	1m 8s
check-proto-changes-python	1m 8s
markdown-code-lint	2m 3s
samples-code-check	1m 6s
codecov (./packages/autogen-core)	8s
codecov (./packages/autogen-magentic-one)	9s
codecov (./packages/autogen-ext)	7s
codecov (./packages/autogen-agentchat)	12s
	37m 28s

Provide feedback