Add tiktoken as a dependency in pyproject.toml (#5008) #3404

Job	Run time
format	53s
lint	52s
mypy (./packages/autogen-core)	2m 11s
pyright (./packages/autogen-core)	57s
mypy (./packages/autogen-magentic-one)	1m 13s
pyright (./packages/autogen-magentic-one)	1m 3s
mypy (./packages/agbench)	1m 3s
pyright (./packages/agbench)	1m 4s
pyright (./packages/autogen-ext)	1m 3s
mypy (./packages/autogen-ext)	1m 50s
pyright (./packages/autogen-agentchat)	1m 6s
mypy (./packages/autogen-agentchat)	1m 10s
mypy (./packages/magentic-one-cli)	1m 21s
pyright (./packages/magentic-one-cli)	1m 32s
check-proto-changes-python	1m 9s
codecov (./packages/autogen-core)	1m 9s
codecov (./packages/autogen-magentic-one)	2m 1s
docs (./packages/autogen-core)	1m 26s
codecov (./packages/autogen-ext)	2m 49s
codecov (./packages/autogen-agentchat)	1m 5s
docs-example-check (./packages/autogen-core)	2m 36s
markdown-code-lint	2m 16s
samples-code-check	1m 8s
test (./packages/autogen-core)	1m 3s
test (./packages/autogen-magentic-one)	1m 32s
test (./packages/autogen-ext)	3m 0s
test (./packages/autogen-agentchat)	1m 5s
	39m 37s

Provide feedback