feat: Enhance MCP integration and example

[ThanabordeeN]

📝 Changes Description

TLDR; Enhanced DSPy's ReAct with concurrent MCP server support, enabling efficient integration with external APIs (e.g., Airbnb) through asynchronous operations and robust resource management.

This MR/PR introduces significant improvements to DSPy's ReAct framework, enabling concurrent interaction with multiple MCP (Model Context Protocol) servers. Key enhancements include:

• mcp_multi_server_example.py:
  • Provides a practical demonstration of concurrent MCP server operations within a ReAct workflow.
• mcp.py:
  • Add mcp module intregrations
• Asynchronous ReAct Operations:
  • Leverages ReAct's asynchronous capabilities (async_forward in react.py) for efficient management of multiple server connections.

Example Usage

import asyncio
import os
import dspy

# Define a simple DSPy Signature for the agent
class MultiServerSignature(dspy.Signature):
    """Perform operations using tools potentially available across multiple MCP servers."""
    request: str = dspy.InputField(desc="The user's request, potentially requiring external tools.")
    output: str = dspy.OutputField(desc="The final response to the user's request after potentially using tools.")

async def main():
    # Initialize language model
    lm = dspy.LM("gemini/gemini-2.0-flash", api_key=os.getenv("GOOGLE_API_KEY"))
    dspy.configure(lm=lm)
    
    # Configure MCP servers
    config_path = "path/to/servers_config.json"
    
    async with dspy.MCPServerManager() as server_manager:
        # Load and initialize servers from config
        config = server_manager.load_config(config_path)
        await server_manager.initialize_servers(config)
        
        # Get all tools from all connected servers
        all_mcp_tools = await server_manager.get_all_tools()
        
        # Create a ReAct agent with the tools
        react_agent = dspy.ReAct(
            MultiServerSignature,
            tools=all_mcp_tools,
            max_iters=7
        )
        
        # Execute a request
        result = await react_agent.async_forward(request="Your request here")
        print("Final Result:", result.output)

if __name__ == "__main__":
    asyncio.run(main())

✅ Contributor Checklist

• [-] Pre-Commit checks are passing (locally and remotely)

⚠️ Warnings

• MCP tools are currently incompatible with combinations of default functions and MCP functions must use async function instead
• Some MCP functions may exhibit unexpected behavior.
• SSE MCP functionality has not been thoroughly tested.

[TomeHirata]

Please don't include mcp in the main dependency. Include it in the extra dependency instead

[TomeHirata]

Please don't change the minimum support Python version

[TomeHirata]

Examples are not actively used. Can we have a documentation page in docs/docs/tutorials?

[TomeHirata]

@ThanabordeeN Thank you for the PR. The maintainer team is discussing how we should support the MCP integration in dspy.ReAct. Can we keep this PR on hold while we discuss the design direction?

[ThanabordeeN]

Okay , with pleasure.

[TomeHirata]

Hi, @ThanabordeeN. Regarding the MCP support in dspy.ReAct. Here is the proposal from the maintainer team. Are you willing to contribute?

1. We provide a public util to convert mcp.types.Tool and mcp.client.session.ClientSession into dspy.primitives.tool.Tool so that MCP tools can be passed to dspy.ReAct
2. dspy.ReAct should be able to use async callables and async Tools in the sync forward method. While we plan to provide an async forward method, it should be a follow-up after the MVP version
3. We don't plan to support MCP server session management within the DSPy library in the short term. We believe it should be addressed by the MCP library side.

[ThanabordeeN]

Of course, I am interested in being a part of this development because I have personally benefited from using this tool in research and other personal projects.

[okhat]

Thank you @ThanabordeeN ! Looking forward to collaborating with you. (+ Thank you @TomeHirata !)

[ThanabordeeN]

Could you please inform me where this part is located, or confirm if it has not yet been released in any branch?

1. We provide a public util to convert mcp.types.Tool and mcp.client.session.ClientSession into dspy.primitives.tool.Tool so that MCP tools can be passed to dspy.ReAct

[okhat]

@ThanabordeeN That quote is a plan, not a statement about something that exists.

Read Tomu's post again, this is a list of proposals that this PR should adhere to.

1. We should provide a public util to convert mcp.types.Tool and mcp.client.session.ClientSession into dspy.primitives.tool.Tool so that MCP tools can be passed to dspy.ReAct
2. We should update dspy.ReAct sot i can use async callables and async Tools in the sync forward method. While we plan to provide an async forward method, it should be a follow-up after the MVP version (not this PR).
3. We don't plan to support MCP server session management within the DSPy library in the short term. We believe it should be addressed by the MCP library side.

[ThanabordeeN]

Thank you for the explanation.

[ThanabordeeN]

Thank you for the explanation.

[TomeHirata]

Hi, @ThanabordeeN. How's the progress so far? We got some requests for the MCP tool integration with ReAct, and want to ship the first version soon. If it would take time for you, would you mind us working on the development based on the idea in this PR? We can add you as a co-author of the PR.

[ThanabordeeN]

Hi , @TomeHirata Thank you for your message and the proposal regarding the MCP tool integration with ReAct.
I am currently in the process of developing this part. I am very happy for the team to step in and help with the development based on the idea in the PR, and I would like to be a Co-author on this part as well.
To be transparent, I am currently working on this alongside research for another project, which might cause some delays.

However, I am keen to collaborate closely to ensure this integration is completed successfully.

[ThanabordeeN]

@TomeHirata For cleaner commits, I'm going to open a new PR for the upcoming update.