LangChain MCP Client Streamlit App

This Streamlit application provides a user interface for connecting to MCP (Model Context Protocol) servers and interacting with them using different LLM providers (OpenAI, Anthropic, Google, Ollama).

⚠️ Development Status

This application is currently in active development. While functional, you may encounter bugs, incomplete features, or unexpected behavior. We appreciate your patience and welcome feedback to help improve the application.

Features

• Multi-Provider LLM Support: OpenAI, Anthropic Claude, Google Gemini, and Ollama
• Streaming Responses: Real-time token-by-token streaming for supported models
• MCP (Model Context Protocol) Integration: Connect to MCP servers for tool access
• Advanced Memory Management: Short-term session memory and persistent cross-session memory
• Multi-Server Support: Connect to multiple MCP servers simultaneously
• Tool Testing Interface: Test individual tools with custom parameters
• Chat-Only Mode: Use without MCP servers for simple conversations
• Advanced Model Configuration: Custom temperature, max tokens, timeout, and system prompts
• Comprehensive Logging: Track all tool executions and conversations
• Export/Import: Save and load conversation history
• Containerized Deployment: Easy Docker setup

NEW - Streaming Support

The application now supports real-time streaming responses for all compatible models:

Supported Models with Streaming

• ✅ OpenAI: All GPT models (GPT-4, GPT-3.5-turbo, etc.)
• ✅ Anthropic: All Claude models (Claude-3.5-Sonnet, Claude-3-Opus, etc.)
• ✅ Google: All Gemini models (Gemini-2.0-Flash, etc.)
• ✅ Ollama: All local models (Granite, Qwen, etc.)

How It Works

1. Enable Streaming: Toggle in the "🌊 Streaming Settings" section in the sidebar
2. Real-time Display: Responses appear token by token as they're generated
3. Tool Integration: See tool execution status in real-time
4. Fallback Support: Automatically falls back to non-streaming if issues occur

Benefits

• Better User Experience: See responses as they're being generated
• Faster Perceived Response Time: Start reading while the model is still generating
• Real-time Feedback: Know immediately when tools are being executed
• Interactive Feel: More engaging conversation experience

Configuration System

LLM Providers & Parameters

• OpenAI: GPT-4o, GPT-4, GPT-3.5-turbo with temperature (0.0-2.0), max tokens (1-4000), timeout (10-600s)
• Anthropic: Claude models with temperature (0.0-1.0), max tokens (1-4000), timeout (10-600s)
• Google: Gemini models with temperature (0.0-1.0), max tokens (1-2048), timeout (10-600s)
• Ollama: Local models with temperature (0.0-1.0), max tokens (1-4000), timeout (10-600s)

System Prompts

• Built-in Presets: Five specialized system prompts for different use cases
• Custom Prompts: Create and save your own system prompts
• Real-time Application: Apply configuration changes with instant feedback
• Configuration Status: Visual indicators showing applied/changed/default states

Configuration Management

• Apply Configuration: Smart button that detects changes and applies settings
• Export/Import: Save configurations as JSON files for backup or sharing
• Reset Options: Reset to defaults or previously applied settings
• Change Detection: Real-time tracking of configuration modifications

Memory System

Memory Types

1. Short-term (Session):

   • Conversations stored in browser session memory
   • Lost when browser is closed or app restarted
   • Uses LangGraph's InMemorySaver

2. Persistent (Cross-session):

   • Conversations stored in SQLite database (conversations.db)
   • Persists across browser sessions and app restarts
   • Uses LangGraph's SqliteSaver with custom metadata management
   • Auto-saves conversations during chat
   • Browse, load, and manage saved conversations

Advanced Memory Features

• Conversation Import/Export: Import previous conversations with preview and confirmation system
• Thread Management: Switch between different conversation threads with unique IDs
• Memory Analytics: Track message counts, memory usage, conversation statistics, and database size
• Conversation Browser: View and manage all stored conversations with metadata and search capabilities
• History Tool Integration: When memory is enabled, the agent gains access to a get_conversation_history tool that allows it to:
  • Search through previous conversations by type or content
  • Reference earlier discussions and maintain context
  • Summarize conversation topics and filter messages
  • Access specific parts of the conversation history with clean, formatted output

Memory Safety & Performance

• Import Validation: Safe import system with format validation and preview before applying
• Loop Prevention: Robust safeguards against infinite loops during memory operations
• Flexible Limits: Configurable message limits and memory constraints
• Real-time Status: Visual indicators for memory state, thread information, and change detection

Tool Testing & Analytics

• Individual Tool Testing: Access via the "🔧 Test Tools" tab
• Dynamic Parameter Forms: Auto-generated forms based on tool schemas with real-time validation
• Performance Tracking: Execution timing, success/failure rates, and detailed statistics
• Test History: Complete test result history with export capabilities
• Result Analysis: Success rate calculations and average execution time metrics
• JSON Export: Export test results and performance data for external analysis

Future Improvements

• STDIO MCP Servers: Support for connecting to MCP servers using standard input/output (STDIO) for more flexible server configurations
• RAG (File Upload): Enable Retrieval-Augmented Generation (RAG) by allowing users to upload files that the agent can use to enhance its responses
• Enhanced Tool Validation: Advanced parameter validation and schema checking for MCP tools
• Multi-threaded Processing: Parallel processing for multiple tool executions and server connections

Installation

1. Clone this repository:

git clone https://github.com/guinacio/langchain-mcp-client.git
cd langchain-mcp-client

2. Create a virtual environment and install dependencies:

python -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate
pip install -r requirements.txt

Running the Application

Run the Streamlit app with:

streamlit run app.py

The application will be available at http://localhost:8501

Setting Up an MCP Server

To use this application, you'll need an MCP server running or a valid URL to an MCP server. Use the simple MCP server available on weather_server.py for a quick test:

2. Install the MCP library:

pip install mcp

3. Run the server:

python weather_server.py

The server will start on port 8000 by default. In the Streamlit app, you can connect to it using the URL http://localhost:8000/sse.

Troubleshooting

• Connection Issues: Ensure your MCP server is running and accessible
• API Key Errors: Verify that you've entered the correct API key for your chosen LLM provider
• Tool Errors: Check the server logs for details on any errors that occur when using tools

Resources

• LangChain MCP Adapters
• Model Context Protocol
• Streamlit Documentation