How to Connect to Any LLM to Any MCP Server, Locally and Open Source

Use Director CLI to connect any LLM to MCP servers locally. This guide shows how to set up proxies, add servers like Hacker News or Slack, and use clients like Claude or Cursor for AI-powered workflows.

Ashley Goolam

Ashley Goolam

8 August 2025

How to Connect to Any LLM to Any MCP Server, Locally and Open Source

Want to hook up your favorite large language model (LLM) to a Model Context Protocol (MCP) server without cloud dependencies or subscription fees? You’re in the right place! With the Director CLI tool, you can connect any LLM to any MCP server locally, using open-source tools. In this guide, we’ll walk you through setting up Director, configuring an MCP proxy, and linking it to clients like Claude, Cursor, or VS Code. By the end, you’ll be querying Hacker News or posting to Slack with ease—all from your own machine. Let’s get started!

💡
Want a great API Testing tool that generates beautiful API Documentation?

Want an integrated, All-in-One platform for your Developer Team to work together with maximum productivity?

Apidog delivers all your demands, and replaces Postman at a much more affordable price!
button

What Is Director and Why Use It?

Director is an open-source CLI tool launched in July 2025 that simplifies connecting LLMs to MCP servers. MCP, introduced by Anthropic in November 2024, is a standardized protocol for linking LLMs to external data sources and tools, like a “USB-C for AI.” Whether you’re pulling top stories from Hacker News or posting summaries to Slack, Director makes it easy to set up local MCP proxies and manage multiple servers and clients. It’s free, privacy-focused, and perfect for developers who want control over their AI workflows. Ready to dive in?

director cli tool

Step 1: Install the Director CLI Tool

Let’s get Director running on your machine. You can install it locally via npm for a quick setup, no browser required, or use the original curl method for flexibility.

Option 1: Install via npm

  1. Open a Terminal:

2. Install Director:

npm install -g @director.run/cli

This installs the Director CLI globally.

3. Start the Gateway:

director serve

This starts a local server at http://localhost:8080.

4. Open the Studio:

director studio

This launches the Director UI for proxy setup.

Option 2: Install via Curl

  1. Install Director:
curl -LsSf https://director.run/install.sh | sh

This fetches the latest Director binary and sets it up in your PATH.

2. Start the Quickstart:

director quickstart

This opens a browser window at http://localhost:8080.

Pro Tip: If the browser doesn’t open, check the terminal for the URL or navigate to http://localhost:8080. Ensure port 8080 is free (lsof -i :8080).

Step 2: Configure an MCP Proxy Server

You can set up an MCP proxy server using Director’s browser UI or CLI. The proxy acts as a middleman, routing LLM requests to MCP servers like Hacker News or Slack. Let’s explore both methods.

Option 1: Configure via Browser UI

  1. Create a Proxy:
name the proxy server

2. Add an MCP Server:

add an mcp server

3. Save and Deploy:

save and connect to an mcp client

Option 2: Configure via CLI

  1. Start the Gateway:
director serve

2. Create a Proxy:

director create my-first-proxy

This sets up a proxy named my-first-proxy.

3. Add an MCP Server:

director add fetch --target=my-first-proxy

The fetch server is a simple MCP server for testing, similar to Hacker News.

4. Connect Clients:

director connect my-first-proxy --target=claude
director connect my-first-proxy --target=cursor
director connect my-first-proxy

Why Hacker News or Fetch? These are lightweight MCP servers that expose tools for fetching data (e.g., top stories), making them great for testing.

Step 3: Connect Your MCP Client

Now, let’s hook up your LLM client (Claude Desktop, Cursor, or VS Code) to the proxy. We’ll use Claude Desktop as an example, but the process is similar for others.

  1. Launch Claude Desktop:
director proxy serrver

2. Test It Out:

Give me a list of the top stories on Hacker News using my MCP server.
get the result from the hackernews mcp server

What’s Happening? Director routes Claude’s request to the MCP server, fetches data, and sends it back to Claude—all locally and open-source.

Step 4: Add More MCP Servers (Like Slack)

Want to expand your setup? Let’s add a Slack MCP server to your proxy, which requires extra configuration but is a breeze with Director.

  1. Access Director:
director add slack --target=my-first-proxy
search for the slack mcp server

2. Configure Slack:

director add slack --target=my-first-proxy --api-token=your-slack-token --channel-id=C123456
configure the slack mcp server

3. Verify in Claude Desktop:

Give me a list of the top stories on Hacker News, summarize them, and post them to Slack.
test the slack mcp server

Why Slack Needs More Config? Slack’s MCP server interacts with external APIs, requiring secure tokens. Director handles this seamlessly via its UI or CLI.

Step 5: Scale with Multiple Servers and Clients

Director shines when managing multiple MCP servers and clients. Here’s how to scale:

director add github --target=my-first-proxy --api-token=your-github-token
director connect my-first-proxy --target=cursor
director connect my-first-proxy --target=vscode
{
  "mcpServers": {
    "director_my-first-proxy": {
      "command": "director",
      "args": ["proxy", "my-first-proxy"]
    }
  }
}
director create work-proxy
director list-proxies

Pro Tip: For detailed CLI usage, check the CLI Reference.

Troubleshooting Common Issues

Why Use Director for MCP Connections?

Director is a developer’s dream for local AI workflows. Here’s why it rocks:

Users highlight Director’s versatility, noting it “makes MCP setup feel like magic” for Claude Code. Whether you’re a solo dev or building enterprise AI, Director saves time and hassle.

Conclusion

You’re now equipped to connect any LLM to any MCP server using Director! From pulling Hacker News stories to posting Slack summaries, you’ve got a local, open-source AI powerhouse at your fingertips. Experiment with more MCP servers, tweak your proxy, or share your setup in the comments. Let’s keep the AI revolution local and open—happy coding!

💡
Want a great API Testing tool that generates beautiful API Documentation?

Want an integrated, All-in-One platform for your Developer Team to work together with maximum productivity?

Apidog delivers all your demands, and replaces Postman at a much more affordable price!
button

Explore more

Tyk vs Kong: Which API Gateway Should You Choose in 2025?

Tyk vs Kong: Which API Gateway Should You Choose in 2025?

Compare Tyk vs Kong in this comprehensive guide. Discover their features, pros & cons and real-world use cases. Learn how Apidog complements them for complete API lifecycle management.

8 August 2025

Docs as Code: The Ultimate Guide to Modern API Documentation That Scales

Docs as Code: The Ultimate Guide to Modern API Documentation That Scales

Learn how Docs as Code methodology combined with Apidog's AI-powered features creates scalable, accurate API documentation that evolves with your code. From visual API design to LLMs.txt and MCP Server integration, discover the future of technical documentation.

8 August 2025

GPT-5 vs Claude Opus: Comparing their API Pricing, and Which is Better for Coding

GPT-5 vs Claude Opus: Comparing their API Pricing, and Which is Better for Coding

Dive into GPT-5 vs Claude Opus 4.1! Compare coding benchmarks, API pricing, and features to find the best AI for your 2025 projects. Perfect for developers seeking speed or precision.

8 August 2025

Practice API Design-first in Apidog

Discover an easier way to build and use APIs