Connect Cohere to Microsoft Copilot via MCP

💡 No install? Use cloud.anythingmcp.com directly. Sign in, click Connectors → Cohere, paste your credentials, mint an MCP API key and you're done. No Docker, no git clone, no local server.

Cohere + Microsoft Copilot

Cohere with your own API key: answers from Command models with citations from your documents, embeddings for semantic search, reranking of search results, speech-to-text, parsing of document images, token counting, and the models, datasets, batches and embed jobs of the account.

Prerequisites

See the full setup instructions baked into the connector (visible in the in-app store when you select the connector). The required environment variables for this connector are:

COHERE_API_KEY

Step 1 — Get credentials

Setting up takes about 2 minutes. You need a Cohere account; a trial key is free.

1. Sign up at https://dashboard.cohere.com and open API Keys (https://dashboard.cohere.com/api-keys).
2. Copy the trial key, or create a production key after adding a payment method under Billing.
3. Paste it into COHERE_API_KEY, without the word Bearer. The connector sends it as Authorization: Bearer and only to Cohere.
4. Install the connector and run cohere_check_api_key or cohere_list_models to check the key.

Which tools cost money: cohere_chat, cohere_embed, cohere_rerank, cohere_transcribe_audio and cohere_parse_document run a model. With a production key every call is billed: chat per input and output token, embed per token or image, rerank per search of up to 100 documents (longer documents count as several). A trial key is free but rate limited per minute and per month and may not be used commercially. The AI asks you before large or repeated calls and sets max_tokens to cap a chat reply. cohere_tokenize, cohere_detokenize, cohere_check_api_key and all list and get tools cost nothing.

Models: ids change, so cohere_list_models (filter endpoint chat, embed or rerank) has the current list and cohere_get_model shows one model's context length, features and endpoints.

• Chat: command-a-03-2025 (the default choice), command-a-reasoning-08-2025 (reasoning), command-a-vision-07-2025 (images), command-a-translate-08-2025 (translation), command-r7b-12-2024 (small and cheap).
• Embed: embed-v4.0 (text and images), embed-v5.0-pro, embed-v5.0-fast, embed-multilingual-v3.0.
• Rerank: rerank-v5.0-fast (default), rerank-v5.0-pro (more accurate), rerank-v3.5.
• Transcription: cohere-transcribe-03-2026. Parsing: parse-v5.0.

Answers with citations: cohere_chat takes model and messages and returns the whole reply at once. Pass documents (plain strings, or objects with id and data holding title and snippet) for a grounded answer: the reply then carries message.citations pointing into them. response_format forces JSON, tools adds function calling, and thinking with type disabled turns reasoning off on reasoning models.

Semantic search: cohere_embed turns up to 96 texts (or images as data URIs) into vectors; input_type search_document is for what you store, search_query for the query. The default here is embed-v4.0 with 256 dimensions (output_dimension 256, 512, 1024 or 1536). cohere_rerank orders up to 1,000 documents by relevance to a query and returns results with index (the position in your list) and relevance_score from 0 to 1; top_n keeps only the best.

Audio and documents: cohere_transcribe_audio takes a public link to an audio file (flac, mp3, mpeg, mpga, ogg, wav, up to 10 MB through this connector) and the required language (ISO-639-1); the connector downloads the file and uploads it to Cohere. cohere_parse_document turns an image of a page (scan, photo, screenshot; public link or data URI up to 20 MB) into markdown with tables inlined, or into layout blocks. PDFs are not supported yet.

Tokens: cohere_tokenize counts the tokens of a text for a model, for example before a chat call; cohere_detokenize turns token ids back into text.

Account data: cohere_list_datasets, cohere_get_dataset and cohere_get_dataset_usage (storage used, at most 10 GB per organization); cohere_list_batches and cohere_get_batch for Batch API jobs; cohere_list_embed_jobs and cohere_get_embed_job for embed jobs.

Data formats: chat returns message.content[] (items of type text with text), finish_reason (COMPLETE, MAX_TOKENS, STOP_SEQUENCE, TOOL_CALL, ERROR) and usage.billed_units with the billed input and output tokens. Embeddings are under embeddings.float, one vector per text in order. Dates are ISO 8601, UTC.

Paging: cohere_list_models and cohere_list_batches return next_page_token; the AI passes it as page_token until it is empty. cohere_list_datasets pages with limit and offset.

Switched off at install: nothing. All 17 tools are on, and none of them deletes anything.

Limits: at most 96 texts per embed call and 1,000 documents per rerank; audio up to 10 MB and document images up to 20 MB. Trial keys have low per-minute and monthly limits.

Common errors: 400 means a bad request (for example a parameter the model does not take, or more than 96 texts); 401 a wrong key; 402 a payment method is needed (add one under Billing); 404 an unknown model, dataset, batch or job; 422 a request that could not be processed; 429 the rate limit (the AI waits instead of retrying in a loop); 499 a cancelled request; 500 and 503 are Cohere problems, retry once later.

The connector does not stream replies and does not create, cancel or delete datasets, batches or embed jobs. Classify, Summarize, Generate, connectors and fine-tuning are deprecated by Cohere and left out.

Step 2 — Install the adapter

curl -fsSL https://raw.githubusercontent.com/HelpCode-ai/anythingmcp/main/docker-compose.quickstart.yml -o docker-compose.yml
printf 'JWT_SECRET=%s\nENCRYPTION_KEY=%s\n' "$(openssl rand -hex 32)" "$(openssl rand -hex 32)" > .env
docker compose up -d

Step 3 — Add the connector in Microsoft Copilot

Your server URL: in AnythingMCP, open MCP Servers → the server this connector is on, and copy its URL (https://cloud.anythingmcp.com/mcp/…). Use it wherever this guide shows YOUR_SERVER_ID.

Microsoft Copilot uses MCP servers through agents built in Copilot Studio: you add AnythingMCP to an agent as a tool, then publish the agent to Microsoft 365 Copilot and Teams. Copilot Studio connects from Microsoft's cloud over Streamable HTTP, which AnythingMCP supports.

1. In Copilot Studio, open your agent (or create one), go to Tools and choose Add a tool → New tool → Model Context Protocol.
2. Enter a Server name (for example AnythingMCP), a Server description that says what the connector does, and the Server URL https://cloud.anythingmcp.com/mcp/YOUR_SERVER_ID. Copilot Studio uses the description to decide when to call the server.
3. Under authentication, choose API key, set Type to Header and the header name to X-API-Key, then select Create.
4. In Add tool, choose Create a new connection, paste an MCP API key from AnythingMCP (MCP Servers → your server → API keys) and select Add to agent.
5. Try it in the agent's Test pane: ask for something that needs the Cohere tools.
6. Select Publish, then Channels → Microsoft 365 and Microsoft Teams, keep Make agent available in Microsoft Copilot selected and choose Add channel. See agent in Teams installs it for you; in Microsoft 365 Copilot, type @ and pick the agent.

Prefer per-user sign-in? Choose OAuth 2.0 → Dynamic discovery instead of an API key: each user then signs in to AnythingMCP the first time the agent calls it.

Self-hosting? Use your instance's public HTTPS address instead of https://cloud.anythingmcp.com. Copilot Studio connects from Microsoft's cloud, so localhost does not work.

Available tools

Example prompts

• "Answer the question about our refund window using only these three policy excerpts, and show which excerpt each sentence comes from."
• "Which of these 20 product descriptions best match waterproof winter hiking boots? Rerank them and show the top 5 with scores."
• "How many tokens does this contract text have for command-a-03-2025?"
• "Turn the scanned invoice at https://example.com/scans/invoice-0425.png into markdown, including the line-item table."
• "Which of my Cohere embed jobs and batches are still running, and did any of them fail?"

FAQ

Which Copilot is this for? Microsoft 365 Copilot at work, through agents built in Copilot Studio. The Microsoft Copilot app for personal accounts has no option to add your own MCP server.

What do I need? A work account with access to Copilot Studio (a license or a trial) to build the agent. People who use it in Microsoft 365 Copilot or Teams need access to the agent: share it with them, or ask an admin to publish it to the organization. If your organization applies data policies to Power Platform connectors, they cover MCP servers too.

The agent doesn't call the tools. Check that the header name is exactly X-API-Key and that the key belongs to the same MCP server as the URL, and make the server description specific: Copilot Studio uses it to decide when to call the server. Publish the agent again after each change; in an open chat, type "start over" to get the new version.

Next steps

• Connector landing page
• Connect to Claude
• Connect to ChatGPT
• Connect to Cursor
• Connect to Gemini
• Connect to Meta Muse