Scrapingbee MCP for AI Agents

Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with Scrapingbee MCP or direct API to extract web page HTML, scrape structured data, automate browser actions, and handle proxies through natural language.

Scrapingbee logoScrapingbee
Api Key

Scrapingbee is a web scraping API that handles browsers and proxy rotation for you. It lets you extract HTML from any website with a single API call.

5 Tools

Try Scrapingbee now

Type what you want done — sign in and watch it run live in the Tool Router playground.

TOOL ROUTER PLAYGROUND
Scrapingbee
Try asking
TOOLS

Supported Tools

Every Scrapingbee action and event your agent gets out of the box.

ScrapingBee Data Extraction

Tool to extract structured data from a webpage using CSS or XPath selectors.

ScrapingBee HTML Fetch

Tool to fetch HTML or screenshot via ScrapingBee HTML API.

ScrapingBee Proxy Mode

Tool to fetch web content via ScrapingBee's Proxy Mode.

ScrapingBee Stealth Proxy

Tool to perform stealth scraping via ScrapingBee's Stealth Proxy mode.

ScrapingBee Usage Stats

Tool to retrieve usage statistics for your ScrapingBee account.

SETUP GUIDE

Connect Scrapingbee MCP Tool with your Agent

1

Install Composio

typescript
npm install @composio/core ai @ai-sdk/openai @ai-sdk/mcp
Install the Composio SDK and Claude Agent SDK
2

Create Tool Router Session

typescript
import { Composio } from '@composio/core';

const composio = new Composio({ apiKey: 'your-api-key' });

console.log("Creating Tool Router session...");
const { mcp } = await composio.create('your-user-id');
console.log(`Tool Router session created: ${mcp.url}`);
Initialize the Composio client and create a Tool Router session
3

Connect to AI Agent

typescript
import { openai } from '@ai-sdk/openai';
import { experimental_createMCPClient as createMCPClient } from '@ai-sdk/mcp';
import { generateText, stepCountIs } from 'ai';

const client = await createMCPClient({
  transport: {
    type: 'http',
    url: mcp.url,
    headers: { 'x-api-key': 'your-composio-api-key' }
  }
});

const tools = await client.tools();

const { text } = await generateText({
  model: openai('gpt-4o'),
  tools,
  messages: [{ role: 'user', content: 'Extract all product titles from https://example.com/shop' }],
  stopWhen: stepCountIs( 5 )
});

console.log(`Agent: ${text}`);
Use the MCP server with your AI agent
SETUP GUIDE

Connect Scrapingbee API Tool with your Agent

1

Install Composio

typescript
npm install @composio/openai
Install the Composio SDK
2

Initialize Composio and Create Tool Router Session

typescript
import OpenAI from 'openai';
import { Composio } from '@composio/core';
import { OpenAIResponsesProvider } from '@composio/openai';

const composio = new Composio({
  provider: new OpenAIResponsesProvider(),
});
const openai = new OpenAI({});
const session = await composio.create('your-user-id');
Import and initialize Composio client, then create a Tool Router session
3

Execute Scrapingbee Tools via Tool Router with Your Agent

typescript
const tools = session.tools;
const response = await openai.responses.create({
  model: 'gpt-4.1',
  tools: tools,
  input: [{
    role: 'user',
    content: 'Extract product prices from this Amazon page'
  }],
});
const result = await composio.provider.handleToolCalls(
  'your-user-id',
  response.output
);
console.log(result);
Get tools from Tool Router session and execute Scrapingbee actions with your Agent

Why Use Composio?

AI Native Scrapingbee Integration

  • Supports both Scrapingbee MCP and direct API based integrations
  • Structured, LLM-friendly schemas for reliable tool execution
  • Rich coverage for reading, writing, and querying your Scrapingbee data

Managed Auth

  • Built-in API key handling with secure storage and rotation
  • Central place to manage, scope, and revoke Scrapingbee access
  • Per user and per environment credentials instead of hard-coded keys

Agent Optimized Design

  • Tools are tuned using real error and success rates to improve reliability over time
  • Comprehensive execution logs so you always know what ran, when, and on whose behalf

Enterprise Grade Security

  • Fine-grained RBAC so you control which agents and users can access Scrapingbee
  • Scoped, least privilege access to Scrapingbee resources
  • Full audit trail of agent actions to support review and compliance
FAQ

Frequently asked questions

Yes, Scrapingbee requires you to configure your own API key credentials. Once set up, Composio handles secure credential storage and API request handling for you.

Yes! Composio's Tool Router enables agents to use multiple toolkits. Learn more.

Composio is SOC 2 and ISO 27001 compliant with all data encrypted in transit and at rest. Learn more.

Composio maintains and updates all toolkit integrations automatically, so your agents always work with the latest API versions.

Start with Scrapingbee.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Scrapingbee tool your agent needs.Free to start.

Start building