Scrapegraph ai MCP for AI Agents

Securely connect your AI agents and chatbots (Claude, ChatGPT, Cursor, etc) with Scrapegraph ai MCP or direct API to scrape websites, extract structured tables, summarize online content, and automate data collection through natural language.

Scrapegraph ai logoScrapegraph ai
Api Key

Scrapegraph ai is an AI-powered web scraping API that lets you extract structured data from any website using natural language prompts. Easily turn web pages into ready-to-use data for your apps and agents.

27 Tools

Try Scrapegraph ai now

Type what you want done — sign in and watch it run live in the Tool Router playground.

TOOL ROUTER PLAYGROUND
Scrapegraph ai
Try asking
TOOLS

Supported Tools

Every Scrapegraph ai action and event your agent gets out of the box.

Convert Webpage to Markdown (V2)

Tool to convert any webpage into clean, well-formatted Markdown with full parameter control.

Generate Schema

Generate or modify a JSON schema based on a search query for structured data extraction.

Get Agentic Scraper History

Retrieve paginated history of agentic scraper jobs.

Get Crawler History

Retrieve the history of crawler jobs for your account.

Get Credits

Retrieve remaining and used credits for your ScrapeGraphAI account.

Get Endpoint Suggestions

Tool to get AI-powered suggestions for creating scraping endpoints.

Get Live Session URL

Tool to get a URL for a live browser session.

Get Markdownify History

Tool to retrieve the history of markdownify webpage-to-Markdown conversion jobs.

Get Scrape History

Retrieve the history of scrape jobs from your ScrapeGraphAI account.

Get Searchscraper History

Get the history of searchscraper jobs with pagination support.

Get Sitemap History

Tool to retrieve the history of sitemap extraction jobs.

Get Smartscraper History

Tool to retrieve the history of smartscraper jobs.

Get Usage Timeline

Tool to retrieve usage timeline statistics for your ScrapeGraphAI account.

Get Webhook Logs

Tool to retrieve webhook delivery logs for a crawler job.

List Scheduled Jobs

Retrieve a paginated list of all scheduled scraping jobs for your account.

Markdownify Status

Check the status and retrieve results of a Markdownify webpage-to-Markdown conversion job.

Save Endpoint Configuration

Tool to save custom scraping endpoint configurations to ScrapeGraphAI.

Search Scraper

Perform AI-powered web searches with structured, parsed results.

Check SearchScraper Status

Check the status and results of an asynchronous SearchScraper job.

SmartCrawler Status

Check the status and retrieve results of a SmartCrawler web crawling job.

Start Smart Scraper

Start AI-powered web scraping with natural language extraction prompts.

SmartScraper Status

Check the status and retrieve results of a SmartScraper web scraping job.

Start Smart Crawler (Async)

Tool to start a multi-page web crawl using SmartCrawler for AI-powered data extraction.

Submit Feedback

Submit feedback and ratings for completed ScrapeGraphAI requests.

Submit Product Feedback

Submit product feedback for ScrapeGraphAI.

Convert JSON to TOON Format

Tool to convert JSON data to TOON (Token-Oriented Object Notation) format.

Validate API Key

Validate your ScrapeGraphAI API key to ensure it is active and authorized.

SETUP GUIDE

Connect Scrapegraph ai MCP Tool with your Agent

1

Install Composio

typescript
npm install @composio/core ai @ai-sdk/openai @ai-sdk/mcp
Install the Composio SDK and Claude Agent SDK
2

Create Tool Router Session

typescript
import { Composio } from '@composio/core';

const composio = new Composio({ apiKey: 'your-api-key' });

console.log("Creating Tool Router session...");
const { mcp } = await composio.create('your-user-id');
console.log(`Tool Router session created: ${mcp.url}`);
Initialize the Composio client and create a Tool Router session
3

Connect to AI Agent

typescript
import { openai } from '@ai-sdk/openai';
import { experimental_createMCPClient as createMCPClient } from '@ai-sdk/mcp';
import { generateText, stepCountIs } from 'ai';

const client = await createMCPClient({
  transport: {
    type: 'http',
    url: mcp.url,
    headers: { 'x-api-key': 'your-composio-api-key' }
  }
});

const tools = await client.tools();

const { text } = await generateText({
  model: openai('gpt-4o'),
  tools,
  messages: [{ role: 'user', content: 'Extract all product titles from https://example.com/shop' }],
  stopWhen: stepCountIs( 5 )
});

console.log(`Agent: ${text}`);
Use the MCP server with your AI agent
SETUP GUIDE

Connect Scrapegraph ai API Tool with your Agent

1

Install Composio

typescript
npm install @composio/openai
Install the Composio SDK
2

Initialize Composio and Create Tool Router Session

typescript
import OpenAI from 'openai';
import { Composio } from '@composio/core';
import { OpenAIResponsesProvider } from '@composio/openai';

const composio = new Composio({
  provider: new OpenAIResponsesProvider(),
});
const openai = new OpenAI({});
const session = await composio.create('your-user-id');
Import and initialize Composio client, then create a Tool Router session
3

Execute Scrapegraph ai Tools via Tool Router with Your Agent

typescript
const tools = session.tools;
const response = await openai.responses.create({
  model: 'gpt-4.1',
  tools: tools,
  input: [{
    role: 'user',
    content: 'Extract product prices from the first page of https://www.example.com/shop'
  }],
});
const result = await composio.provider.handleToolCalls(
  'your-user-id',
  response.output
);
console.log(result);
Get tools from Tool Router session and execute Scrapegraph ai actions with your Agent

Why Use Composio?

AI Native Scrapegraph ai Integration

  • Supports both Scrapegraph ai MCP and direct API based integrations
  • Structured, LLM-friendly schemas for reliable tool execution
  • Rich coverage for reading, writing, and querying your Scrapegraph ai data

Managed Auth

  • Built-in OAuth handling with automatic token refresh and rotation
  • Central place to manage, scope, and revoke Scrapegraph ai access
  • Per user and per environment credentials instead of hard-coded keys

Agent Optimized Design

  • Tools are tuned using real error and success rates to improve reliability over time
  • Comprehensive execution logs so you always know what ran, when, and on whose behalf

Enterprise Grade Security

  • Fine-grained RBAC so you control which agents and users can access Scrapegraph ai
  • Scoped, least privilege access to Scrapegraph ai resources
  • Full audit trail of agent actions to support review and compliance
FAQ

Frequently asked questions

Yes, Scrapegraph ai requires you to configure your own API key credentials. Once set up, Composio handles secure credential storage and API request handling for you.

Yes! Composio's Tool Router enables agents to use multiple toolkits. Learn more.

Composio is SOC 2 and ISO 27001 compliant with all data encrypted in transit and at rest. Learn more.

Composio maintains and updates all toolkit integrations automatically, so your agents always work with the latest API versions.

Start with Scrapegraph ai.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Scrapegraph ai tool your agent needs.Free to start.

Start building