mcp scrape copilot

Local 2025-08-31 23:12:18 0
Browser Automation @jwaldor/mcp-scrape-copilot

Enables LLMs to perform web browsing tasks, take screenshots, and execute JavaScript using Puppeteer for browser automation.

A Model Context Protocol server that provides browser automation capabilities using Puppeteer. This server enables LLMs to interact with web pages, take screenshots, and execute JavaScript in a real browser environment.

Components

Tools

  • puppeteer_navigate
  • Navigate to any URL in the browser

  • Input: url (string)

  • puppeteer_screenshot

  • Capture screenshots of the entire page or specific elements

  • Inputs:

    • name (string, required): Name for the screenshot
    • selector (string, optional): CSS selector for element to screenshot
    • width (number, optional, default: 800): Screenshot width
    • height (number, optional, default: 600): Screenshot height

  • puppeteer_click

  • Click elements on the page

  • Input: selector (string): CSS selector for element to click

  • puppeteer_hover

  • Hover elements on the page

  • Input: selector (string): CSS selector for element to hover

  • puppeteer_fill

  • Fill out input fields

  • Inputs:

    • selector (string): CSS selector for input field
    • value (string): Value to fill

  • puppeteer_select

  • Select an element with SELECT tag

  • Inputs:

    • selector (string): CSS selector for element to select
    • value (string): Value to select

  • puppeteer_evaluate

  • Execute JavaScript in the browser console
  • Input: script (string): JavaScript code to execute

Resources

The server provides access to two types of resources:

  1. Console Logs (console://logs)
  2. Browser console output in text format

  3. Includes all console messages from the browser

  4. Screenshots (screenshot://<name>)

  5. PNG images of captured screenshots
  6. Accessible via the screenshot name specified during capture

Key Features

  • Browser automation
  • Console log monitoring
  • Screenshot capabilities
  • JavaScript execution
  • Basic web interaction (navigation, clicking, form filling)

Configuration to use Puppeteer Server

Here's the Claude Desktop configuration to use the Puppeter server:

Docker

NOTE The docker implementation will use headless chromium, where as the NPX version will open a browser window.

{
  "mcpServers": {
    "puppeteer": {
      "command": "docker",
      "args": ["run", "-i", "--rm", "--init", "-e", "DOCKER_CONTAINER=true", "mcp/puppeteer"]
    }
  }
}

NPX

{
  "mcpServers": {
    "puppeteer": {
      "command": "npx",
      "args": ["-y", "@modelcontextprotocol/server-puppeteer"]
    }
  }
}

Build

Docker build:

docker build -t mcp/puppeteer -f src/puppeteer/Dockerfile .

License

This MCP server is licensed under the MIT License. This means you are free to use, modify, and distribute the software, subject to the terms and conditions of the MIT License. For more details, please see the LICENSE file in the project repository.

[
  {
    "description": "Navigate to a URL",
    "inputSchema": {
      "properties": {
        "url": {
          "type": "string"
        }
      },
      "required": [
        "url"
      ],
      "type": "object"
    },
    "name": "puppeteer_navigate"
  },
  {
    "description": "Get the history of visited URLs, most recent urls first",
    "inputSchema": {
      "properties": {},
      "required": [],
      "type": "object"
    },
    "name": "puppeteer_page_history"
  },
  {
    "description": "Make an HTTP request with curl",
    "inputSchema": {
      "properties": {
        "body": {
          "description": "Body to include in the request",
          "type": "object"
        },
        "headers": {
          "description": "Headers to include in the request",
          "type": "object"
        },
        "type": {
          "description": "Type of the request. GET, POST, PUT, DELETE",
          "type": "string"
        },
        "url": {
          "description": "Url to make the request to",
          "type": "string"
        }
      },
      "required": [
        "type",
        "url",
        "headers",
        "body"
      ],
      "type": "object"
    },
    "name": "make_http_request"
  },
  {
    "description": "Semantically search for requests that occurred within a page URL. Returns the top 10 results.",
    "inputSchema": {
      "properties": {
        "page_url": {
          "description": "The page within which to search for requests",
          "type": "string"
        },
        "query": {
          "description": "Your search request. Make this specific and detailed to get the best results",
          "type": "string"
        }
      },
      "required": [
        "query",
        "page_url"
      ],
      "type": "object"
    },
    "name": "semantic_search_requests"
  }
]