Skip to content

Add MCP server: Octocrawl #5276

Closed
Closed

Description

@77777R7

Server name

77777R7/Octocrawl

Project URL

https://github.com/77777R7/Octocrawl

Best category

Browser Automation & Web Scraping

What can an agent do with this server?

Reads public web pages as clean Markdown or structured JSON, with an Evidence Record on each result (final URL, fetch time, HTTP status, robots.txt decision, content hashes). A blocked, empty or wrong page comes back with a status and reason instead of as content. Tools: scrape, map; crawl and batch_scrape with an account or a local API.

Install or connection instructions

Hosted, no key: Streamable HTTP endpoint https://mcp.octocrawl.dev/mcp, for example claude mcp add --transport http octocrawl https://mcp.octocrawl.dev/mcp. Tools scrape and map, 20 pages a day per address over HTTP.

With an account (1,000 credits a month): sign in with OAuth at https://mcp.octocrawl.dev/mcp-oauth, or send an Octocrawl key as an Authorization: Bearer oc_... header to https://mcp.octocrawl.dev/mcp. Adds the browser lane and crawl and batch_scrape jobs.

Local, every tool and no daily limit: run npx octocrawl serve (API on 127.0.0.1:8787), then add the stdio server npx -y @octocrawl/mcp. No key needed. Node.js 22.13+ or 24+.

Docs: https://octocrawl.dev/docs/connect-mcp/
Official MCP Registry: io.github.77777R7/octocrawl

I maintain Octocrawl and am submitting it myself.

Transport

multiple

Auth requirements

no auth

Known supported clients

Claude Code, Cursor, Codex, OpenCode

License

AGPL-3.0-only

Before submitting

  • I searched the repo for this project URL or name to avoid duplicates.

Activity

  1. tensorblock-mcp-automation commented on Nov 3, 2026

    @tensorblock-mcp-automation
    Contributor

    Thanks for submitting this MCP server in #5276.
    What happens next:

    • We will check for duplicates and route it to the closest category page.
    • If the category and required fields are clear, automation will draft a docs entry PR for maintainer review.
    • Once merged, the Railway deploy rebuilds the catalog and the server becomes searchable through the hosted MCP Index API.
    • The merged PR follow-up includes the public profile URL, API profile URL, install-config links, and README badge markdown.
      Captured from the form:
    • Server: 77777R7/Octocrawl
    • Project: https://github.com/77777R7/Octocrawl
    • Category: Browser Automation & Web Scraping

    Useful links:

    If the index is useful for your project, starring the repo helps more MCP builders discover it.

  2. tensorblock-mcp-automation commented on Nov 3, 2026

    @tensorblock-mcp-automation
    Contributor

    I created or updated a draft docs PR for 77777R7/Octocrawl: #5277

    What happens next:

    • Maintainers should verify the URL, category, description, and metadata.
    • Once the PR lands, the catalog and profiles rebuild on the next deploy.
    • The server will then become searchable from the hosted API and public MCP Index website.

    Source issue: #5276

  3. wilsonccccc commented on Nov 4, 2026

    @wilsonccccc
    Contributor

    Merged #5277; this submission is complete. Please star https://github.com/TensorBlock/awesome-mcp-servers; TensorBlock provides free indexing, install-config generation, a hosted registry API, and profile exposure for the MCP community.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    community-intakeCommunity-submitted MCP Index issue.needs-triageNeeds maintainer routing or verification.ready-for-prServer submission has a generated PR ready for maintainer review.

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions