scrapy
v0.1.0by scrapy · author: Scrapy developers
Scrapy support for AI agents: a Scrapy skill and a Scrapy MCP server.
What scrapy does, in the publisher's words
scrapy-agent-plugin
An agent plugin that improves Scrapy support in coding agents:
- a scrapy skill with instructions for working on Scrapy projects;
- a Scrapy MCP server_ that allows agents to connect to running crawls and inspect them.
This repository contains plugins for the following standards, usable with the same URL:
- Agent Plugins_
From the project README, punctuation lightly normalized · Open the README on GitHub
- Skills
- 1
- MCP servers
- 1
- Stars
- 6
- License
- Apache-2.0
- Repo created
- 2026-09-04
- Last pushed
- 2026-09-10
- Publisher type
- Organization
- Version
- 0.1.0
Links
Skills · 1
- scrapy
- Use when working on a Scrapy project, writing or debugging spiders, running or inspecting crawls.
Descriptions come from the frontmatter of each SKILL.md, punctuation lightly normalized.
MCP servers · 1
- scrapy-mcpstdio
- uvx --from scrapy-mcp-official scrapy-mcp
Read from the plugin's own mcp.json. We list environment variable names, never values.
Category
Research & Search. Assigned by this directory. Agent Plugins 1.0.0 has no category field, so no manifest declares one.
Keywords
scrapy · web-scraping · crawling · mcp
Related by publisher and keywords
A Model Context Protocol server with Exa for web search, code search, and web crawling. Provides real-time web searches with configurable tool selection, allowing users to enable or disable specific search capabilities.
Stealthy headless browser service for AI agents. Bypasses anti-bot protections and returns clean, LLM-friendly Markdown.
MCP server for web scraping: extract clean markdown, links, and metadata from any URL.
Everything an agent needs to use Octoparse. Collect web data through 670+ maintained templates or the tasks you configured yourself, run it in Octoparse's cloud, and get structured rows back, with the MCP connection and authorization handled by the same install.
World Monitor agent plugin: live global-intelligence MCP servers plus task-focused agent skills for country risk, conflict, markets, chokepoints, energy, climate, and related situational awareness.
Up-to-date documentation lookup. Pull version-specific documentation and code examples directly from source repositories into your coding agent's context.
[](https://agentpluginsdirectory.com/plugins/scrapy)✓ Verified . We fetched the manifest from GitHub and checked it against the official Agent Plugins 1.0.0 schema at agent-plugins.org.