Scrapy MCP Server
A powerful web scraping MCP server built on Scrapy and FastMCP that supports multiple scraping methods (HTTP, Scrapy, browser automation), anti-detection techniques, form handling, and concurrent crawling. Designed for commercial environments with enterprise-grade features like intelligent retry mechanisms, performance monitoring, and configurable data extraction.
浏览器自动化
0 个平台
0 项功能
安装
uvx negentropy-perceives
把上面的配置写入 MCP 客户端的配置文件(Claude Desktop 为 claude_desktop_config.json),重启客户端后生效。
{
"mcpServers": {
"negentropy-perceives": {
"command": "uvx",
"args": [
"negentropy-perceives"
],
"env": {
"SCRAPY_MCP_PROXY_URL": "<SCRAPY_MCP_PROXY_URL>",
"SCRAPY_MCP_USE_PROXY": "<SCRAPY_MCP_USE_PROXY>",
"SCRAPY_DOWNLOAD_DELAY": "<SCRAPY_DOWNLOAD_DELAY>",
"SCRAPY_MCP_MAX_RETRIES": "<SCRAPY_MCP_MAX_RETRIES>",
"SCRAPY_MCP_SERVER_NAME": "<SCRAPY_MCP_SERVER_NAME>",
"SCRAPY_MCP_SERVER_VERSION": "<SCRAPY_MCP_SERVER_VERSION>",
"SCRAPY_CONCURRENT_REQUESTS": "<SCRAPY_CONCURRENT_REQUESTS>",
"SCRAPY_MCP_BROWSER_TIMEOUT": "<SCRAPY_MCP_BROWSER_TIMEOUT>"
}
}
}
}把上面的配置写入 MCP 客户端的配置文件(Claude Desktop 为 claude_desktop_config.json),重启客户端后生效。
数据来源:公开的 MCP Server 目录。本站为独立第三方目录,与各 MCP Server 维护方均无隶属或背书关系;名称与简介如实标注,介绍文案由本站再加工。