crawl-census
Provides preflight checks and domain intelligence so agents can skip domains that will refuse them or charge a fee, covering robots.txt, edge refusals, and HTTP 402 paywalls.
Browser Automation
0 platforms
0 features
Install
Paste the configuration above into your MCP client config (claude_desktop_config.json for Claude Desktop) and restart the client.
No configuration sample provided; see the repository.
Paste the configuration above into your MCP client config (claude_desktop_config.json for Claude Desktop) and restart the client.
Sources: public MCP Server directories. This is an independent third-party directory with no affiliation to or endorsement from the maintainers of the listed servers.
