Scan, identify, and manage website bot traffic for security and visibility.
Copy the install command and let the AI configure it · recommended for beginners
No copy-paste install info for "mcp-bot-crawler" yet — see the docs or source repo.
Scan bot traffic on my website, identify the most active crawlers in the last 7 days, classify them into search engines, monitoring tools, and suspicious bots, and provide risk levels and mitigation recommendations.
A bot traffic analysis report with classifications, anomalous sources, risk assessments, and mitigation recommendations.
Based on current bot activity on my website, generate a governance policy: allowed search engine bots, high-frequency bots to rate-limit, and suspicious sources to block, with rationale for each rule.
An actionable bot governance rule set with classification logic and policy explanations.
Analyze how bot traffic affects website bandwidth, response time, and key page access, identify the most resource-intensive bot behaviors, and suggest optimization and protection measures.
An impact assessment describing resource-heavy bot activity and related performance optimization steps.
Politely scrape websites and extract structured data with bounded async crawling.
Helps AI agents scrape web pages compliantly with provenance.
Scan MCP tool descriptions for prompt injection and privilege escalation risks.
Search, crawl, and collect structured web data through an MCP server.
Analyze MCP tool security risks, detect malicious behavior, and provide risk scores.
Scrape websites, extract structured data, and capture screenshots with bot bypass.