$ loading_
Crawl websites, extract links, and capture page content with browser fallback.
Copy the install command and let the AI configure it · recommended for beginners
No copy-paste install info for "crawler-mcp" yet — see the docs or source repo.
Crawl this site's homepage and section pages, extract all article titles and links, deduplicate them, and group the results by section: https://example.com
A deduplicated list of article titles and URLs, grouped by section or source page.
Open this page, use suitable CSS selectors to extract the headline, publish date, author, and article body, then return them in a structured format: https://example.com/post/123
Structured extracted data containing the title, date, author, and main content.
If static fetching fails, use a headless browser to open this product listing page and extract product names, prices, and detail links: https://example.com/shop
A list of visible products from the dynamic page, including names, prices, and detail URLs.
Fetch, crawl, and analyze web pages for SEO, extraction, and research.
Crawl websites, extract dynamic content, and save structured Markdown files.
Crawl web pages and return clean Markdown optimized for LAGM use.
Scrape web pages in bulk with selectors, stealth mode, and automation.
Scrape pages and crawl websites automatically for structured content collection.
Politely scrape websites and extract structured data with bounded async crawling.