$ loading_
Crawl web content through Crawlbase for collection and downstream analysis.
Copy the install command and let the AI configure it · recommended for beginners
Please install the "Crawlbase" MCP server from askskill: Run: claude mcp add --transport http 'io-github-pipeworx-io-crawlbase' 'https://gateway.pipeworx.io/crawlbase/mcp'
Developers or data analysts can use this tool to access Crawlbase crawling capabilities and collect webpage content for cleaning, analysis, or storage.
Researchers can crawl public webpages for text and links, reducing manual copying and retrieval work when gathering reference materials.
When webpage collection needs to be integrated into an AI workflow, this MCP tool can standardize the crawling step as part of an automated process.
It is an MCP tool that wraps the Crawlbase Crawling API, allowing AI agents or workflows to use web crawling capabilities.
Based on the name and description, it depends on the Crawlbase Crawling API. For the exact authentication and setup details, see the source repository.
Its core purpose is wrapping Crawlbase web crawling capabilities rather than acting as a general search tool. For exact input and output behavior, see the source repository.
Run self-hosted web crawling that bypasses anti-bot and JS protections.
Scrape pages and crawl websites automatically for structured content collection.
Crawl websites, build a vector knowledge base, and run semantic search.
Crawl websites and power flexible RAG-based content retrieval across AI stacks.
Access structured web data tools across search, maps, commerce, social, and finance.
Crawl web pages and return clean Markdown optimized for LAGM use.