Local-first web scraping, DuckDuckGo search, site mapping and crawling with trafilatura and an optional Firecrawl fallback.
Setup
This project documents no single launch command; follow its repository instructions.
WebCrawl MCP
andyliszewski
Related
More- PPyreCrawlSanggonBoySelf-hosted web scraping server to scrape, crawl, extract, map, search and monitor pages without API keys.Search & Web Data22 Repository stars
- AAnyBrowsekc23goScrapes, crawls and searches the web with real Chrome browsers and converts pages to Markdown for agents, with a limited free tier.Search & Web DataRemote only5 Repository stars
- SScraperAPI MCPScraperAPIOfficialLets agents run ScraperAPI scraping requests with JavaScript rendering, geotargeting, premium proxies and auto-parsing.Search & Web Data5 Repository stars
- SString AI MCPStringOfficialSearches the web, fetches URLs and maps sites as Markdown through the String Web Access API.Search & Web DataLocal + remote4 Repository stars
- AAnyAPI MCPAnyAPIOfficialLocal stdio server for AnyAPI: pay-per-request scraping and data APIs for social media, search results, Google Maps and e-commerce behind one key.Search & Web DataLocal + remote1 Repository stars
- SSerper MCP ServermarcopesaniSearch and webpage scraping through the Serper API, supporting its full parameter set including location.Search & Web Data169 Repository stars