Search & Web Data
4,609 results
- Crawl CensustaylorsmithggAsk before you fetch. Skip domains that will refuse your crawler, and never route around an HTTP 402 paywall. JS + Python, zero dependencies.
- crawl-readinessGrubbomaticMCP server that checks a website's AI readiness: can GPTBot, ClaudeBot, PerplexityBot and 50+ other AI crawlers access it? Generates llms.txt, AI-crawler robots.txt and JSON-LD, and reads LLM Monitor trends. For Claude Desktop, Cursor, Cline and Windsurf.
- Crawl4Agentsaastemlycrawl4ai-compatible web crawler API: POST a URL, get clean LLM-ready Markdown with fit_markdown...
- Crawlbasepipeworx-ioCrawlbase MCP — wraps the Crawlbase Crawling API (crawlbase.com, formerly
- CrawlCheckemmanuelortaOpen readers behind CrawlCheck, the verification layer for the agentic web: robots.txt policy per crawler and agent, user-agent group shadowing detection, and request verification against operators' published IP feeds.
- CrawlConsolecrawlconsoleBacklink Analysis MCP for AI Agents: authority, referring domains, and competitor link gaps.
- Crawler IP Verifier - real Googlebot or fakeworkers{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key
- Crawler Log Triageworkers{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key
- CrawlerData: Google Shopping & SERPcrawlerdataGoogle Shopping products and seller prices, plus Google Search, Images, News and Local results.
- Crawlgraphpipeworx-ioCrawlGraph MCP — backlink intelligence on the public Common Crawl webgraph
- crawlinx-mcpim-ffFree technical-SEO audit MCP: crawl a site, run checks, return an LLM-ready shareable report.
- CrawlRavencrawlravenRead Search Console performance, keyword opportunities and annotations for your sites.
- CrawlwisecrawlwiseSEO audits and AI crawler checks. Honest findings only; no invented scores.
- CreateMod.com SchematicscreatemodA Claude plugin for createmod.com to search for Minecraft Schematics for the Create Mod
- CreativeScope — Mobile Game Ad Creative IntelligencecreativescopeOfficial MCP server for CreativeScope — search mobile game ad creatives across AppLovin, Mintegral, Unity, ironSource, Vungle, Pangle, AdMob & TikTok; plus App Store / Google Play ranking tools and 5 ready-made Agent Skills.
- Creator SKILL — Influencer DiscoverydeinaiAI influencer search on TikTok, Instagram, YouTube. Deinai MCP token required; credits per result.
- Creator SKILL v2 — Influencer DiscoverydeinaiSKILL-02 (not SKILL-01): AI influencer search on TikTok, Instagram & YouTube. sk_live_ token.
- CreatorsCompanioncreatorscompanionUse CreatorsCompanion inside Claude, ChatGPT, Codex, Cursor and Gemini: write social content in your voice, plan your week, research what works.
- creditcards.bestcreditcardsSearch, compare and estimate rewards across US credit cards. Verified fees, APRs and bonuses.
- CrelacrelaSearch the Crela software marketplace and publish, update and review your software from your agent.
- CriercrierCrier — the bulletin board for agents. Post, search, subscribe. REST + MCP.
- Crimson CrawlercrimsoncrawlerEnrich, search, assess, and manage threat intelligence through 80+ typed MCP tools.
- CromausecromaColombian, Peruvian, and Mexican public data: judicial cases, registries, legislation, web search.
- Crossrefpipeworx-ioMCP server for searching academic papers, journals, and citations via the Crossref API