smart-crawler

Name: smart-crawler
Author: shulex-voc

shulex-voc

Smart-crawler is a multi-platform e-commerce data collection system that crawls product listings and customer reviews (VOC)

Setup

Choose your client, copy the config, then fill in any required environment variables.

Add to Cursor Add to VS Code

claude mcp add --transport http smart-crawler https://smartcrawler.io/mcp/ --header 'Authorization: Bearer <API_KEY>'

~/.codex/config.toml

[mcp_servers.smart-crawler]
url = "https://smartcrawler.io/mcp/"
bearer_token_env_var = "SMART_CRAWLER_API_KEY"

# codex mcp add smart-crawler --url https://smartcrawler.io/mcp/ --bearer-token-env-var SMART_CRAWLER_API_KEY
# export SMART_CRAWLER_API_KEY=<API_KEY>

~/.cursor/mcp.json

{
  "mcpServers": {
    "smart-crawler": {
      "url": "https://smartcrawler.io/mcp/",
      "headers": {
        "Authorization": "Bearer <API_KEY>"
      }
    }
  }
}

.vscode/mcp.json

{
  "servers": {
    "smart-crawler": {
      "type": "http",
      "url": "https://smartcrawler.io/mcp/",
      "headers": {
        "Authorization": "Bearer <API_KEY>"
      }
    }
  }
}

~/.gemini/settings.json

{
  "mcpServers": {
    "smart-crawler": {
      "httpUrl": "https://smartcrawler.io/mcp/",
      "headers": {
        "Authorization": "Bearer <API_KEY>"
      }
    }
  }
}

claude_desktop_config.json · Customize › Connectors › Add custom connector

{
  "mcpServers": {
    "smart-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://smartcrawler.io/mcp/",
        "--header",
        "Authorization:${AUTH_HEADER}"
      ],
      "env": {
        "AUTH_HEADER": "Bearer <API_KEY>"
      }
    }
  }
}

.trae/mcp.json

{
  "mcpServers": {
    "smart-crawler": {
      "url": "https://smartcrawler.io/mcp/",
      "headers": {
        "Authorization": "Bearer <API_KEY>"
      }
    }
  }
}

Setup

Related