Adaptive Python web scraping toolkit + MCP server for AI agents. Self-healing selectors that survive site changes, TLS-fingerprint stealth to bypass anti-bot filters, CSS/XPath parsing, and 24 built-in scrapers, clean, structured, LLM-ready data from any URL.
Setup
Choose your client, copy the config, then fill in any required environment variables.
claude mcp add pyscrappy --env OMDB_API_KEY='<OMDB_API_KEY>' -- uvx pyscrappy~/.codex/config.toml
[mcp_servers.pyscrappy]
command = "uvx"
args = ["pyscrappy"]
env = { OMDB_API_KEY = "<OMDB_API_KEY>" }
# codex mcp add pyscrappy --env OMDB_API_KEY='<OMDB_API_KEY>' -- uvx pyscrappy~/.cursor/mcp.json
{
"mcpServers": {
"pyscrappy": {
"command": "uvx",
"args": [
"pyscrappy"
],
"env": {
"OMDB_API_KEY": "<OMDB_API_KEY>"
}
}
}
}.vscode/mcp.json
{
"servers": {
"pyscrappy": {
"type": "stdio",
"command": "uvx",
"args": [
"pyscrappy"
],
"env": {
"OMDB_API_KEY": "<OMDB_API_KEY>"
}
}
}
}~/.gemini/settings.json
{
"mcpServers": {
"pyscrappy": {
"command": "uvx",
"args": [
"pyscrappy"
],
"env": {
"OMDB_API_KEY": "<OMDB_API_KEY>"
}
}
}
}claude_desktop_config.json
{
"mcpServers": {
"pyscrappy": {
"command": "uvx",
"args": [
"pyscrappy"
],
"env": {
"OMDB_API_KEY": "<OMDB_API_KEY>"
}
}
}
}.trae/mcp.json
{
"mcpServers": {
"pyscrappy": {
"command": "uvx",
"args": [
"pyscrappy"
],
"env": {
"OMDB_API_KEY": "<OMDB_API_KEY>"
}
}
}
}Environment variables
OMDB_API_KEY
Replace the placeholders with your own credentials and keep them out of version control.