Synthetic monitoring and CI smoke tests for LLM endpoints: time to first token, latency, throughput and errors, with Prometheus and OpenTelemetry export.
Setup
This project documents no single launch command; follow its repository instructions.
llmprobe
Jwrede
Related
More- LLangfuse MCPavivsinaiQuery Langfuse traces, debug exceptions, analyze sessions and manage prompts for LLM applications.Monitoring & Observability113 Repository stars
- Aagent-interviewcdavid817AI Agent / LLM application engineer Chinese interview question bank: 2,038 questions with reference answersMonitoring & Observability17 Repository stars
- IInternet Speed Test MCPInventerInternet speed testing: download and upload speed, latency, jitter and CDN server detection with geographic mapping.Monitoring & Observability15 Repository stars
- NNetdata MCPNetdataOfficialLets agents explore Netdata observability data (metrics, logs, containers, processes, network connections) for reporting and root cause analysis.Monitoring & Observability81.1k Repository stars
- PPostHog MCPPostHogOfficialLets agents work with PostHog analytics, feature flags, error tracking and more.Monitoring & ObservabilityRemote only40.4k Repository stars
- PPhoenix MCP ServerArize AIOfficialLets agents use Arize Phoenix to inspect traces, manage prompts, curate datasets and run experiments.Monitoring & Observability11.9k Repository stars