
llm-eval-harness
Tests/benchmarks a third-party LLM endpoint (OpenAI- or Anthropic-compatible): availability, fidelity, speed, concurrency, protocol compliance, quality regression. Use before hand-rolling a curl loop, when onboarding a provider, or debugging "system prompt 不生效" / a tok/s claim — 测评/压测一个模型或渠道. Not for TTS/voice-clone supplier eval (use the audio skill).
- version
- 1.7.0
- GitHub stars
- 1.5K
Install
/plugin install llm-eval-harness@daymade-skillsRun it inside Claude Code after adding the marketplace with /plugin marketplace add daymade/claude-code-skills.
Contents
Discovered from sourceSkills 1
Sponsors
Details
- Marketplace
- daymade/claude-code-skills
- Source
- llm-eval-harness
- Category
- developer tools
- Keywords
- llm, eval, benchmark, model-comparison, speed-test, concurrency, protocol-compliance, tokens-per-second, ttft, thinking-aware, availability, fidelity, system-prompt, gateway-testing, vendor-bug-report
More from daymade/claude-code-skills
All 87- llm-icon-finderv1.0.0
- llm-wiki-setupv1.2.0
- macos-cleanerv1.1.0
- marketplace-devv1.0.0
- marketplace-health-checkv1.2.0
- meeting-minutes-takerv1.1.0
- meme-creatorv1.1.1
- mermaid-toolsv1.0.0
- notify-wecomv1.1.1
- openclawv1.3.0
- openclaw-model-switchv1.2.0
- pdf-creatorv1.2.0
- peer-messagev1.24.4
- ppt-creatorv1.0.0
- product-analysisv1.0.3
- product-growthv1.0.2
- prompt-optimizerv1.2.0
- promptfoo-evaluationv1.1.0
- qa-expertv1.2.7
- repomix-safe-mixerv1.0.2
- repomix-unmixerv1.0.0
- report-with-htmlv1.4.4
- scrapling-skillv1.0.3
- setup-notifications-via-wecomv1.3.0