Tests/benchmarks a third-party LLM endpoint (OpenAI- or Anthropic-compatible): availability, fidelity, speed, concurrency, protocol compliance, quality regression. Use before hand-rolling a curl loop, when onboarding a provider, or debugging "system prompt 不生效" / a tok/s claim — 测评/压测一个模型或渠道. Not for TTS/voice-clone supplier eval (use the audio skill).

version
1.7.0
GitHub stars
1.5K

Install

/plugin install llm-eval-harness@daymade-skills

Run it inside Claude Code after adding the marketplace with /plugin marketplace add daymade/claude-code-skills.

Contents

Discovered from source

Skills 1

Sponsors

Details

Marketplace
daymade/claude-code-skills
Source
llm-eval-harness
Category
developer tools
Keywords
llm, eval, benchmark, model-comparison, speed-test, concurrency, protocol-compliance, tokens-per-second, ttft, thinking-aware, availability, fidelity, system-prompt, gateway-testing, vendor-bug-report

More from daymade/claude-code-skills

All 87