Claude Marketplaces
SkillsMCP serversMarketplacesDigestTools
Submit

This week in Claude

Every Monday: Claude Code, Agent SDK, MCP, and the Anthropic platform moves worth your time.

Skills by category
Frontend DevelopmentBackend & APIsTesting & QASecurityDevOps & CI/CDGit & Pull RequestsDocumentationCode Review & QualityAI & Agent BuildingSkill Development
MCP servers by category
Sales & MarketingWeb & Browser AutomationDatabasesAI & LLM ToolsCloud & InfrastructureCommunication & MessagingDeveloper ToolsDesign & CreativeDocuments & KnowledgeSearch & Web Crawling
Marketplaces by category
AI Agents & OrchestrationLLM IntegrationDevelopment ToolsFrontend & UIBackend & APIsDatabasesTesting & Code QualityDevOps & CloudSecurity & ComplianceGit & Version Control
Claude Marketplaces

An independent directory of skills, plugins and MCP servers for Claude Code. Not affiliated with Anthropic.

Browse

  • Skills
  • MCP servers
  • Marketplaces
  • Weekly digest
  • Skill index
  • MCP index
  • Marketplace index

Site

  • About
  • Tools
  • Submit
  • Feedback
  • Privacy
  • llms.txt
  • Plugins reference

Maker

  • Agent Caffeine
  • knobs
  • Wax
  • Snug
  • mertduzgun.com
Made by mertduzgun.com
Skills/DevOps & CI/CD
intertwine avatar

Dspy Evaluation Harness

intertwine/dspy-agent-skills

You need this the moment you start wondering why your DSPy optimizer isn't improving.

GitHub stars
250
last updated
May 25, 2026
View on GitHubSave

Install

$ npx -y skills add intertwine/dspy-agent-skills --skill dspy-evaluation-harness --agent claude-code

Installs into .claude/skills of the current project.

Sponsors

CodeRabbitSponsoredTry For FreeLid closed, agents workingTry itOpen StepsSponsoredDownload for freeAppSignalSponsoredStart Free TrialKeep API keys from agentsGet SnugBlock apps on your iPhoneGet WaxDevtools for design engineersTry it livebelt - the only tool your agent needsSponsoredone prompt install

What it does

The real insight here is that GEPA lives or dies on rich textual feedback, not just scores. Returns a `dspy.Prediction(score=..., feedback=...)` instead of a dict (which breaks parallel aggregation), shows you how to build multi-axis metrics that actually teach the optimizer something useful, and hammers home the separate valset rule because optimizers overfit frighteningly fast. The canonical example walks through correctness plus citation plus conciseness with specific feedback strings. Also covers CI integration with cached LMs and the usual tracing hooks for MLflow and Weights & Biases. If your metric is a bare float, you're leaving signal on the table.

Files

Select a file.

Details

Repository
github.com/intertwine/dspy-agent-skills
Categories
DevOps & CI/CD, Documentation, AI & Agent Building, Debugging
License
MIT
First seen
Jun 11, 2026

More from intertwine/dspy-agent-skills

All 5
  • Dspy Fundamentals
  • Dspy Gepa Optimizer
  • Dspy Rlm Module
  • Dspy Advanced Workflow

Recommended

More DevOps & CI/CD
1kubesphere avatarwhizard-notificationkubesphere/kubesphereThis handles the notification layer for KubeSphere's observability stack, routing alerts from Prometheus, Kubernetes events, audit logs,...0installs
2microck avataraws-cdk-developmentmicrock/ordinary-claude-skillsAWS Cloud Development Kit (CDK) expert for building cloud infrastructure with TypeScript/Python. Use when creating CDK stacks, defining CDK constructs, implemen0installs
3microck avataraws-cost-operationsmicrock/ordinary-claude-skillsThis skill provides AWS cost optimization, monitoring, and operational best practices with integrated MCP servers for billing analysis, cost estimation, observa0installs
4noobnooc avatarwtfnoobnooc/agentPre-launch and pre-commit audit for vibe coding projects. Use when asked to check whether a project is ready to ship, deploy, merge, or commit, especially for c0installs
5noobnooc avatarwtfnoobnooc/noobnoocPre-launch and pre-commit audit for vibe coding projects. Use when asked to check whether a project is ready to ship, deploy, merge, or commit, especially for c0installs
6Synerise avatarpush-mrSynerise/synerise-designPush current branch to origin, create a GitLab MR if one doesn't exist, and monitor the pipeline until completion0installs