Sglang

If you're building agents or chat systems with LLMs, this wrapper gives you structured outputs and automatic prefix caching through SGLang's RadixAttention. The real win is when you have repeated prefixes like system prompts or tool definitions. It'll cache them automatically and reportedly decode JSON about 3× faster than standard approaches. It's overkill if you just need basic text generation, but for agentic workflows with function calling or multi-turn conversations where context gets reused, the performance gains are tangible. The skill has passed security audits from Gen Agent Trust Hub, Socket, and Snyk.

Install to Claude Code

npx -y skills add davila7/claude-code-templates --skill sglang --agent claude-code