Sglang - AI Skill | Natoma

orchestra-research

Sglang

by @orchestra-research

Type

Instruction

Platforms

Claude CodeClaude.aiAPI

Best for

developermanager

Resources

Source Repository Author

Sglang

This skill speeds up structured generation and agent workflows with prefix caching for JSON outputs and tool calls, boosting latency and throughput.

Try it out

Help me use the Sglang skill effectively.

How it works

This skill speeds up structured generation and agent workflows with prefix caching for JSON outputs and tool calls, boosting latency and throughput.

Tags

performancebackendapiautomationaianalytics