SGLang

SGLang: Efficient Execution of Structured Language Model Programs

Large language models (LLMs) are increasingly utilized for complex tasks requiring multiple generation calls, advanced prompting techniques, control flow, and…