Qortora · Search · Indexed page

xgrammar.mlc.aiFetched 2026-08-15T11:14:21Z

XGrammar | Home

WebLLM: High-Performance In-Browser LLM Inference Engine

Open original source · Full cached text

XGrammar | Home Home Docs Github XGrammar: Efficient, Flexible and Portable Structured Generation GitHub Documentation Overview XGrammar is open-source solution for flexible, portable, and fast structured generations, aiming at bring flexible zero-overhead structure generation everywhere. It supports general context-free grammar to enable a broad range of structures while bringing careful system optimizations to enable fast executions. XGrammar features a minimal and portable C++ backend that can be easily integrated into multiple environments and frameworks, and is co-designed with the LLM inference engine and enables zero-overhead structured generation in LLM inference. Get Started Please visit our documentation to get started with XGrammar. Installation Quick start Links XGrammar Github