Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 18.9k 3.1k

2. sgl-project/ome sgl-project/ome Public

   OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)

   Go 290 43

3. sgl-project/genai-bench sgl-project/genai-bench Public

   Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

   Python 219 24

4. oracle/langchain-oracle oracle/langchain-oracle Public

   The Oracle LangChain integration provides official LangChain support for Oracle’s Generative AI and AI Platform services, enabling developers to build intelligent, secure, and scalable applications…

   Python 27 9