microsoft/llm-42

Commits: 745

apt-team-018/sglang-usf

Commits: 680

microsoft/ltp-sglang

Commits: 532

sgl-project/sglang

SGLang is a fast serving framework for large language models and vision language models.

Commits: 202

InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Commits: 40

sgl-project/sgl-learning-materials

Materials for learning SGLang

Commits: 21

flashinfer-ai/flashinfer

FlashInfer: Kernel Library for LLM Serving

Commits: 16

zhyncs/lmdeploy-build

Commits: 12

flashinfer-ai/flashinfer-nightly

Commits: 9

zhyncs/zhyncs.github.io

Commits: 8

zhyncs/zhyncs

Commits: 8

basetenlabs/sglang-workshop

Workshop materials for AI Engineer World's Fair

Commits: 7

yigitarda/c

Commits: 4

binhangyuan/deepseek-v3-test

Commits: 4

uncle-iroh-420/deepseek-v3

Commits: 4

schoolsinrwanda/deepseekfile

Commits: 4

manicpixiedigifairy/deepseekv3

Commits: 4

nemoopla/testo

Commits: 4

bobryk0999/deep-speekv3

Commits: 4

sgl-project/sgl-project.github.io

This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.

Commits: 4

lightseekorg/tokenspeed

Commits: 4

wandington/deepseek

Commits: 4

smartx-api/deepseek-v3

Commits: 4

dimamend/deepseek-v3

Commits: 4

deepseek-ai/deepseek-v3

Commits: 4

andrew/vllm

Commits: 3

kenvix/vllm-mod

VLLm with some additional features [GC, maxtoken] mod

Commits: 3

basetenlabs/truss-examples

Examples of models deployable with Truss

Commits: 3

red-hat-data-services/vllm-rocm

Commits: 3

red-hat-data-services/vllm-cpu

Commits: 3

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Commits: 3

IBM/vllm

Commits: 3

efeslab/vllm

Commits: 3

zhyncs/sglang-fork-sync

Commits: 2

sgl-project/specforge

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

Commits: 2

FasterDecoding/Medusa

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

Commits: 1

sgl-project/sgl-kernel-npu

SGLang kernel library for NPU

Commits: 1

flashinfer-ai/flashinfer-bench

Commits: 1

Traceerickson/Awesome-LLM

Commits: 1

kvcache-ai/Mooncake

Commits: 1

mlc-ai/xgrammar

Fast, Flexible and Portable Structured Generation

Commits: 1

IBM/Granite-vLLM

Commits: 1

lm-sys/lm-sys.github.io

Commits: 1

QwenLM/Qwen3

Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.

Commits: 1

chenshuo/muduo

Event-driven network library for multi-threaded Linux server in C++11

Commits: 1

jbampton/tvm

Commits: 1

tqchen/test

Commits: 1

deepseek-ai/DeepSeek-V2

Commits: 1

lightseekorg/smg

Commits: 1

SafeAILab/EAGLE

Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3.

Commits: 1

SafeAILab/EAGLE

Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3.

Commits: 1

Hannibal046/Awesome-LLM

Awesome-LLM: a curated list of Large Language Model

Commits: 1

sgl-project/DeepGEMM

Commits: 1

kenzok8/trojan

Commits: 1

sgl-project/ome

Commits: 1

tw93/MiaoYan

⛷ Lightweight Markdown app to help you write great sentences. ⛷ 轻灵的 Markdown 笔记本伴你写出妙言

Commits: 1

dmlc/tvm

Commits: 1

selinyldrm/distributed-speculative-decoding

Commits: 1

ldlinglingling/eagle3_for_minicpm4

根据MiniCPM4训练Eagle3的投机解码模型

Commits: 1

gpu-mode/lectures

Material for gpu-mode lectures

Commits: 1

alibaba/rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Commits: 1

QwenLM/Qwen2.5

Qwen2.5 is the large language model series developed by Qwen team, Alibaba Cloud.

Commits: 1

modelscope/modelscope

ModelScope: bring the notion of Model-as-a-Service to life.

Commits: 1

trojan-gfw/trojan

An unidentifiable mechanism that helps you bypass GFW.

Commits: 1

apache/tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

Commits: 1

baidu/babylon

High-Performance C++ Fundamental Library

Commits: 1

rikkihamano/trojan

Commits: 1

mlc-ai/relax

Commits: 1

InternLM/InternLM

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

Commits: 1

sgl-project/sgl-kernel-xpu

SGLang kernel library for Intel XPU

Commits: 1

deepseek-ai/deepseek-r1

Commits: 1