Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 16.1k 2.4k

2. tllm tllm Public

   create your own llm inference server from scratch

   Python 12

3. ggml-org/llama.cpp ggml-org/llama.cpp Public

   LLM inference in C/C++

   C++ 83.2k 12.4k

4. wRPC wRPC Public

   this is a simple RPC

   C++ 4 1

5. ChunelFeng/CGraph ChunelFeng/CGraph Public

   【A common used C++ & Python DAG framework】 一个通用的、无三方依赖的、跨平台的、收录于awesome-cpp的、基于流图的并行计算框架。欢迎star & fork & 交流

   C++ 2.1k 361

6. cuda_example cuda_example Public

   this repository is for cuda example

   Cuda