Pinned Loading

1. xlite-dev/LeetCUDA xlite-dev/LeetCUDA Public

   ??LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners??, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.??

   Cuda 5.8k 615

2. xlite-dev/lite.ai.toolkit xlite-dev/lite.ai.toolkit Public

   ?? A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.??

   C++ 4.2k 754

3. xlite-dev/Awesome-LLM-Inference xlite-dev/Awesome-LLM-Inference Public

   ??A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.??

   Python 4.3k 297

4. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 53.9k 9.1k

5. PaddlePaddle/FastDeploy PaddlePaddle/FastDeploy Public

   High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

   Python 3.4k 582

6. vipshop/cache-dit vipshop/cache-dit Public

   ??A Training-free and Easy-to-use Cache Acceleration Toolbox for Diffusion Transformers.

   Python 117 4