An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.
Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.
Fast, differentiable sorting and ranking in PyTorch
row-major matmul optimization
GPU ๆง่ฝไธ AI Infra ๅญฆไน ้กน็ฎ๏ผCUDA/Triton ็ฎๅญใNCU/NSYSใvLLM/SGLang/TRT-LLM/ms-swiftใPyTorch/DeepSpeed/ms-swift ่ฎญ็ปใๅนถ่กๆถๆ
PHP CUDA extension for GPU computing, tensor operations, and machine-learning workloads
CUDA++ for the NVIDIA DGX Spark (GB10, sm_121): Aien's own GPU machine-code toolchain, runtime and driver client, without the CUDA toolkit. Other NVIDIA GPUs are not supported yet.
A performance comparison of standard matrix functions between CPU and GPU using Nvidia CUDA on Visual Studio using C++
A beginner's guide to CUDA programming
frontier.fast challenge repo for agents and submissions to push the frontier of AI!
Rust KV-cache compression for LLM inference. Implements TurboQuant (Zandieh et al., ICLR 2026) plus PQO โ our variant that drops QJL, adds a fused CUDA kernel, and shrinks the cache to ~20% of FP16 (49% total VRAM at 32K). mistral.rs integration.
A collection of scripts on MLSys-related stuff
An unofficial re-implementation of Cursor's warp decode MoE inference technique. Achieved nearly 2.0x speedup on MOE layer on Nvidia H20 at batch size 1.
SNU CSE Scalable High Performance Computing (M1522.006700) - 2023 Autumn
a custom CUDA kernel for windowed matrix multiplication
True Gradient will guide you through it all; believing in it and continuing to move forward is what fosters growth. Donโt let the past control youโthe noise within the past is the very source of your worries and suffering.
Winning submission for StartHack 2024: HPC optimized multi-GPU/CPU inference
To associate your repository with the cuda-kernel topic, visit your repo's landing page and select "manage topics."