cuda rising this week
Tools tagged “cuda” gaining momentum, ranked by rate of change.
- 171· newvllmA high-throughput and memory-efficient inference and serving engine for LLMsamdblackwell+1858.1
- 179· newtesseraFrom teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.cudaflash-attention+1457.9
- 319· newsglangSGLang is a high-performance serving framework for large language models and multimodal models.attentionblackwell+1656.1
- 1715· newself-hosted-ai-stackDeploy a complete self-hosted AI stack with Docker Compose: Ollama, LiteLLM, AnythingLLM, Whisper, WhisperLive, Kokoro, Embeddings, Docling and MCP Gateway. Local-first, private by default, with lightweight stacks, optional HTTPS and NVIDIA CUDA acceleration. Multi-arch: amd64, arm64.mcp-serversrag-eval+2020.1
- 1775· newsndr_core_engineSNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A3B FP8 ~240 tok/s, 27B-int4 hybrid GDN+Mamba, Gemma4 26B/31B AWQ, 256K ctx. 321 patches: TurboQuant k8v4 KV, MTP/DFlash spec-decode, FULL cudagraph, hybrid GDN. vLLM pin dev424 + Control Center GUI.rag-evalawq+1920.0
The weekly drop
Get the weekly rising list
The top risers across agents, MCP servers and dev tools, once a week in your inbox. No spam, unsubscribe anytime.