Top vllm tools
Sustained, decay-weighted momentum leaders tagged “vllm”.
- 298· newFunASRIndustrial-grade speech recognition toolkit: 170x realtime, 50+ languages, speaker diarization, emotion detection, streaming, and OpenAI-compatible API.mcp-serversasr+1956.7
- 304· newAI-Research-SKILLsComprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.ai-dev-toolsai+1356.6
- 673· newKVarNKVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.ai-agentsagentic-ai+651.9
- 713· newvllm-ascendCommunity maintained hardware plugin for vLLM on Ascendai-dev-toolsascend+851.6
- 951· newllama-cookbookWelcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services aifinetuning+848.4
- 1226· newQwen3.6-27B-AEON-Ultimate-Uncensored-DFlashFully uncensored, capability-enhanced abliteration of Qwen3.6-27B. NVFP4 + z-lab DFlash speculative decoding (n=12) on the unified ghcr.io/aeon-7/aeon-vllm-ultimate:latest container, tuned for long-context draft acceptance on DGX Spark. 6 HF variants (BF16/NVFP4/MTP/MTP-XS), docker-compose, and QuickStart.abliterationblackwell+1041.8
- 1397· newprometheus-evalEvaluate your LLM's response with Prometheus and GPT4 💯ai-dev-toolsevaluation+841.6
- 1469· newtaOSSelf-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).ai-agentsagent-framework+1740.5
- 1780· newsndr_core_engineSNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A3B FP8 ~240 tok/s, 27B-int4 hybrid GDN+Mamba, Gemma4 26B/31B AWQ, 256K ctx. 321 patches: TurboQuant k8v4 KV, MTP/DFlash spec-decode, FULL cudagraph, hybrid GDN. vLLM pin dev424 + Control Center GUI.rag-evalawq+1919.3
- 2137· newUltraRAGA Low-Code MCP Framework for Building Complex and Innovative RAG Pipelinesmcp-serversrag-eval+1719.2
The weekly drop
Get the weekly rising list
The top risers across agents, MCP servers and dev tools, once a week in your inbox. No spam, unsubscribe anytime.