Top model-serving tools
Sustained, decay-weighted momentum leaders tagged “model-serving”.
- 171· newvllmA high-throughput and memory-efficient inference and serving engine for LLMsamdblackwell+1858.1
- 612· newopenlakeOpenLake is a high performance storage engine for efficient LLM inference and GPU Trainingblackwellgpt+952.4
- 651· newvllm-ascendCommunity maintained hardware plugin for vLLM on Ascendai-dev-toolsascend+851.9
- 876· newpredikitThe missing bridge between your ML models and your AI agents.ai-agentsagents+1048.6
- 1017· newrtp-llmRTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.ai-dev-toolsgpt+646.9
- 1333· newloraxMulti-LoRA inference server that scales to 1000s of fine-tuned LLMsai-dev-toolsfine-tuning+1042.7
- 1330· newBentoMLRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.ai-dev-toolsai-inference+2742.7
- 2156· newaiciAICI: Prompts as (Wasm) Programsai-dev-toolsai+1219.9
- 2096· newFedMLFEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.ai-agentsai-agent+1019.9
- 2155· newenvd🏕️ Reproducible development environment for humans and agentsai-agentsai-dev-tools+1219.9
The weekly drop
Get the weekly rising list
The top risers across agents, MCP servers and dev tools, once a week in your inbox. No spam, unsubscribe anytime.