inference rising this week
Tools tagged “inference” gaining momentum, ranked by rate of change.
- 72· newinferoaInference-native Tokenmaxxing Agent Harness for Loop Engineeringai-agentsagent+960.1
- 171· newvllmA high-throughput and memory-efficient inference and serving engine for LLMsamdblackwell+1858.1
- 319· newsglangSGLang is a high-performance serving framework for large language models and multimodal models.attentionblackwell+1656.1
- 651· newvllm-ascendCommunity maintained hardware plugin for vLLM on Ascendai-dev-toolsascend+851.9
- 795· newTurboLLMRun any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine in one command. No Electron, no Python, offline-first.ai-dev-toolsai+1249.2
- 937· newmlx-serveNative LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.ai-agentsai-dev-tools+2046.9
- 1017· newrtp-llmRTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.ai-dev-toolsgpt+646.9
- 1032· newopenvinoOpenVINO™ is an open source toolkit for optimizing and deploying AI inferenceaicomputer-vision+1746.9
- 1016· newcube-studiocubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台，算法全链路流程，多租户，算力租赁平台，token中转，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务，VGPU虚拟化，云边端协同，边缘计算，自动化标注平台，deepseek等大模型sft微调/奖励模型/强化学习训练，vllm/ollama/mindie大模型多机推理，私有知识库llmops智能体，AI模型市场，支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等，支持ib/roce/RDMA，信创支持ai-dev-toolsai-platform+1346.9
- 1372· newdstackVendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.agent-skillsagentic-orchestration+1742.7
- 2156· newaiciAICI: Prompts as (Wasm) Programsai-dev-toolsai+1219.9
- 2143· newsuperduperSuperduper: End-to-end framework for building custom AI applications and agents.ai-dev-toolsrag-eval+2019.9
- 2144· newcube-studiocube studio开源云原生一站式机器学习/深度学习/大模型AI平台，mlops算法链路全流程，算力租赁平台，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU虚拟化，边缘计算，标注平台自动化标注，deepseek等大模型sft微调/奖励模型/强化学习训练，vllm/ollama/mindie大模型多机推理，私有知识库，AI模型市场，支持国产cpu/gpu/npu 昇腾生态，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/ray/volcano等分布式ai-dev-toolsai+1619.9
The weekly drop
Get the weekly rising list
The top risers across agents, MCP servers and dev tools, once a week in your inbox. No spam, unsubscribe anytime.