evaluation rising this week
Tools tagged “evaluation” gaining momentum, ranked by rate of change.
- 222· newlangfuse🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23 ai-dev-toolsrag-eval+1957.5
- 317· newWeKnoraOpen-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.ai-agentsrag-eval+2056.1
- 324· newpromptfooTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.ai-dev-toolsrag-eval+1856.0
- 387· newopikDebug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.ai-dev-toolsrag-eval+1355.2
- 513· newragasSupercharge Your LLM Application Evaluations 🚀ai-dev-toolsevaluation+253.7
- 536· newmlflowThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.ai-agentsai-dev-tools+1953.4
- 665· newyao-meta-skillYAO = Yielding AI Outcomes. A rigorous engineering, evaluation, governance, and portability system for reusable agent skills.ai-agentsagent-skills+751.2
- 700· newhelicone🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓ai-dev-toolsrag-eval+1951.2
- 749· newcoze-loopNext-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring. ai-agentsai-dev-tools+1750.2
- 753· newtrpc-agent-goA Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.ai-agentsmcp-servers+1850.2
- 770· newlangwatchThe platform for LLM evaluations and AI agent testingai-dev-toolsai+1250.2
- 861· newintellagentA framework for comprehensive diagnosis and optimization of agents using simulated, realistic synthetic interactionsai-agentsai-dev-tools+548.9
- 860· newagentaThe open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.ai-agentsai-dev-tools+1648.9
- 1076· newClawBenchOpen-source benchmark for browser AI agents on daily tasks.ai-agentsrag-eval+1945.4
- 1334· newlmnrLaminar - open-source observability platform purpose-built for AI agents. YC S24.ai-agentsai-dev-tools+2142.7
- 1335· newChainForgeAn open-source visual programming environment for battle-testing prompts to LLMs.ai-dev-toolsai+542.7
- 1338· newprometheus-evalEvaluate your LLM's response with Prometheus and GPT4 💯ai-dev-toolsevaluation+842.7
- 1454· newParseBenchParseBench - A Document Parsing Benchmark for AI Agentsbenchmarkdocument-ai+940.5
- 1932· newSanityHarnessA lightweight harness designed to be simple to use, efficient, universially compatible with any coding agent to evaluate them over a broad set of coding tasks and languages.ai-agentsai-dev-tools+819.9
- 1980· newmeta-agents-research-environmentsMeta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces evolving environments where agents must adapt their strategies as new information becomes available, mirroring real-world challenges.ai-agentsagents+1219.9
- 2016· newinspectorTesting and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.mcp-serversrag-eval+2019.9
- 2152· newuptrainUpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.ai-dev-toolsrag-eval+1419.9
The weekly drop
Get the weekly rising list
The top risers across agents, MCP servers and dev tools, once a week in your inbox. No spam, unsubscribe anytime.