Compare projects
Select 2–4 projects to compare on the same basis.
Only identical known values are hidden. Unknown information remains visible.
Ppromptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
Mevalscope
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
Popularity
Repository stars26,748Highest3,640
7-day net stars——
Fork2,633Highest552
30-day trendInsufficient historyInsufficient history
Maintenance
Last push2026-11-022026-11-03
Maintenance notesNot verifiedNot verified
Repository created2023-04-282023-12-07
License & use
LicenseMIT · PermissiveApache-2.0 · Permissive
PricingPricing not verifiedPricing not verified
Basics
Browse by purposeContinuous delivery · Model and data evaluation · Retrieval-augmented generation · Software testingModel and data evaluation · Retrieval-augmented generation
TypeApps & systemsFrameworks & SDKs
SubcategorySecurity toolsGeneral
PlatformNot verifiedNot verified
Cost detailsCheck current official software, hosting, model and infrastructure pricing.Check current official software, hosting, model and infrastructure pricing.
Pricing source——
First collected2026-11-032026-11-03
MetricRepository stars, not unique users or individual-skill installsRepository stars, not unique users or individual-skill installs
LanguageTypeScriptPython
About this projectTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
Measured at2026-11-02 19:01 UTC2026-11-03 09:40 UTC
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Ranked by repository stars, one position per repository. Stars and forks are not user counts.