Compare projects
Select 2–4 projects to compare on the same basis.
Only identical known values are hidden. Unknown information remains visible.
Ppromptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
Popularity
Repository stars29,283Highest26,748
7-day net stars——
Fork3,069Highest2,633
30-day trendInsufficient historyInsufficient history
Maintenance
Last push2026-11-022026-11-02
Maintenance notesNot verifiedNot verified
Repository created2024-08-062023-04-28
License & use
LicenseLicense not declaredMIT · Permissive
PricingPricing not verifiedPricing not verified
Basics
Browse by purposeModel and data evaluationContinuous delivery · Model and data evaluation · Retrieval-augmented generation · Software testing
TypeFrameworks & SDKsApps & systems
SubcategoryAgent frameworksSecurity tools
PlatformNot verifiedNot verified
Cost detailsCheck current official software, hosting, model and infrastructure pricing.Check current official software, hosting, model and infrastructure pricing.
Pricing source——
First collected2026-11-032026-11-03
MetricRepository stars, not unique users or individual-skill installsRepository stars, not unique users or individual-skill installs
LanguageTypeScriptTypeScript
About this projectMastra is the modern TypeScript framework for AI-powered applications and agents.Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
Measured at2026-11-02 18:59 UTC2026-11-02 19:01 UTC
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Ranked by repository stars, one position per repository. Stars and forks are not user counts.