Map / AI Red Teaming / Confident AI
Confident AI
confident-ai.com ↗ · LinkedIn ↗ · Open on the map
AI Red TeamingObservability & Governance
Capabilities
LLM evaluation, observability and red-teaming platform built on two open-source frameworks. DeepEval is a pytest-style eval library with metrics for RAG, agents, multi-turn and MCP-based systems. DeepTeam is an adversarial testing framework that simulates attacks such as prompt injection, jailbreaks, PII leakage, excessive agency and bias against LLM apps and agents. The hosted platform traces production agent runs, flags failures and turns them into regression eval datasets, with red-teaming assessments and AI governance for enterprise.
Sensors / integration
Python SDK and OSS libraries (DeepEval, DeepTeam) run in code, CI/CD and CLI/YAML configs. Tracing instrumentation sends production LLM/agent traces to the Confident AI cloud.
Protections
Pre-deployment and continuous red teaming against OWASP Top 10 for LLMs-style vulnerability classes (prompt injection, jailbreak, data leakage, toxicity, excessive agency). Eval gates in CI catch quality and safety regressions, and production monitoring flags failing agent traces. It tests and reports rather than blocking inline.
Differentiator
YC W25, San Francisco. CEO Jeffrey Ip (ex-Google YouTube infrastructure, ex-Microsoft Office 365) created DeepEval. CTO Kritin Vongthongsri is a Princeton-trained, CHI-published AI researcher. The $2.2M oversubscribed seed closed in about five days in March 2025, ahead of YC Demo Day, with no lead disclosed. DeepEval (repo created Aug 2023) has about 19.5k GitHub stars and DeepTeam (Mar 2025) about 3.1k stars, per the GitHub API in Nov 2026. Named enterprise users include BCG, AstraZeneca, Stellantis and Mercedes-Benz. Small team (7 per YC).
Team & funding
- Founders
- Jeffrey Ip, Kritin Vongthongsri
- Total raised
- $2.2M
- Investors
- Y Combinator, Flex Capital, Liquid 2 Ventures, Vermilion Cliffs Ventures, January Capital, Rebel Fund, Oliver Jung
Other AI Red Teaming companies
A Security · AccuKnox · ActaClad · ActiveFence · Advai · Adversa AI · Aether AI · AgentFox · Aikido · AIM Intelligence · Akto · Alice · See all →
Last updated · Get the “Listed on” badge