Why Red Teaming Matters
Without adversarial testing, you cannot know how your agent behaves under attack. Netra helps you answer critical safety questions with confidence:Core Building Blocks
The Red Teaming suite is built on three interconnected pillars:Suites & Evaluators
Suites & Evaluators form the adversarial test catalog. Evaluators define individual attack categories — each with a generation template for creating adversarial prompts and a grader rubric for judging agent responses. Suites bundle related evaluators into curated groups aligned to security frameworks.Setup
A Setup is a reusable test configuration. It connects a specific agent to selected evaluators, an attacker LLM (for generating adversarial prompts), and a judge LLM (for scoring agent responses). You also choose between single-turn and multi-turn attack modes.Runs & Results
A Run executes all adversarial prompts from a setup against the target agent. Each prompt is sent to the agent, the response is judged by the LLM, and a pass/fail/error result is recorded. Runs execute asynchronously with queue-based concurrency control.Execution Modes
Netra supports two attack strategies, each suited to different risk scenarios:End-to-End Flow
The red teaming pipeline follows this sequence:1
Create a Setup
Create a setup for your agent. Choose the attack type, number of tests, and configure the attacker and judge LLMs.
2
Select Suites & Evaluators
Explore suites & evaluators and select the attack categories that match your risk profile.
3
Generate Adversarial Prompts
Trigger prompt generation. The attacker LLM generates targeted adversarial prompts for each evaluator.
4
Run the Test
Start a run. Each prompt is sent to the agent, the response is judged, and a pass/fail result is recorded.
5
Review Results and Risk Scores
View per-prompt results and monitor your risk scores over time.
Getting Started
1
Create a Setup
Create a setup for your agent. Choose attack type, number of tests, and configure the attacker and judge LLMs.
2
Select Suites & Evaluators
Navigate to Red Teaming and explore suites & evaluators. Select a suite or pick individual evaluators that match your risk profile.
3
Generate Adversarial Prompts
Trigger prompt generation. Netra uses the attacker LLM and each evaluator’s template to generate targeted adversarial prompts.
4
Run the Red Team Test
Start a run. Each adversarial prompt is sent to your agent. The judge LLM scores every response.
5
Review Results and Risk Scores
View per-prompt results, track progress, and monitor your risk scores over time.
Related
Suites & Evaluators
Browse the adversarial test catalog and select attack categories.
Setup
Create reusable test setups that connect agents to evaluators.
Runs & Results
Execute red team tests and view per-prompt pass/fail results.
Risk Scores
Track your agent’s safety posture over time with aggregated scores.