AWS Certified AI Practitioner (AIF-C01) · Objective 3.4
Evaluating harmful output
3.4Standard
Test a chatbot's safety.
Use normal and adversarial inputs.
Choose two evaluations.
Hint 1: Focus on the requirement
Test harmful and evasive inputs as well as safe inputs, and assess both missed harms and unjustified refusals.
Hint 2: Key terms
Review harmful-output and red-team evaluation.
False refusal
Rejecting a safe request that policy allows the system to answer.
Red-team evaluation
Deliberately probing a system with adversarial or boundary inputs to find weaknesses.
Adversarial input
An input designed to expose or bypass a model's safety or reliability controls.
Safety category
A defined type of harmful, prohibited, or high-risk content used for evaluation.
× Incorrect
Measure harmful categories, false positives, false negatives, paraphrases, prompts, and language differences rather than testing only normal questions.
Detailed explanation
A
IncorrectTest safety only with ordinary questions
Adversarial input is missing.
B
IncorrectOne filter pass proves safety
Behavior changes with context and phrasing.
C
CorrectMeasure harmful, discriminatory, sexual, self-harm, and privacy-request categories
Risk-specific weaknesses are visible.
D
CorrectTest false refusals, paraphrases, coercion, and language differences
Both overblocking and misses are measured.
Check official documentation
Compare the following points with the official documentation.
Path & Pass is an independent learning site and is not affiliated with any certification body. Questions are original practice content based on published objectives.