AWS Certified AI Practitioner (AIF-C01) · Objective 4.1
Handling small subgroup metrics
4.1Standard
A subgroup is small and its fairness metric varies widely.
Do not hide it in the overall average.
Choose two responses.
Hint 1: Focus on the requirement
Report uncertainty for small groups, preserve their representation in sampling and labels, and avoid treating a noisy estimate as a final verdict.
Hint 2: Key terms
Review small-group fairness and statistical uncertainty.
Confidence interval
A range expressing uncertainty around an estimated statistic.
Stratified sampling
Sampling that preserves or deliberately controls representation for defined groups.
Small-group estimate
A metric calculated from few observations and therefore subject to high variability.
Uncertainty reporting
Showing the limits and variability of a measurement instead of only a point value.
× Incorrect
Report sample size, confidence intervals, and label quality, and use additional data, stratified sampling, and human review rather than excluding the group.
Detailed explanation
A
CorrectShow sample size, confidence interval, and label quality
Uncertainty is not overstated.
B
CorrectUse additional data, stratified sampling, and human review to check impact
Measurement gaps and real harm are investigated.
C
IncorrectDeclare fairness from a point estimate alone
Sampling variation is ignored.
D
IncorrectExclude the subgroup because it is small
Its impact cannot be measured.
Check official documentation
Compare the following points with the official documentation.
Path & Pass is an independent learning site and is not affiliated with any certification body. Questions are original practice content based on published objectives.