A model's group gap grows after launch.
Find the cause.
Choose two practices.
Compare time, group, distribution, threshold, and human-decision metrics regularly and define investigation, notice, stop, and reassessment.
Detailed explanation
Operational change is visible.
Operational change is visible.
Remedy is continuous.
Remedy is continuous.
Use and distributions change.
Use and distributions change.
Gaps disappear.
Gaps disappear.
Try it yourself
An example you can run in a temporary verification environment.
AWS公式AIF-C01 Domain 4.2・3.3の公平性監視、ドリフト、緩和を確認する。Expected result
モデルと利用環境の変化で公平性が悪化する可能性を運用へ組み込める。Key points
- Fairness monitoring
- Distribution change
- Alert
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Command output formatting can vary slightly by distribution or tool version.
- Run the example in a temporary directory or process when possible.
Foundation review
Read the scope first
Check whether the command acts on the current shell, a new process, an existing process, or a file.
Verify the observable result
Use the supplied command and compare the output with the expected result.