The production inputs should be used to evaluate a new model.
Do not return its output to users yet.
Which method is most appropriate?
Mirror production inputs to the new model, record its output, and keep that output away from user responses and side effects.
Detailed explanation
The source of differences cannot be isolated.
Real distribution is evaluated safely.
Production distribution and boundaries differ.
Impact occurs before evaluation.
Check official documentation
Compare the following points with the official documentation.
AWS公式AIF-C01 Domain 4の段階展開、評価、人的監督を確認する。
Official references
What to confirm
新モデルを利用者へ影響させず、同じ本番入力で比較評価できる。
Key points
- Shadow deployment
- Same input
- Side-effect isolation
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Compare the definition with the AIF-C01 objective and the service documentation before applying it.
- Keep the concept separate from a particular answer choice or implementation step.
Foundation review
Shadow deployment
Sending production inputs to a new version without using its output for live decisions.
Side-effect isolation
Preventing a test output from changing users, records, or external systems.