A churn model includes a field recorded after churn.
Keep only data available at prediction time.
Choose two responses.
Remove future information by auditing feature timing and reassess with time-based splits.
Detailed explanation
Future information is excluded.
Future information is excluded.
Inflated estimates can be detected.
Inflated estimates can be detected.
It uses future information.
It uses future information.
Overestimation remains.
Overestimation remains.
Try it yourself
An example you can run in a temporary verification environment.
AWS公式AIF-C01 Domain 1.2のデータ漏洩、特徴量生成時点、評価を確認する。Expected result
特徴量の相関ではなく、予測時点で利用可能かを確認してモデルを評価できる。Key points
- Target leakage
- Prediction time
- Time split
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Command output formatting can vary slightly by distribution or tool version.
- Run the example in a temporary directory or process when possible.
Foundation review
Read the scope first
Check whether the command acts on the current shell, a new process, an existing process, or a file.
Verify the observable result
Use the supplied command and compare the output with the expected result.