Split customer data into training, validation, and test sets.
Do not inflate the final result.
Choose two practices.
Keep test data out of model selection and split by customer or time so related records and future information do not cross the boundary.
Detailed explanation
Generalization remains measurable.
Generalization remains measurable.
Dependence and future leakage are reduced.
Dependence and future leakage are reduced.
The test set becomes a training signal.
The test set becomes a training signal.
Unavailable information leaks.
Unavailable information leaks.
Try it yourself
An example you can run in a temporary verification environment.
AWS公式AIF-C01 Domain 1.2のデータ分割、リーケージ、評価を確認する。Expected result
テストデータと未来情報の漏えいを避けた評価手順を説明できる。Key points
- Test isolation
- Leakage
- Time split
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Command output formatting can vary slightly by distribution or tool version.
- Run the example in a temporary directory or process when possible.
Foundation review
Read the scope first
Check whether the command acts on the current shell, a new process, an existing process, or a file.
Verify the observable result
Use the supplied command and compare the output with the expected result.