There is little data and repeated user records.
Compare models reliably.
Choose two practices.
Respect group and time independence, report mean and variation across folds, and keep a final test set separate.
Detailed explanation
Independence is preserved.
Independence is preserved.
Uncertainty is visible.
Uncertainty is visible.
User patterns leak.
User patterns leak.
The test becomes contaminated.
The test becomes contaminated.
Try it yourself
An example you can run in a temporary verification environment.
AWS公式AIF-C01 Domain 1.2の交差検証、グループ分割、時系列評価を確認する。Expected result
データの関係性を保った分割で、評価結果のばらつきを説明できる。Key points
- Cross-validation
- Group split
- Variation
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Command output formatting can vary slightly by distribution or tool version.
- Run the example in a temporary directory or process when possible.
Foundation review
Read the scope first
Check whether the command acts on the current shell, a new process, an existing process, or a file.
Verify the observable result
Use the supplied command and compare the output with the expected result.