Splitting customization data

Review independent evaluation for model adaptation.

Independent evaluation

Testing on data not used to adapt or select a model, providing less biased evidence.

Boundary case

An example near a decision or safety boundary where errors are more likely.

Data partition

Assigning examples to separate roles such as adaptation, validation, and final testing.

Evaluation contamination

Using evaluation examples or their outcomes during model choices and adaptation.