Pass only the highest-ranked documents to generation.
Balance missed evidence and token cost.
Choose two evaluations.
Compare recall, evidence accuracy, duplication, and token cost for different top-k values, including important documents after authorization filtering.
Detailed explanation
Retrieval range and cost are measured.
Retrieval range and cost are measured.
Ranking and access effects are visible.
Ranking and access effects are visible.
Noise and cost also increase.
Noise and cost also increase.
Misses and diversity are not measured.
Misses and diversity are not measured.
Try it yourself
An example you can run in a temporary verification environment.
AWS公式AIF-C01 Domain 3.1の検索評価、top-k、RAGコストを確認する。Expected result
取得件数を品質・費用・認可の観点で調整できる。Key points
- Top-k
- Recall
- Noise
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Command output formatting can vary slightly by distribution or tool version.
- Run the example in a temporary directory or process when possible.
Foundation review
Read the scope first
Check whether the command acts on the current shell, a new process, an existing process, or a file.
Verify the observable result
Use the supplied command and compare the output with the expected result.