Answer questions from an internal FAQ.
Evaluate whether retrieved evidence is sufficient.
Choose two appropriate evaluation practices.
Check whether necessary evidence appears near the top and separately assess whether the answer is supported by the retrieved sources.
Detailed explanation
This detects missed relevant chunks.
This detects missed relevant chunks.
Retrieval quality and generation quality can be diagnosed separately.
Retrieval quality and generation quality can be diagnosed separately.
Fluency does not prove evidence quality.
Fluency does not prove evidence quality.
Retrieval performance cannot then be measured.
Retrieval performance cannot then be measured.
Try it yourself
An example you can run in a temporary verification environment.
Amazon Bedrock Knowledge Bases公式の検索評価とAIF-C01 Domain 3.2を確認する。Expected result
検索品質と生成品質を分離して評価できる。Key points
- Recall
- Precision
- Grounding
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Command output formatting can vary slightly by distribution or tool version.
- Run the example in a temporary directory or process when possible.
Foundation review
Read the scope first
Check whether the command acts on the current shell, a new process, an existing process, or a file.
Verify the observable result
Use the supplied command and compare the output with the expected result.