Automatically compare translation and summarization output.
Do not penalize correct paraphrases unfairly.
Choose two correct statements.
N-gram overlap is one signal of wording similarity; human assessment of meaning, facts, and safety is also required.
Detailed explanation
It is useful but does not guarantee semantic correctness.
Equivalent meaning can use different words.
Policy and expert review may still be necessary.
Correct paraphrases and context need additional review.
Check official documentation
Compare the following points with the official documentation.
AWS公式AIF-C01 Domain 3.3の生成AI評価指標と人手評価を確認する。
Official references
What to confirm
自動指標の有用性と、意味・安全性を保証しない限界を説明できる。
Key points
- Automatic metric
- Meaning
- Human review
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Compare the definition with the AIF-C01 objective and the service documentation before applying it.
- Keep the concept separate from a particular answer choice or implementation step.
Foundation review
N-gram overlap
An automatic measure based on shared contiguous token or word sequences with a reference.
Semantic evaluation
Judging whether meaning, facts, completeness, and context are appropriate.