Automatically compare translation and summarization output.
Do not penalize correct paraphrases unfairly.
Choose two correct statements.
N-gram overlap is one signal of wording similarity; human assessment of meaning, facts, and safety is also required.
Detailed explanation
It is useful but does not guarantee semantic correctness.
It is useful but does not guarantee semantic correctness.
Correct paraphrases and context need additional review.
Correct paraphrases and context need additional review.
Equivalent meaning can use different words.
Equivalent meaning can use different words.
Policy and expert review may still be necessary.
Policy and expert review may still be necessary.
Try it yourself
An example you can run in a temporary verification environment.
AWS公式AIF-C01 Domain 3.3の生成AI評価指標と人手評価を確認する。Expected result
自動指標の有用性と、意味・安全性を保証しない限界を説明できる。Key points
- Automatic metric
- Meaning
- Human review
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Command output formatting can vary slightly by distribution or tool version.
- Run the example in a temporary directory or process when possible.
Foundation review
Read the scope first
Check whether the command acts on the current shell, a new process, an existing process, or a file.
Verify the observable result
Use the supplied command and compare the output with the expected result.