2.1Basic
Process long Japanese and English inputs.
Compare tokens and quality.
Choose two evaluations.
× Incorrect
Measure token count, context length, cost, latency, and meaning preservation for representative Japanese, English, and mixed-language cases.
Detailed explanation
IncorrectCharacter count equals token count in every language
Tokenization differs by language and model.
CorrectTest meaning preservation on representative Japanese, English, and mixed cases
Language-specific capability gaps are visible.
IncorrectFewer tokens mean quality testing is unnecessary
Compression and semantic quality are separate.
CorrectMeasure token count, context, cost, and latency by language
Input size and operating cost can differ.
Check official documentation
Compare the following points with the official documentation.
AWS公式AIF-C01 Domain 2.1のトークン、文脈長、基盤モデル能力を確認する。
Official references
What to confirm
文字数だけでなくトークン化が費用・長さ・品質へ与える影響を説明できる。
Key points
- Tokens
- Context
- Language
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Compare the definition with the AIF-C01 objective and the service documentation before applying it.
- Keep the concept separate from a particular answer choice or implementation step.
Foundation review
Token
A word, subword, character, or symbol unit processed by a language model.
Tokenizer
The component that converts text into a model's token sequence.
Question IDAWS-AIF-336
EnvironmentAWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
Last technical review2026-08-20
Report an error or rights issue