A long document is sent to a model.
Control input limits and answer quality.
Choose two designs.
Keep input and output tokens within the context limit, and use retrieval, summarization, or splitting to prioritize important instructions and evidence.
Detailed explanation
Noise and limit overflow can occur.
Rejection or truncation is avoided.
Limited context is used effectively.
Tokenization varies.
Check official documentation
Compare the following points with the official documentation.
AWS公式AIF-C01 Domain 2.3のトークン、コンテキストウィンドウ、長文処理を確認する。
Official references
What to confirm
文字数ではなくトークン上限を前提に入力を整理できる。
Key points
- Token
- Context window
- Chunking
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Compare the definition with the AIF-C01 objective and the service documentation before applying it.
- Keep the concept separate from a particular answer choice or implementation step.
Foundation review
Context window
The maximum number of tokens a model can process in one request and response.
Token
A unit of text used to measure model input and output length.