A customer chat service must return short answers with high concurrency.
Response time and cost matter more than complex long-form reasoning.
Choose two model-selection criteria.
Compare measured latency and throughput for representative prompts, along with inference cost per request or token.
Detailed explanation
The service must meet response-time and concurrency requirements with representative inputs.
The service must meet response-time and concurrency requirements with representative inputs.
At scale, token volume and unit price directly affect operating cost.
At scale, token volume and unit price directly affect operating cost.
A name's length says nothing about capability, latency, or price.
A name's length says nothing about capability, latency, or price.
A file name does not characterize a model's service behavior.
A file name does not characterize a model's service behavior.
Try it yourself
An example you can run in a temporary verification environment.
Amazon Bedrock公式のモデル・推論料金・サービスクォータ情報を確認し、代表プロンプトで測定する。Expected result
レイテンシ・スループット・コストをモデル選択の要件として比較できる。Key points
- Latency
- Throughput
- Inference cost
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Command output formatting can vary slightly by distribution or tool version.
- Run the example in a temporary directory or process when possible.
Foundation review
Read the scope first
Check whether the command acts on the current shell, a new process, an existing process, or a file.
Verify the observable result
Use the supplied command and compare the output with the expected result.