A summarization API is slow under concurrent use.
Clarify performance goals.
Choose two measurements.
Measure p50, p95, p99 latency, timeouts, errors, concurrency, queues, tokens, throughput, and cost together.
Detailed explanation
Long-tail delay is visible.
Long-tail delay is visible.
Bottlenecks can be found.
Bottlenecks can be found.
Long tails are hidden.
Long tails are hidden.
Quota and contention exist.
Quota and contention exist.
Try it yourself
An example you can run in a temporary verification environment.
AWS公式AIF-C01 Domain 1.3・3.3のレイテンシ、スループット、同時実行を確認する。Expected result
尾部レイテンシと処理量・費用のトレードオフを測定できる。Key points
- p95
- Throughput
- Concurrency
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Command output formatting can vary slightly by distribution or tool version.
- Run the example in a temporary directory or process when possible.
Foundation review
Read the scope first
Check whether the command acts on the current shell, a new process, an existing process, or a file.
Verify the observable result
Use the supplied command and compare the output with the expected result.