Invoices are processed overnight, while another feature needs immediate replies.
Choose an inference mode.
Choose two mappings.
Batch inference suits large jobs with tolerated delay; online inference suits low-latency requests and must be monitored for concurrency, failures, and quota.
Detailed explanation
Service quality still matters.
Throughput and cost can be prioritized.
It processes groups.
Interactive requirements fit.
Check official documentation
Compare the following points with the official documentation.
AWS公式AIF-C01 Domain 1.3のバッチ推論、オンライン推論、レイテンシを確認する。
Official references
What to confirm
処理量と応答時間の要件から推論方式を選べる。
Key points
- Batch
- Online
- Latency
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Compare the definition with the AIF-C01 objective and the service documentation before applying it.
- Keep the concept separate from a particular answer choice or implementation step.
Foundation review
Batch inference
Processing a collection of inputs together without an immediate response requirement.
Online inference
Returning a prediction for an individual request within a latency target.