An external model API times out temporarily.
Recover without amplifying the outage.
Choose two operational designs.
Retry only transient errors with bounded exponential backoff, and use a circuit breaker and safe fallback when failure or latency exceeds limits.
Detailed explanation
Resources can be exhausted.
Cost, latency, and the outage can be amplified.
Recovery is attempted without infinite loops or a retry storm.
Cascading failure and unclear waits are limited.
Check official documentation
Compare the following points with the official documentation.
AWS公式AIF-C01 Domain 3.4の信頼性、監視、障害対応を確認する。
Official references
What to confirm
AI API障害の再試行と遮断を、可用性・費用・遅延の観点で設計できる。
Key points
- Exponential backoff
- Timeout
- Circuit breaker
Notes
- Environment: AWS公式AIF-C01試験ガイドとAWS公式ドキュメントの確認
- Compare the definition with the AIF-C01 objective and the service documentation before applying it.
- Keep the concept separate from a particular answer choice or implementation step.
Foundation review
Exponential backoff
A retry policy that increases the wait between attempts to reduce request bursts.
Jitter
A small random delay added to retry waits so many clients do not retry at the same moment.