A Glue job emits structured logs containing error codes.
Count errors by code and find the latest occurrence without downloading all logs.
Which analysis approach is most appropriate?
Use CloudWatch Logs Insights fields and commands such as filter, stats, and sort within a bounded time range.
Detailed explanation
CloudTrail records API events, not the complete Glue job-log content.
CloudTrail records API events, not the complete Glue job-log content.
Full downloads add time, exposure, and reproducibility problems.
Full downloads add time, exposure, and reproducibility problems.
Logs Insights can filter and aggregate only the required records in the log group.
Logs Insights can filter and aggregate only the required records in the log group.
Lifecycle transitions do not count or filter log fields.
Lifecycle transitions do not count or filter log fields.
Check official documentation
Compare the following points with the official documentation.
Amazon CloudWatch Logs Insights query syntax、filter、stats、sortの公式説明を確認する。
What to confirm
ログ検索クエリとS3移行・CloudTrail監査の役割を区別できる。
Key points
- Logs Insights
- filter
- stats
- Structured logging
Notes
- Environment: AWS公式DEA-C01試験ガイドと各サービスの公式ドキュメントの確認
- Confirm current AWS service behavior in the official DEA-C01 documentation.
Foundation review
Observability contract
Emit error code, record ID, execution ID, and input version as fields.
Search governance
Bound query duration, permissions, retention, and sensitive-field exposure.