Remove unnecessary fields from each event arriving in S3 and produce standard JSON.
Each transformation completes quickly and no server management is desired.
Which processing platform is most appropriate?
Use AWS Lambda for short, event-driven JSON transformations without server management.
Detailed explanation
Lambda runs short event-driven transformations without requiring server management.
Lambda runs short event-driven transformations without requiring server management.
Macie detects sensitive information in S3 and does not perform arbitrary JSON transformations.
Macie detects sensitive information in S3 and does not perform arbitrary JSON transformations.
An EMR cluster suits large distributed workloads but adds unnecessary startup and operating cost for small transformations.
An EMR cluster suits large distributed workloads but adds unnecessary startup and operating cost for small transformations.
Access Analyzer analyzes IAM policies and access, not event records.
Access Analyzer analyzes IAM policies and access, not event records.
Check official documentation
Compare the following points with the official documentation.
AWS Lambdaの実行時間、メモリ、同時実行、S3イベント連携を確認する。
What to confirm
小規模イベント変換と大規模分散ETLの使い分けを説明できる。
Key points
- Lambda
- Event-driven
- JSON normalization
- Short execution
Notes
- Environment: AWS公式DEA-C01試験ガイドと各サービスの公式ドキュメントの確認
- Confirm current AWS service behavior in the official DEA-C01 documentation.
Foundation review
Compute fit
Workload size and duration determine whether Lambda or a distributed engine is appropriate.
Idempotency
Retries can invoke a transformation more than once, so output writes should be safe to repeat.