Manufacturing equipment sends per-second time-series events, daily CSV files, and image files.
Classify the characteristics before selecting ingestion and transformation platforms.
Which design or service is most appropriate?
Classify data by volume, velocity, and variety, then choose stream, batch, and file processing that match those characteristics.
Detailed explanation
A file name does not guarantee the size, arrival rate, or structure of the content.
A file name does not guarantee the size, arrival rate, or structure of the content.
API event volume does not describe the size, arrival speed, or format of business data.
API event volume does not describe the size, arrival speed, or format of business data.
Second-level events incur delay and a single format cannot fit image and structured data equally.
Second-level events incur delay and a single format cannot fit image and structured data equally.
Ingestion latency, storage, and transformation can be matched to the data characteristics.
Ingestion latency, storage, and transformation can be matched to the data characteristics.
Check official documentation
Compare the following points with the official documentation.
AWS公式DEA-C01 Skill 1.2.9とストリーミング・バッチ・S3データ処理の説明を確認する。
What to confirm
データ量・速度・形式を区別し、処理方式を一律にしない理由を説明できる。
Key points
- Volume
- Velocity
- Variety
- Stream and batch
Notes
- Environment: AWS公式DEA-C01試験ガイドと各サービスの公式ドキュメントの確認
- Confirm the relevant DEA-C01 Skill and current AWS service documentation.
Foundation review
Workload shape
Use stream and batch patterns according to arrival and latency needs.
Format
Select schemas and transformations that fit structured and non-structured data.