Question 5
Content Domain 1: Data EngineeringA data engineer is designing an ingestion process for sensor events that must be processed continuously as they are generated rather than collected and loaded at scheduled intervals. Which data job type is the best fit for this requirement?
Correct answer: B
Explanation
Use streaming when data must be ingested and processed continuously as it is produced, and use batch load when data can be collected and loaded at defined intervals. — Source material: Identify data job styles and job types, for example, batch load, streaming.
Why each option is right or wrong
A. Batch load
Batch load collects data and loads it at scheduled intervals rather than continuously as events occur.
B. Streaming
The requirement is to process sensor events continuously as they are generated, which matches streaming rather than interval-based loading. The source material identifies streaming as a data job type distinct from batch load for this kind of ongoing ingestion pattern.
C. Manual export
Manual export is not identified here as a data job style for continuous ingestion.
D. Periodic archive
Periodic archive implies grouped handling over time, not continuous event-by-event processing.