What you need to know
Why can a pipeline aggregation emit more than one result for the same time bin?
Potentially affected
Azure Monitor pipeline dataflows that aggregate logs with summarize before cloud ingestion.
DSE recommendation
Design downstream interpretation around batch-local aggregates rather than assuming one final record per time bin.
Source facts
Azure Monitor pipeline aggregates each incoming batch; its default processing interval is one minute. A batch processor is required, and changing that interval is not available through the portal. Microsoft warns that aggregation adds up to five minutes of latency and that a query using bin() can produce multiple records for the same interval because ingestion is streaming and batched. Microsoft Learn.
Applicability
Review dataflows using summarize, their batch-processor configuration, and the queries consuming the resulting records. Keep the aggregation window separate from the time bins expressed in KQL. Establish what each exported value represents before treating repeated timestamps as duplicate source events.
DSE recommendation
Design downstream interpretation around batch-local aggregates rather than assuming one final record per time bin. Have the query owner document how multiple partial results will be handled for the chosen calculation. Retain the original count or other necessary supporting fields in the proposed schema when the downstream calculation needs them. Review latency tolerance before using these aggregates for urgent decisions.
Verification
Send a controlled set of records across more than one collection batch while keeping their event times inside one selected bin. Compare emitted aggregates with the known inputs and the downstream result. Check timing as well as arithmetic. Preserve the batch configuration, transformation, input set, and outputs so a later interval change can be assessed without assuming that matching bin labels imply a single completed total.
Official references
Microsoft Learn: Azure Monitor pipeline transformations. Source reviewed September 9, 2026.
Review the official source
Configure Azure Monitor pipeline transformations - Azure Monitor | Microsoft Learn · Verified September 9, 2026
Need help applying this guidance safely?
DSE can help confirm applicability, protect service continuity, and validate the result across physical security and IT systems.
Talk with DSE