Skip to content

Log each operator's frontier interest with its summary - #836

Merged
frankmcsherry merged 1 commit into
TimelyDataflow:masterfrom
frankmcsherry:log-frontier-interest
Nov 8, 2026
Merged

frankmcsherry merged 1 commit into
TimelyDataflow:masterfrom
frankmcsherry:log-frontier-interest

Conversation

@frankmcsherry

Copy link
Copy Markdown
Member

Operator summaries now log each input's frontier interest, so a user can audit which operators are scheduled as frontiers move.

OperatesSummaryEvent gains notify: Vec<FrontierInterest>, one entry per input, read from notify_me() at the point where the summary is already logged.
This follows the summary's own shape, which already carries per-port information for the whole operator.
A region's entry is the strongest interest among its children, and at least IfCapability, so joining with OperatesEvent names shows which child keeps a region awake.
FrontierInterest derives Serialize, Deserialize and Columnar so that it can be logged.

For input -> region { map -> inspect_core } -> probe the summaries report FlatMap: [Never], Inspect: [Always], Region: [Always], and Probe: [Always]; without the inspect_core the region reports [IfCapability].
The new test checks these, and the mdbook's logging chapter describes the field.

This changes the fields of a public log event, so code that constructs or exhaustively matches OperatesSummaryEvent needs updating.

🤖 Generated with Claude Code

`OperatesSummaryEvent` gains `notify`, one `FrontierInterest` per input, taken from `notify_me()` where the summary is already logged.
A region's entry is the strongest interest among its children, and at least `IfCapability`.
Joined with `OperatesEvent` names, this shows which operators are scheduled as frontiers move, and which child keeps a region awake.

`FrontierInterest` derives `Serialize`, `Deserialize` and `Columnar` so it can be logged.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@frankmcsherry
frankmcsherry merged commit 5d82cb0 into TimelyDataflow:master Nov 8, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant