feat(planner): compose exact functions with summaries - #359
Merged
Merged
Conversation
…ase boundaries (#171) Add phase-explicit post-ASAP nodes SummaryExpr::{ExactTransform, ExactPostProcess} carrying a non-exhaustive ExactOperator::Aggregate payload (never an intact QueryExpr subtree), plus an ExecutionAvailability {UpdateValue, SummaryState, ReadoutValue} derivation/validation (post_asap::phase) returning typed PhaseErrors at construction. construct_summary_agg now validates its edge, so a maintained summary over a query-time readout falls back conservatively instead of producing an unexecutable plan. Add ExactCompositionStrategy (registered in default_strategies) proposing Replacement::ExactComposition candidates that reference the child target rather than selecting a child; PlanSpace::global_selection commits the compatible parent/child pair using the issue's cost-units-per-second formulas (postprocess/pretransform vs raw-recompute baseline), counts shared child state once, and GlobalSelection::materialize links the committed decisions into one validated DAG with shared Rc identity. Cost hooks: CostModel::mixed_execution_capabilities and exact_composition_cost_inputs (unknowns stay None, never zero; missing statistics keep KeepPreAsap). DAG export gains explicit per-node stage, decision provenance, cost unit and child-decision links (additive). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #171
Why
The planner could build nested accumulator summaries, but it could not preserve a useful inner summary when an exact function had to run across the summary maintenance/read boundary. Those cases collapsed to an opaque raw fallback.
What
ValueOperationIR node whose semantic operation is independent fromExecutionTiming(MaintenanceTimeorReadTime)rate,irate, andincreaseare distinct intents andirateis no longer lowered asrateLipschitz(1); later accuracy-target checks therefore fail closedHow
Before: an exact fold over a summary readout, or a summary over an exact function without accumulator state, remained an opaque
KeepPreAsapregion.iratealso lost its identity by lowering toRate, and unclassified exact functions could inherit a placeholder accuracy rule.After: the planner selects and materializes
ValueOperation(operation, timing)around the independently selected summary plan. Function definitions supply semantic identity and accuracy/capability rules; execution timing remains an independent physical property. No function- or issue-specific physical node is introduced.For exact samples,
rate,irate, andincreaseremain exact. For approximate samples, reset detection and boundary extrapolation do not receive a guessed bound: the guarantee remains unknown unless a deployment registers a proof-backed rule with sufficient evidence.Review fixes
Validation
cargo fmt --all -- --checkcargo check --workspacecargo clippy --workspace --all-targets -- -D warningscargo test -p asap-types --lib(182 passed)cargo test -p asap-aware-mapping --lib(392 passed)cargo test -p asap-frontend-promqlcargo test -p asap-integration-tests --test exact_composition(13 passed)cargo test --workspacepreviously reached the environment linker limit for several large DataFusion test binaries (lldbus error); focused suites above pass.