Skip to content

Clone, Memory, And Sanitizer Stability#212

Open
zayenz wants to merge 38 commits into
mainfrom
feature/clone-memory-stability
Open

Clone, Memory, And Sanitizer Stability#212
zayenz wants to merge 38 commits into
mainfrom
feature/clone-memory-stability

Conversation

@zayenz

@zayenz zayenz commented Jul 6, 2026

Copy link
Copy Markdown
Member

This branch fixes several exception-safety and sanitizer-detected failures in Gecode's clone, allocation, MiniModel, and search code.

The clone and allocation work is based on the issues reported in Gecode/gecode#211.

Changes

  • Failed cloning restores the source space if actor, advisor, local-object, variable-implementation, disposal metadata, or derived Space copying throws.
  • Partial clone destruction no longer walks inconsistent actor/advisor state.
  • Dispose-notice and AP_DISPOSE registration failures follow the ownership boundary: the space disposes an actor only after registration succeeds.
  • IntSetObject allocation initializes cleanup state before range allocation and releases the object if range allocation fails.
  • Full-width integer-domain calculations avoid signed overflow in range-width and hole-count arithmetic.
  • MiniModel expression construction cleans up partially transferred objects and arrays without changing the public LinIntExpr() zero-expression behavior.
  • Advisor recovery handles marked advisor links without typed casts.
  • BAB recomputation handles the missing-incumbent case without binding through an invalid reference.
  • Parallel search uses targeted synchronization fixes for command state, path stealing, stop state, mutable stop limits, PBS slave lifetime, restart-stop state, shared statistics, and no-good accounting.
  • Fault injection can exercise clone, dispose-notice, IntSet, MiniModel, and heap-allocation failure paths deterministically.

Relationship To PR 211

PR 211 identified real problems , several parts carry over closely, especially the IntSetObject cleanup rule, early initialization of clone fields, and guarded MiniModel ownership transfers.

Some parts changed after testing made the ownership boundary more explicit. The clearest case is AP_DISPOSE: PR 211 disposed the actor when registration allocation failed, but the fault test shows that the space does not own the actor until registration succeeds.

Two PR 211 changes are not included. The propagation-statistics virtual hook is not needed for the clone/allocation fixes and adds dispatch to a hot path. The broad locking-scope patch is also left out as a unit; the synchronization changes here are the narrower ones exercised by TSan.

Validation

Multiple local runs of ASan, UBSan, and TSan, plus targeted UBSan replays for wide integer-domain arithmetic and
no-good accounting.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your trial has ended. Reactivate Greptile to resume code reviews.

@zayenz zayenz mentioned this pull request Jul 6, 2026

@zayenz zayenz left a comment

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I pushed current main into the branch and added three review fixes:

  • 1044ec5 keeps each partial propagator and brancher list circular after every successful copy. The previous head crashed when actor copy #2 threw because recovery followed actor #1's uninitialized next link. The fault tests now cover failures on both the first and second copy.
  • 00bca10 restores the copy construction and assignment that NodeStop, FailStop, TimeStop, RestartStop, and NoGoods had before their fields became atomic.
  • 80ce269 gives the process-global fault suite its own single-threaded CTest/check target, exercises it on the Ubuntu CMake CI row, and documents the fault/sanitizer options.

The repaired crash probe and copy-semantics probe pass. Debug+Audit check, the fault suite, generated-header comparison, tidy, and ASan+UBSan fault runs also pass locally.

I am leaving these points for manual design review:

  1. Thread::run now snapshots Runnable::todelete() before run(). A Runnable that calls todelete(true) inside run() was deleted on main and is no longer deleted on this branch. That supports the PBS lifetime change, but it changes public behavior; a clean fix likely needs an explicit PBS completion handshake.
  2. TimeStop::reset() can still write Timer::t0 while parallel workers read it in TimeStop::stop(). Making only the limit atomic does not make reset/resume race-free.
  3. The new 64-bit and double atomics may require libatomic on supported 32-bit targets. Neither build system detects that dependency, and current CI is 64-bit only.
  4. FailPoint remains process-global. The supported CMake targets are now safe, but manually mixing Fault::* and ordinary tests in one multi-threaded test process is not.

I would resolve those as explicit API/platform decisions rather than fold speculative changes into this already broad stability PR.

Mikael Zayenz Lagerkvist added 27 commits July 10, 2026 16:14
Close follow-up gaps found while validating the local clone,
IntSet, and MiniModel exception-safety invariants. In particular,
recover advisor-copy state on failure, keep IntSet fault accounting
consistent when allocation throws, and make MiniModel ownership
cleanup robust under injected heap failures.

Reference: #211
Pass the incumbent best solution as an optional pointer during BAB path
recomputation. Recompute can run before an incumbent exists; the previous
reference parameter forced callers to dereference a null best pointer and
tripped UBSan.
Replace shared volatile search flags and stop limits with atomics, and close a
racy path-steal check. TSan reported concurrent reads and writes in parallel
engines and portfolio stop propagation; these fields are cross-thread
coordination state.
Delete portfolio slave engines in the PBS destructor before freeing the slave
pointer array. This closes the lifetime leak exposed by sanitizer runs.
Mikael Zayenz Lagerkvist added 10 commits July 10, 2026 16:14
Address the remaining findings from the larger sanitizer matrix: harden
integer-domain width arithmetic, avoid invalid marked-link casts, protect RBS
stop state, and make thread-runner cleanup tolerate null terminators.
Add release-note entries and file-header attribution for the clone,
IntSet, MiniModel, fault-injection, and sanitizer-stability changes.

PR 211 is kept as release-note issue metadata and as a reference for
original patch authorship where that context matters.

Reference: #211
Use relaxed atomics for the fault-injection live-allocation counters used by IntSet and MiniModel leak checks. These counters are diagnostics only, but fault-enabled TSan search runs can construct and destroy the instrumented objects concurrently.
@zayenz zayenz force-pushed the feature/clone-memory-stability branch from c0866dc to 36716c0 Compare July 10, 2026 14:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant