Skip to content

Leiden treemap, insights pane, and Arrow loader hardening - #3

Merged
adsharma merged 1 commit into
mainfrom
leiden-treemap-insights-pane
Oct 2, 2026
Merged

adsharma merged 1 commit into
mainfrom
leiden-treemap-insights-pane

Conversation

@adsharma

@adsharma adsharma commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Treemap + insights pane

  • Treemap view over Leiden communities (in-process icebug Leiden, same family as GDS_LEIDEN), squarified layout after disktree, tiles weighted by PageRank. Header Graph | Treemap toggle (⌘1/⌘2, View menu). Click selects, double-click drills into the 1-hop neighborhood. (Sunburst deliberately skipped — arc-heavy painting needs more GPUI scaffolding than rects.)
  • Collapsible right insights pane (⌘I, chevron divider, View menu): top 10 nodes by PageRank over the displayed graph + Leiden community summary with modularity. PageRank rows focus the neighborhood; community rows select and jump to the treemap.
  • backend::graphr_leiden_full, backend::gds_leiden_communities readout, and tests/gds_leiden.rs porting the extension's gds_leiden.test (two cliques + bridge, gamma/bogus-param errors) with a no-extension local cross-check.

Loader hardening (fixes "0 nodes" on transformers.lbdb)

  • Root causes: lbug builds Arrow batches with arrow 55 while the crate used 56, so every downcast_ref silently decoded zero rows; plus some storage versions report Ok with empty CSR arrays.
  • collect_edge_graph is now tiered CSR → columnar Arrow → row-wise ids, each tier declining on error or empty success, so a silent-empty fast path can never hide the graph.
  • arrow pinned to 55 to match lbug 0.21.x (single unified build); icebug 13.2.0's arrow-56 arrays live behind the arrow56 alias.
  • tests/loader.rs contract tests (exact counts, no dangling endpoints, empty-DB case) + a backend unit test locking the lbug batch decode shape against future arrow/field drift.

Verification

  • transformers.lbdb loads 1440 nodes / 6285 edges via the Arrow tier.
  • Full suite green (11 lib + 2 + 2 + 2 integration), clippy 0 warnings, fmt clean.

- Treemap view over Leiden communities (in-process icebug Leiden,
  same family as GDS_LEIDEN) with squarified layout after disktree,
  PageRank-weighted tiles; header toggle switches graph/treemap
- Collapsible right insights pane: top 10 nodes by PageRank plus the
  Leiden community summary; rows focus/select into the graph
- backend: graphr_leiden_full, gds_leiden_communities readout,
  tests/gds_leiden.rs port of the extension's gds_leiden.test
- loader: tiered CSR -> columnar Arrow -> row-wise id scans so a
  silent-empty fast path can never show 0 nodes; pin arrow to 55
  to match lbug (arrow56 alias for the icebug arrays); tests/loader.rs
  plus an arrow-pin unit test locking the batch decode shape
@adsharma
adsharma merged commit ddba193 into main Oct 2, 2026
5 checks passed
@adsharma
adsharma deleted the leiden-treemap-insights-pane branch October 2, 2026 04:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant