feat(enrichment): unify binary extension inventory for asset-weight and provenance - #3252
Conversation
…nd provenance Extract shared binary-extensions module so asset-weight and provenance stay in sync, and add scientific/data formats (HDF5, NumPy, Parquet, Arrow, ORC, MessagePack, lz4, brotli) with dedicated parity tests. Co-authored-by: Cursor <cursoragent@cursor.com>
|
🚨 Contributor flagged. Click here for more info: Superagent Dashboard |
|
Superagent didn't find any vulnerabilities or security issues in this PR. |
|
Warning 🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 ⏸️ Gittensory review result - manual review recommendedReview updated: 2026-07-04 22:51:40 UTC
⏸️ Suggested Action - Manual Review Review summary Nits — 6 non-blocking
Review context
Contributor next steps
Signal definitions
🟩 Safe / merged · 🟦 Advisory · 🟨 Held for review · 🟥 Blocked / closed 💰 Earn for open-source contributions like this. Gittensor lets GitHub contributors earn for the work they already do — register to start earning →. Checked by Gittensory, a quiet PR intelligence layer for OSS maintainers.
|
Summary
binary-extensions.tsmodule soasset-weightandprovenanceuse the same binary file inventory instead of duplicated extension lists that can drift..h5,.hdf5), TensorFlow SavedModel (.pb), NumPy (.npy,.npz), Parquet/Feather/Arrow/ORC, MessagePack, lz4, and brotli.binary-extensions.test.tsplus regression cases inasset-weight.test.tsandprovenance.test.ts.Motivation
Asset-weight and provenance previously maintained separate binary extension lists. This refactor keeps them synchronized and improves classification for scientific data artifacts that should be treated as binary assets rather than reviewable text.
Test plan
npm run buildinreview-enrichment/binary-extensions.test.ts— parity betweenisBinaryFileExtension()andBINARY_EXT_RE, case insensitivity, negativesasset-weight.test.ts— scientific/compression formats classified as binary assetsprovenance.test.ts— scientific data paths classified as binary in provenance analysisMade with Cursor