Skip to content

release: verification 20.11% per record / 33.92% per product - #154

Merged
Seungpyo1007 merged 2 commits into
mainfrom
develop
Aug 10, 2026
Merged

release: verification 20.11% per record / 33.92% per product#154
Seungpyo1007 merged 2 commits into
mainfrom
develop

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Aug 10, 2026

Copy link
Copy Markdown
Member

Release of the 146 GPU promotions and the refreshed status aggregate. Merging deploys the site and notifies TechEngine.

records  105,742   verified 21,260  = 20.11%   (was 19.97%)
models    62,148   verified 21,082  = 33.92%   (was 33.69%)

Only GPU moved: 32.66% → 39.85%.

What earned it

No data was added. vendor_core_field failed whenever cuda_cores/stream_processors was absent — but both are already gpu RICH_FIELDS, so completeness scored that same absence and consistency billed it a second time, under a name claiming the record contradicts itself. Of the 281 records carrying the flag, 279 were plain gaps (including the NV1, RIVA 128 and GeForce 256 — parts that predate the unified shader, where a CUDA core count is inapplicable rather than missing) and 2 were real vendor mismatches. Only the mismatch still fails (GetTechAPI/TechEngine#57).

Predicted 147 records would cross the green threshold; 146 did.

Closes #1

Auto-promotions from the verification layer (green+live-source or crossref-confirm).
Each flip is verified:false->true only; see data/_verify/ledger.jsonl. Refs #1
@TechEngineBot

Copy link
Copy Markdown
Member

🔎 Data verification — Tier 0 (offline existence/trust)

Scored by app.verify; posted by TechEngineBot. Informational only — the structural gate (app.validate) is separate and authoritative for merge.

Changed records in this PR

146 record(s) scored.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 146
    "Yellow" : 0
    "Red" : 0
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
gpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 146 146 0 0 100.0%
All 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 146 146 0 0 100.0%

Full-dataset baseline

105742 record(s) scored.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 21256
    "Yellow" : 83285
    "Red" : 1201
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
brand 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 207 24 183 0 11.6%
soc 🟩🟨🟨🟨🟨🟨🟥🟥🟥🟥🟥🟥 2104 146 844 1114 6.9%
smartphone 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 93396 17382 75934 80 18.6%
tablet 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 3455 218 3236 1 6.3%
watch 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 433 18 410 5 4.2%
pda 🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨🟨 140 66 74 0 47.1%
gpu 🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨🟨🟨 2030 810 1220 0 39.9%
cpu 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟥 3977 2592 1384 1 65.2%
All 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 105742 21256 83285 1201 20.1%

Hard violations (forced red):

Count Check
1 !boost_ge_base

green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to verified runs in the scheduled verify-network workflow.

@Seungpyo1007
Seungpyo1007 merged commit e18c63a into main Aug 10, 2026
10 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in TechAPI-Project Aug 10, 2026
@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine change review: PASS

Check Result
python -m app.validate PASS
python integrity_check.py TechAPI/data --strict PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 0 0 0 0 0
smartphone 0 0 0 0 0 0
tablet 0 0 0 0 0 0
watch 0 0 0 0 0 0
pda 0 0 0 0 0 0
gpu 0 0 0 0 0 0
cpu 0 0 0 0 0 0

Changed record examples

  • No data file changes detected.

Heuristic review

  • Heuristic warnings: none found.

@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine validation stats: PASS

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 207 24 183 0 207 11.6%
soc 2104 146 1958 0 2104 6.9%
smartphone 93396 17384 76012 0 93396 18.6%
tablet 3455 218 3237 0 3455 6.3%
watch 433 18 415 0 433 4.2%
pda 140 66 74 0 140 47.1%
gpu 2030 809 1221 0 2030 39.9%
cpu 3977 2595 1382 0 3977 65.3%
all 105742 21260 84482 0 105742 20.1%

Warning

Tracked verified coverage is below 50% for watch 4.2% (18/433), tablet 6.3% (218/3455), soc 6.9% (146/2104), brand 11.6% (24/207), smartphone 18.6% (17384/93396), all 20.1% (21260/105742), gpu 39.9% (809/2030), pda 47.1% (66/140).
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py --strict
loaded CPU=3977 GPU=2030
✅ integrity gate: no hard anomalies.
Integrity section Flagged lines
structural 0
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 8
CPU cross-source ratio outliers (possible wrong-variant) 152
GPU cross-source ratio outliers + sanity 18

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants