feat: add AVE-2026-00083, Silent Guardrail Comparison Failure - #277
Merged
chaksaray merged 2 commits intoSep 22, 2026
Merged
Conversation
Proposed by arian-gogani (CWE-CAPEC/AI-Working-Group#1), backed by five independently reproduced structural forms against real shipped code (deepeval, litellm, openai-agents-python, guardrails-ai, autogen, AutoGPT classic, rebuff) and prevalence data with stated limitations at github.com/arian-gogani/failopen. Confirmed genuinely distinct from the nearest existing records (AVE-2026-00038, 00063, 00076, 00078, 00079) field by field, not by label. ave_id confirmed via issue #276.
…3-silent-guardrail-comparison-failure Resolves conflict from AVE-2026-00081/00082 landing on develop while this branch was open. CHANGELOG and README are combined additively (all three records kept, in ave_id order); README counts recomputed for the resulting 83-record total (HIGH 15, MEDIUM 65, unchanged CRITICAL 1 / LOW 2). dist/ left at develop's content -- it's regenerated by the regenerate-records-json.yml workflow after merge, not hand-edited per PR.
Merged
4 tasks
chaksaray
deleted the
feat/AVE-2026-00083-silent-guardrail-comparison-failure
branch
September 22, 2026 00:02
5 tasks
chaksaray
added a commit
that referenced
this pull request
Sep 22, 2026
chaksaray
added a commit
that referenced
this pull request
Sep 22, 2026
…283) Co-authored-by: Nicolai <245527909+predictor2718@users.noreply.github.com> Co-authored-by: Claude <noreply@anthropic.com> Co-authored-by: chaksaray <15962335+chaksaray@users.noreply.github.com> Co-authored-by: Sankalp Gilda <sankalp.gilda@gmail.com> Co-authored-by: Empire Labs Pty Ltd <narko4u@gmail.com> Co-authored-by: narko4u <narko4u@users.noreply.github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
AVE-2026-00083: a protection mechanism (guardrail, approval gate, or judge) that executes on every request and reports a permissive result because its own comparison, branch, or aggregation logic never evaluates the real input — distinct from a missing or bypassed check.confident-ai/deepeval,openai/openai-agents-python,BerriAI/litellm,guardrails-ai/guardrails,microsoft/autogen, plus AutoGPT classic and archivedprotectai/rebuff, both with no live disclosure channel) and prevalence data with stated limitations, all from arian-gogani'sfailopen— proposed inCWE-CAPEC/AI-Working-Group#1.researchercredits him directly; this is his original measurement, not AVE's cataloguing.ave_idconfirmed via New record: silent guardrail comparison failure #276, including field-by-field distinctness checks against the nearest neighbors:AVE-2026-00063(check disabled via a legible config flag, versus this record's check that runs and is structurally blind),AVE-2026-00076(classifier genuinely evaluates real input but is steered, versus this record's comparison that never reaches its deny branch regardless of input),AVE-2026-00078/AVE-2026-00079(no verification step exists at all, versus this record's check that exists and is invoked), andAVE-2026-00038(no gating mechanism present at all).MEASUREMENT.md(fifteen across thirty-six projects, twenty-one read clean), confirmed by reading the primary source directly rather than the issue summary.cvss_base8.7,aars4.0) rather than the class's more severe-sounding plain-English framing — reasoning for every factor, and for theowasp_mcpmapping (MCP07, an honestly-imperfect best fit) and the emptyowasp_asi/mitre_atlas/nist_ai_rmffields (each checked against its live primary source directly), is inaivss.notes.CHANGELOG.mdupdated per the standard process.Test plan
python3 scripts/validate_records.py— all 82 records (80 ondevelop+ this one + an unrelated pending draft already in the working tree) valid againstschema/ave-record-1.1.0.schema.jsonpython3 scripts/check_fixtures.py— positive and negative fixtures present forAVE-2026-00083python3 scripts/write_verification_basis.py— derivedverification_basismatches the stamped value, no mismatchpytest tests/ -x -q— 478 passed