Skip to content

feat: add mutation generator and precision/recall detection metrics (#93) - #158

Draft
askmy-stack wants to merge 1 commit into
mainfrom
cursor/mutation-generator-c2a5
Draft

askmy-stack wants to merge 1 commit into
mainfrom
cursor/mutation-generator-c2a5

Conversation

@askmy-stack

Copy link
Copy Markdown
Owner

Summary

Implements #93 — mutation generator with precision/recall detection metrics.

Changes

  • tool_semantics.mutations: operators for rename, remove tool, add required param, confusing twin, risk escalation, capability drop
  • Seeded CI run (--seed 0) covering each operator once
  • Regression corpus under benchmarks/mutations/*/before|after|expected-finding.json
  • CLI: tool-semantics mutate
  • Docs: docs/mutations.md (research positioning)
  • CI steps for seeded + corpus runs

Test plan

  • pytest tests/test_mutations.py
  • tool-semantics mutate … --seed 0
  • tool-semantics mutate … --corpus benchmarks/mutations
  • CI green

Closes #93

Open in Web Open in Cursor 

)

Named operators (rename/remove/required param/twin/risk/capability drop),
seeded CI gate, regression corpus folders, and mutate CLI.

Co-authored-by: Abhinaysai Kamineni  <askmy-stack@users.noreply.github.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add mutation generator and precision/recall detection metrics

2 participants