Skip to content

feat(examples): add session replay, tool security, eval pipeline (#89, #90, #91)#166

Open
xyaohubery wants to merge 3 commits into
trpc-group:mainfrom
xyaohubery:feat/session-replay-tool-sec-eval
Open

feat(examples): add session replay, tool security, eval pipeline (#89, #90, #91)#166
xyaohubery wants to merge 3 commits into
trpc-group:mainfrom
xyaohubery:feat/session-replay-tool-sec-eval

Conversation

@xyaohubery

Copy link
Copy Markdown

Summary

Three new examples for the tRPC-Agent SDK:

#89: Session/Memory Replay Testing

  • Multi-backend replay consistency verification
  • Compares responses across backends
  • Supports InMemory, Redis, SQL session/memory backends

#90: Tool Security Scanning

  • Pattern-based security scanning (shell injection, path traversal, network exfil, etc.)
  • Filter/block policy for dangerous tools
  • Integrity checks (size limits, JSON depth)

#91: Evaluation + Optimization Pipeline

  • Built-in eval test cases with keyword-based scoring
  • Auto-regression across prompt iterations
  • Iterative prompt optimization with Hy3-powered analysis

Fixes #89, Fixes #90, Fixes #91

Assisted-by: claude-code:deepseek-v4-pro

- Automated code review agent using trpc-agent-sdk + Hy3 LLM
- Structured review with bug/security/improvement detection
- SQLite persistence for review results
- OpenAI-compatible model config (works with Hy3 API)

Fixes trpc-group#92

Assisted-by: claude-code:deepseek-v4-pro
…trpc-group#89, trpc-group#90, trpc-group#91)

- Session/Memory multi-backend replay consistency testing framework
- Tool execution security scanning with filter/monitoring
- Evaluation + Optimization auto-regression pipeline
- All built on trpc-agent-sdk with Hy3 LLM backend

Fixes trpc-group#89, Fixes trpc-group#90, Fixes trpc-group#91

Assisted-by: claude-code:deepseek-v4-pro
@github-actions

github-actions Bot commented Jul 12, 2026

Copy link
Copy Markdown

CLA Assistant Lite bot All contributors have signed the CLA ✍️ ✅

@codecov

codecov Bot commented Jul 12, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
⚠️ Please upload report for BASE (main@e113610). Learn more about missing BASE report.

Additional details and impacted files
@@            Coverage Diff             @@
##             main        #166   +/-   ##
==========================================
  Coverage        ?   87.54280%           
==========================================
  Files           ?         467           
  Lines           ?       44103           
  Branches        ?           0           
==========================================
  Hits            ?       38609           
  Misses          ?        5494           
  Partials        ?           0           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@xyaohubery

Copy link
Copy Markdown
Author

I have read the CLA Document and I hereby sign the CLA

@raychen911

Copy link
Copy Markdown
Contributor

这里对于不同的issue需要分开

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

2 participants