Skip to content
View dev404ai's full-sized avatar

Highlights

  • Pro

Block or report dev404ai

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
dev404ai/README.md

Oleg Solozobov

AI Software Engineer · AI Agents, Evaluation & Reliability

I build software and platforms, with a focus on reliable AI systems. My background spans distributed systems, cloud platforms, and services operated in production. My open source projects explore how to evaluate AI agents, trace their actions, and understand failures.

Independent research on evaluating AI agents and reconstructing their decisions. Papers and code are linked below.

Open Source Contributions

  • Giskard — Authored a merged fix that preserves partial interaction traces when input generation fails.
  • OpenTelemetry GenAI — Authored a proposal for external references to AI inference content. Open pull request.

Selected Projects

  • inspect-evidence-sufficiency — Checks whether AI agent traces contain the evidence needed for a release decision. Includes an optional CI gate.
  • decision-trace-reconstructor — Reconstructs AI agent decisions from recorded traces and reports which facts are evidenced, missing, or opaque.
  • operational-evidence-plane — Reference implementation connecting release manifests, agent actions, permissions, traces, and replay data.

Engineering Focus

  • AI Agents & Evaluation — agent workflows, evaluation pipelines and release checks.
  • Reliability & Observability — tracing, failure analysis, safe deployment and rollback.
  • Decision Reconstruction — recovering decision context from traces and runtime records.
  • Platform Engineering — distributed services, cloud infrastructure and data pipelines.

Technologies

  • Languages: Python, Go.
  • Platforms and data: Kubernetes, Terraform, AWS, GCP, Kafka, Flink, ClickHouse, PostgreSQL.
  • Observability and controls: OpenTelemetry, Prometheus, Grafana, OPA/Rego, Vault, OAuth2/OIDC.
  • Agent integration: MCP.

Selected Research Preprints

More research preprints

Connect

LinkedIn · Writing on Medium · Research on ORCID

Pinned Loading

  1. rulehub/rulehub rulehub/rulehub Public

    Policy-as-Code guardrails for ML and LLM systems: OPA/Kyverno policies, compliance mappings, signed bundles, evidence trails, and plugin index.

    Python 8 1

  2. costscope/costscope costscope/costscope Public

    Open FinOps and governance data plane for FOCUS 1.2 cost normalization across cloud, on-prem, GPU, and AI/LLM workloads.

    Go 1 2

  3. governance-evidence/decision-event-schema governance-evidence/decision-event-schema Public

    JSON Schema for decision events as governance evidence units in automated decision and real-time risk systems. MIT.

    Python 1 1