Hi there, I'm Saurabh Shubham π
Senior Data Engineer Β· Berlin, Germany
Production Data Platforms Β· Lakehouse & CDC Β· AI Engineering & Observability
- Production Data Platforms: Orchestrating Change Data Capture (CDC), lakehouse pipelines, and distributed data workflows using Dagster, Airflow, and dbt.
- Observability & Reliability: Building real-time anomaly detection, pipeline monitoring, and operational alerting with Prometheus & Grafana.
- Platform Engineering: Automated delivery, containerization, and infrastructure-as-code using Docker, Kubernetes, Terraform, and CI/CD.
- Regulation Check: Independent EU AI Act readiness application built with FastAPI and PostgreSQL, featuring deterministic screening, LLM structured outputs via AI Gateway, and automated self-healing CI/CD deployments.
- Agentic Workflows & MCP: Engineering developer workflows using Model Context Protocol (MCP) and building autonomous coding agent systems.
- Data Engineering: Python, SQL, Dagster, Apache Airflow, dbt, DLT, PySpark, CDC, Lakehouse
- Cloud & DevOps: Microsoft Azure, Google Cloud, Docker, Kubernetes, Terraform, GitHub Actions
- Databases: PostgreSQL, Graph Databases, MySQL, Oracle
- Observability: Prometheus, Grafana, Operational Alerting, Unleash



