Data Engineering · Cloud · Agentic AI
Building reliable data platforms and exploring how AI agents can make them more autonomous.
I'm a Data Engineer based in Germany with 10+ years of experience building data systems. My journey spans the evolution of the field—from Informatica PowerCenter and Hadoop/Spark to cloud-native platforms on GCP and AWS, and now Agentic AI.
At FINN, I help build and evolve the core data platform on GCP, combining modern data engineering with AI-assisted workflows and autonomous problem resolution. Previously, I worked at Uplight, Clairvoyant (embedded with PayPal), and TCS.
Outside work, I share practical lessons about data engineering, architecture trade-offs, AI-assisted engineering, career growth, and life in Germany through Rishi Bytes.
- Reliable data platforms: scalable batch and streaming pipelines, observability, testing, and trusted data products
- Cloud architecture: GCP and AWS systems designed for operability, cost awareness, and long-term maintainability
- Agentic AI: production workflows where agents assist investigation, automation, and autonomous problem resolution
- Knowledge sharing: honest engineering lessons through articles, videos, and open-source experiments
| Area | Technologies |
|---|---|
| Languages & transformation | Python, SQL, dbt |
| Processing & orchestration | Spark, Kafka, Airflow |
| Cloud & data platforms | GCP, AWS, BigQuery, Dataflow, Pub/Sub, Snowflake |
| AI & automation | LLMs, RAG, vector databases, AI agents |
| Platform engineering | Terraform, Docker, Kubernetes, CI/CD |
- todo-bytes — lightweight YAML-based task management with a CLI and browser UI
- hello-openclaw — Docker-based starter for running OpenClaw locally in an isolated container
- rishibytes.com — my home for recent videos, articles, and ideas across data engineering and AI
- Cheap Tokens Won't Make You a Better Engineer
- Why I'm Breaking the DRY Rule: The Case for Data Duplication
- I Stopped Googling. But Is AI Search Actually Honest?
- From Informatica to dbt: Journey to Modern, Maintainable Data Pipelines
- Cheap AI Tokens Won't Make You a Better Engineer
- The Bizarre Human Middleware Loop
- I Watched Two AI Agents Debug a Google Outage Through Two Humans
Find the latest articles and videos at rishibytes.com.
Google Cloud Professional Data Engineer — earned May 2023, expired May 2025.
I have also completed learning programs across GCP, AWS, Airflow, Databricks, Dremio, and applied AI. See selected credentials and recognition for dates and available verification links.
I'm always happy to exchange ideas about data platforms, cloud architecture, Agentic AI, or engineering careers.