I design and automate cloud infrastructure and data platforms that scale — from CI/CD pipelines to petabyte-scale data lakes, built to be reliable and observable.
# What I engineer every day from dataclasses import dataclass @dataclass class Engineer: name: str = "Nanda Kishore Reddy" domain: str = "DevOps & Data" cloud: str = "AWS" # primary cert: str = "AWS SAA" passion: str = "automating everything" async def ship(): infra = await terraform_apply() data = await spark_transform(infra) return await deploy(data, warehouse="Redshift")
About
I'm an AWS-certified DevOps and Data Engineer with 5+ years of experience building systems that are reliable, scalable, and observable. My primary expertise is on AWS — designing cloud-native infrastructure from containerised microservices to event-driven data platforms.
On the data side, I build end-to-end pipelines using Apache Spark, Kafka, Airflow, Hadoop, and dbt — transforming raw data into analytics-ready assets in Redshift and Snowflake. I care deeply about platform reliability, shift-left practices, and clean data architecture.
When I'm not provisioning infrastructure or tuning pipelines, I'm exploring observability tooling, contributing to personal projects, and staying current with the rapidly evolving data engineering landscape.
Certifications
Associate — Amazon Web Services
✓ AWS CertifiedSkills & Tools
A toolkit refined through production pipelines, multi-cloud deployments, and continuous delivery.
Selected Work
Illustrative builds based on real-world patterns from production environments.
End-to-end data lake on AWS — ingestion from multiple sources, Spark transformation on EMR, and Redshift-based analytics layers for BI consumption.
📌 Concept project based on production patterns
Real-time event streaming architecture with Kafka on Kubernetes, dead-letter queues, schema registry, and automated lag alerting via Prometheus.
📌 Concept project based on production patterns
Terraform module patterns for AWS infrastructure with built-in compliance, cost controls, and GitOps-ready CI/CD pipeline templates.
📌 Concept project based on production patterns
Airflow-orchestrated ELT pipeline with dbt transformations, Snowflake as the warehouse, and Tableau dashboards for business reporting.
📌 Concept project based on production patterns
Experience
5+ years shaped by cloud migrations, data platform engineering, and production DevOps.
Leading cloud infrastructure design on AWS and data platform engineering. Architected Kubernetes deployments on EKS for critical data workloads, reduced infra costs by 35% through right-sizing, built self-healing pipeline frameworks using Airflow and Glue, and implemented Redshift-based data warehouse solutions serving multiple BI teams.
Built and maintained large-scale Spark pipelines on AWS EMR processing terabytes of daily data from Hadoop-based sources. Migrated legacy ETL workflows to Airflow-orchestrated pipelines and introduced dbt for analytics engineering — improving data reliability and enabling self-service analytics via Tableau dashboards.
Contact
I'm open to DevOps and Data Engineering roles — remote, hybrid, or on-site. Available for freelance projects and full-time positions. I respond within 24 hours.