DevOps & Data Engineer

Resilient infra,
intelligent pipelines

I design and automate cloud infrastructure and data platforms that scale — from CI/CD pipelines to petabyte-scale data lakes, built to be reliable and observable.

🟢 Open to DevOps & Data Engineering roles — Remote / Hybrid
kishore.py
# What I engineer every day
from dataclasses import dataclass

@dataclass
class Engineer:
    name:    str  = "Nanda Kishore Reddy"
    domain:  str  = "DevOps & Data"
    cloud:   str  = "AWS"  # primary
    cert:    str  = "AWS SAA"
    passion: str  = "automating everything"

async def ship():
    infra = await terraform_apply()
    data  = await spark_transform(infra)
    return await deploy(data, warehouse="Redshift")
Nanda Kishore Reddy

Engineer by trade,
automator by instinct

I'm an AWS-certified DevOps and Data Engineer with 5+ years of experience building systems that are reliable, scalable, and observable. My primary expertise is on AWS — designing cloud-native infrastructure from containerised microservices to event-driven data platforms.

On the data side, I build end-to-end pipelines using Apache Spark, Kafka, Airflow, Hadoop, and dbt — transforming raw data into analytics-ready assets in Redshift and Snowflake. I care deeply about platform reliability, shift-left practices, and clean data architecture.

When I'm not provisioning infrastructure or tuning pipelines, I'm exploring observability tooling, contributing to personal projects, and staying current with the rapidly evolving data engineering landscape.

5+
Years Engineering
1
AWS Certification
2
Cloud Platforms

Verified credentials

☁️

AWS Certified Solutions Architect

Associate — Amazon Web Services

✓ AWS Certified

What I work with

A toolkit refined through production pipelines, multi-cloud deployments, and continuous delivery.

☁️ AWS (Primary)

EMR Glue Redshift S3 EKS Lambda IAM VPC

🔧 DevOps & Infrastructure

Docker Kubernetes Terraform GitHub Actions Jenkins Helm Prometheus Grafana

📊 Data Engineering

Apache Spark Kafka Airflow Hadoop Hive dbt Snowflake Redshift

💻 Languages & Databases

Python SQL Bash PostgreSQL Tableau Azure (learning)

Projects & case studies

Illustrative builds based on real-world patterns from production environments.

Apache SparkAWS EMRRedshift

DataLake Accelerator

End-to-end data lake on AWS — ingestion from multiple sources, Spark transformation on EMR, and Redshift-based analytics layers for BI consumption.

📌 Concept project based on production patterns

🔄
KafkaKubernetesPython

StreamOps

Real-time event streaming architecture with Kafka on Kubernetes, dead-letter queues, schema registry, and automated lag alerting via Prometheus.

📌 Concept project based on production patterns

🏗️
TerraformGitHub ActionsAWS

InfraBlueprint

Terraform module patterns for AWS infrastructure with built-in compliance, cost controls, and GitOps-ready CI/CD pipeline templates.

📌 Concept project based on production patterns

📊
AirflowSnowflakedbt

Orchestrate

Airflow-orchestrated ELT pipeline with dbt transformations, Snowflake as the warehouse, and Tableau dashboards for business reporting.

📌 Concept project based on production patterns

Where I've been

5+ years shaped by cloud migrations, data platform engineering, and production DevOps.

2023 — Present

Senior DevOps & Data Engineer

Current Role

Leading cloud infrastructure design on AWS and data platform engineering. Architected Kubernetes deployments on EKS for critical data workloads, reduced infra costs by 35% through right-sizing, built self-healing pipeline frameworks using Airflow and Glue, and implemented Redshift-based data warehouse solutions serving multiple BI teams.

2021 — 2023

Data Engineer

Data Platform Team

Built and maintained large-scale Spark pipelines on AWS EMR processing terabytes of daily data from Hadoop-based sources. Migrated legacy ETL workflows to Airflow-orchestrated pipelines and introduced dbt for analytics engineering — improving data reliability and enabling self-service analytics via Tableau dashboards.

Let's build something

Get in touch

I'm open to DevOps and Data Engineering roles — remote, hybrid, or on-site. Available for freelance projects and full-time positions. I respond within 24 hours.