Harshith L
Senior Data Engineer| GCP, Spark, Python, SQL | Big Data & Cloud Architect | Data Pipeline & ETL Expert | Streaming & Event-Driven Architectures
- Role
- Senior Aws Data Engineer at Edward Jones
- Location
- Glassboro, NJ, US
- LinkedIn followers
- 500 followers
About Harshith L
I am a Senior Data Engineer with 9+ years of experience in designing, developing, and…
Experience
Senior Aws Data Engineer
Nov 2022 — Present · St Louis, MO, US
Cloud & Data Engineering:Migrated on-premise Oracle & legacy ETL workloads into AWS S3, Redshift, and Glue, ensuring scalable and cost-effective data pipelines.Built real-time ingestion pipelines using Kinesis, Lambda, and Glue to process financial market data.Designed data lake architectures on S3 with partitioning and lifecycle policies for trading & wealth datasets.CI/CD & DevOps:Implemented CI/CD pipelines with AWS CodePipeline, CodeBuild, and GitHub Actions to automate deployments.Deployed and managed Dockerized applications on EKS (Kubernetes) and ECS for scalable workloads.Integrated CloudWatch, CloudTrail, and Prometheus for monitoring, logging, and compliance reporting.Cloud Modernization & Security:Migrated Hadoop/legacy workloads to Redshift & EMR, optimizing ETL performance and costs.Defined IAM policies, KMS encryption, and VPC security to protect sensitive financial data.Automated infrastructure provisioning using Terraform & CloudFormation for reproducible environments.Performance Optimization & Advanced Analytics:Tuned Redshift clusters and Athena queries for sub-second analytics across billions of rows.Optimized EMR Spark workloads, reducing job execution time by 40% on large (1TB+) financial datasets.Delivered analytics-ready datasets supporting AI/ML models for fraud detection and portfolio risk management.
Education
KL University
Bachelor's degree
2010 — 2014
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.