Manish R G
Data Engineer | Python, SQL, AWS, Snowflake | Building Scalable Data Pipelines
- Role
- System Engineer at Tata Consultancy Services
- Location
- Chennai, TN, IN
- LinkedIn followers
- 500 followers
About Manish R G
Results-driven AWS Data Engineer with 3+ Years of experience in designing and implementing scalable data pipelines and ETL processes using AWS Glue, Redshift, S3, and Snowflake. Strong expertise in SQL, Python,and automation frameworks to optimize data workflows. Skilled in building reliable, efficient, and reusable data solutions for analytics and business intelligence.
Experience
System Engineer
Mar 2022 — Present · Chennai, IN
Designed and deployed serverless data pipelines using AWS Lambda, SQS, MSK Kafka, and API Gateway to process and transform XML data with high availability and fault tolerance. •Automated ETL workflows with AWS Glue, transforming raw data from S3 into Parquet and loading into Amazon Redshift for optimized querying. •Leveraged Snowflake as a cloud data warehouse for analytics and reporting, improving query performance and scalability. •Built and tested Python-based Lambda functions with Pytest, implementing data validation, external API enrichment, and efficient file handling. •Developed event-driven architectures integrating RDS/Aurora DB for field-level transformations and downstream Lambda orchestration. •Orchestrated end-to-end ETL pipelines using Apache Airflow, designing DAGs to optimize performance, scheduling, and resource utilization. •Implemented error handling frameworks, archiving events to S3 and routing failed messages to Kafka topics with automated error reporting. •Optimized Lambda performance through chunked file reading and multipart S3 uploads, reducing costs and memory usage. •Created client-facing APIs via API Gateway and Pydantic-based validation, ensuring reliable and consistent data delivery
Education
SRM University
Master of Business Administration - MBA
2023 — 2025
Rajalakshmi Institute of Technology
Bachelor of Engineering - BE
2016 — 2020
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.