Rajesh Midha
AWS-Python Engineer
- Role
- Senior Engineer at Tata Consultancy Services
- Location
- Sirsa, HR, IN
- LinkedIn followers
- 500 followers
About Rajesh Midha
With 10 years of professional experience, I bring 4 years of focused expertise in Python programming, specializing in developing scalable data solutions using PySpark and leveraging a broad range of AWS services. Currently working as an AWS-Python Engineer, I design and implement efficient, cloud-native data pipelines that optimize data processing and enhance system performance.
Experience
Senior Engineer
Aug 2022 — Present · Noida, IN
Consent Management System: Currently contributing to the development of a next-generation Consent Management System, handling medical, commercial, and campaign-related consents. • Designed and implemented APIs to interface with a DynamoDB-based architecture, ensuring efficient data access and management. • Developed and maintained AWS Glue ETL jobs to transform and align consent data with downstream application requirements. • Built a robust solution using Amazon Athena to enable efficient querying and analysis of consent data stored in the database. • Customer Data Platform: Maintaining the data pipeline up-time of 99.8% while ingesting streaming and transactional data across more than 30 data sources using Spark, python, S3, Dyanmodb, Step function, and Lambda function. • Automated ETL processes across billions of rows of data, which reduced manual workload by 85% monthly. • Ingesting data from disparate data sources using a combination of SQL, request and rest API, Kinesis Data Stream, and S3 events file upload mechanism using python. • Supporting implementation and active monitoring of pipelines. Fixing the bug and adding new features as per the business requirements. • Implementing the task assigned in the sprints and providing the deliverables on time. • Work on the pipeline failures either in Glue Job/Lambda functions or updates the correct DynamoDB configuration to streamline the process. • The processed data is stored in snowflake where data analyst team uses it for analysis purposes and new dashboard creations. • Developed an automation using lambda functions for daily incidents report generation using lambda and SMTP to share with intended stakeholders which has reduced our 100% efforts on manual report creation by the team members.
Education
Kurukshetra University
Bachelor of Technology - BTech, Electrical, Electronics and Communications Engineering
2009 — 2013
Kurukshetra University
Bachelor of Technology - BTech, Electrical, Electronics and Communications Engineering
Govt. model sanskriti senior secondary school
Non Medical Science (12th), Non Medical Science
2008 — 2009
Jaipur National University
Post Graduate Diploma , Computer Applications
2017 — 2018
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.