Abhijeet Garad
Senior Data Engineer@TCS || Python || SQL || Pyspark || AWS Services || ETL Pipelines || Data Visualization || MS-Excel || Probability & Statistics || AWS Certified
- Role
- Senior Data Engineer at Tata Consultancy Services
- Location
- Pune, MH, IN
- LinkedIn followers
- 500 followers
About Abhijeet Garad
Data Engineer with specializing in migrating data from on-premise to AWS Cloud using Apache Airflow and AWS Glue. Skilled in designing and managing automated data pipelines, ETL processes, and cloud data warehousing solutions. Proven ability to ensure accurate, efficient data transfers and resolve technical challenges.
Experience
Senior Data Engineer
May 2022 — Present · Pune, IN
Led the migration of tables and 287 schemas to a cloud-based data architecture in AWS, optimizing data storage and access for business-critical applications- Utilized AWS Glue for ETL workflows to automate data extraction, transformation, and loading tasks, reducing manual intervention and ensuring scalable data integration- Built and optimized complex ETL pipelines using AWS Lambda, Amazon S3, and Amazon Redshift, enabling real-time data processing and storage in a secure and cost-effective manner- Employed Apache Spark (PySpark) for distributed data processing, improving performance for large-scale data transformations and aggregations- Collaborated with cross-functional teams to define and implement data migration strategies, ensuring smooth transition and minimal downtime during the migration process. Managed data projects using agile methodology, including creating Jira tasks for sprints and maintaining Confluence pages for documentation and collaboration- Implemented error handling, logging, and monitoring solutions using AWS Cloud Watch to track data pipeline performance and ensure timely resolution of issues- Project 1- Designed and managed a data migration pipeline by utilizing Apache Airflow to automate data loading from client databases to Amazon Redshift- Implemented SQL-based data validation using DB Visualizer to enhance data integrity and consistency, reducing data discrepancies by 20% between source databases and Amazon Redshift- Utilized GitHub for version control and Jira for project management, ensuring seamless integration and deployment processes, leading to a 15% increase in project milestone completion rate- Engaged with cross-functional teams to analyze data requirements and deliver scalable data solutions, in alignment with data governance and security policies, resulting in a 25% improvement in data management efficiency.
Education
Vidya Pratishthans College of Engineering, M.I.D.C.road, Baramati, Dist.Pune
Bachelor of Engineering
2016 — 2020
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.