Mahesh Krishna
Senior Data Engineer|Big Data Developer|Spark|SQL|AWS|Python|Data Analysis
- Role
- Data Engineer Ii at Amazon
- Location
- Hyderabad, TG, IN
- LinkedIn followers
- 500 followers
About Mahesh Krishna
Senior Data Engineer with 8.9 years of experience in the IT industry and 6.9 years of experience specifically as Big Data Developer.Proven ability to design, develop, and implement scalable data pipelines using big datatechnologies Apache Spark, Hadoop, and Hive. Expertise in Python, Java, SQL, Kafka and AWScloud services (EMR, EC2, Athena,Glue, Redshift) to extract, transform, and load data for advanced analytics and machine learning applications. Strong leadership skills with experience mentoring junior team members and collaborating effectively within cross-functional teams1.Design and Development of Data Processing Improved 2X with an Extreme DataPipeline framework.2. Reduced batch processing time by 33% by implementing parallel launching andprocessing of jobs using PySpark in AWS EMR.3. Transformed and loaded 2 TB of data into AWS S3, creating over 300 tables forbusiness stakeholders and Business Analytics team.4. Developed an automated Airflow data pipeline that saves 50% on cluster resourcecosts for daily data processing and loading.5. Improved query performance by 2X times through compaction and archiving ofin-memory databases.6. Increased international transaction processing by 30% by developing an ISO SWIFTmessage ingestion pipeline using Kafka to PostgresQL.7. Developed scalable message adaptor microservices for fault tolerance and handlingmessage partitions in Kafka topics.8. Lead the team and coordinate and supported the technical and business deliverables9.Pipeline Development and Migrated 25 Talend ETL jobs to AWS Cloud
Experience
Data Engineer Ii
Sep 2025 — Present · Hyderabad, IN
Education
KL University
BTech - Bachelor of Technology, Electrical, Electronics and Communications Engineering
2012 — 2016
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.