Affan Mohammed
Data Engineer | Big Data | Apache Spark | PySpark | Python | Aws EMR | Aws S3 | MYSQL | Airflow |
- Role
- Data Engineer at Infosys
- Location
- Hyderabad, TG, IN
- LinkedIn followers
- 500 followers
About Affan Mohammed
Data Engineer with over 3 years experience, specializing in building and optimizing scalable data pipelines. Proficient in SQL, Hive, Hadoop, Python, and Spark, with hands-on experience in orchestrating workflows using Apache Airflow. Skilled in designing robust ETL processes and managing data infrastructure on AWS. Adept at transforming complex financial data into actionable insights, collaborating with cross-functional teams, and enabling data-driven decision-making.
Experience
Data Engineer
Jun 2022 — Present · Hyderabad, IN
Built and optimized large-scale data pipelines using PySpark on AWS EMR, integrating with S3, Hive, and Step Functions- Managed and configured EC2 instances and EMR clusters to ensure efficient execution of Spark jobs- Transformed and analyzed raw web log data using Spark RDDs and DataFrames for downstream analytics- Resolved performance and memory issues in PySpark applications, improving job reliability and execution speed- Contributed to Agile development, including code reviews and collaboration across data engineering teams.
Education
Jawaharlal Nehru Technological University
Bachelor of Technology, Computer Science
2017 — 2021
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.