Abdul Hannan Mohammed

About Abdul Hannan Mohammed

10+ years of experience as a Data Engineer, delivering scalable solutions for complex data challenges across diverse industries. • Specialized in designing and implementing end-to-end data pipelines, data warehousing, ETL/ELT processes, and real-time analytics frameworks. • Proficient in Big Data technologies including Spark (SQL, Streaming), Hadoop, Kafka, and NoSQL databases like MongoDB and HBase. • Extensive cloud expertise with Azure, AWS, and GCP; skilled in architecting and automating cloud-native data infrastructures. • Hands-on experience with Azure Data Factory (ADF) to orchestrate complex data workflows, integrating data from varied structured and unstructured sources. • Successfully migrated on-prem data platforms to Snowflake and GCP using Dataflow, Dataproc, and Snowflake JDBC connectors. • Strong background in building scalable ingestion frameworks using PySpark and cloud-native services to enable seamless data movement. • Deep understanding of data architecture, data modeling (dimensional/star schema), data quality, and governance best practices. • Expertise in DBT for version-controlled transformation workflows, maintaining data integrity and enabling agile development. • Experienced with Informatica IICS for cloud and hybrid data integration, enabling seamless connectivity across environments. • Skilled in performance tuning and cost optimization of large-scale data systems in cloud ecosystems. • Adept in designing secure, fault-tolerant, and high-availability systems, incorporating disaster recovery and data security best practices. • Proficient in visualization tools including Power BI, Tableau, and QuickSight, delivering actionable business insights. • Strong collaborator with cross-functional teams including Data Science, Analytics, and Product, aligning technical solutions to business goals. • Proven leadership in mentoring junior engineers, conducting code reviews, and enforcing best practices across the data engineering lifecycle. • Committed to continuous improvement, automation, and CI/CD implementation for data pipelines and deployments.

Experience

1. Senior Data Engineer Lead Data Engineer

   KeyBank

   May 2023 — Present · Brooklyn, OH, US

   Developed multi-cloud strategies leveraging Azure (Data Factory, Blob Storage, Azure SQL DB) and GCP (Databricks, BigQuery, Hadoop, Cloud Pub/Sub) for scalable data engineering solutions.• Worked with AWS services such as S3, Lambda, and Redshift for cloud infrastructure management and data storage.• Created, loaded, and analyzed data in Azure Cloud and Teradata; proficient in managing and optimizing global Teradata environments.• Developed automated ETL pipelines using Azure Data Factory, Apache Airflow, and Databricks to streamline data integration and processing workflows.• Used Airbytes to replicate and transform data from diverse sources (e.g, MySQL, PostgreSQL, MongoDB, Salesforce, Google Analytics) into centralized data warehouses.• Built and optimized data workflows using Apache Spark (PySpark, Scala) and Hadoop (HDFS, Hive) for large-scale distributed data processing.• Implemented data encryption techniques using Azure Key Vault and AWS KMS to protect sensitive customer information.• Developed and trained deep learning models using PyTorch with a focus on dynamic computational graphs for more efficient debugging and training.• Utilized Azure Purview and Apache Atlas for tracking data lineage and ensuring data governance across systems.• Implemented data stewardship and quality management processes to meet regulatory compliance standards (GDPR, HIPAA).• Performed data analysis and mining using Python (Pandas, NumPy) and visualized insights using Matplotlib, Seaborn, and Tableau.• Designed and managed CI/CD pipelines for deploying data workflows using Apache Airflow & Terraform for infrastructure automation.• Implemented Docker and Kubernetes for containerized data applications & streamlined deployment processes.• Managed PostgreSQL databases for web applications, handling schema design, complex queries, and performance optimization.• Worked with MySQL, MongoDB, Cassandra, and Teradata for high-performance data storage, retrieval & analysis.

Education

• Jawaharlal Nehru Technological University Hyderabad (JNTUH)

  Bachelor of Science - BS, Computer Science

• Trine University

  Master of Science - MS, Business Analytics