Imran Khan Abdul
Data Engineer @Illinois Department of Innovation & Technology (DoIT)
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Illinois Department of Innovation & Technology (DoIT)
IL, US
Migrated legacy data warehouses to Snowflake and AWS, developing scalable cloud infrastructure.Designed and maintained ETL pipelines using Azure Data Factory, T-SQL, and Spark SQL for efficient data processing and integration.Optimized Python-based predictive models with Pandas, NumPy, and scikit-learn.Created and maintained CI/CD pipelines, streamlining deployment with tools like Jenkins and Terraform.Leveraged Databricks Spark and Jupyter Notebooks for advanced data analytics and insights.Built and managed real-time data pipelines using Apache Airflow in GCP Composer, incorporating Hadoop and Python operators.Developed interactive dashboards in Power BI for complex aggregate reporting.Migrated on-prem SQL Server data to Azure Synapse Analytics and Azure SQL DB, improving query performance and scalability.
EDUCATION
University of Illinois Springfield
Master's degree
Vellore Institute of Technology
Bachelor of Technology
Project Management Institute
Master's degree
ABOUT IMRAN KHAN ABDUL
I am a Data Engineer with 6+ years of experience designing and optimizing ETL pipelines, cloud data warehouses, and real-time streaming platforms. Skilled in Python, SQL, Spark, and Kafka with expertise across AWS, GCP, and Azure. I have a proven track record of reducing ETL runtimes by 40% and enabling cross-functional teams to make faster, data-driven decisions. As a PMP-certified professional, I bridge technical depth with project leadership to deliver scalable, cost-effective solutions
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.