Syed Mehdi

About Syed Mehdi

Currently working as a Data Engineer in Data infrastructure & integration team with prime focus on making data available for Analytics purpose through ETL/ELT pipelines and managing its security aspects as well. Working on Azure cloud technologies.Demonstrated history of working in the Financial services industry at Foree.co and Data security industry at Securiti.ai.Experienced in - Python (Programming Language), C++/C- Object Oriented Programming- Web Development (HTML, CSS, JS, PHP, Bootstrap)- MongoDB, MySQL, SQL Server- AWS, Windows, Linux- Flask and Django web frameworksMedium level understanding of - GoLang- Dockers + Kubernetes + Helm- Bash ScriptingHave good communication skills and strong engineering background with a Bachelors in Computer Systems Engineering from NED University of Engineering and Technology.

Experience

1. Data Engineer

   LyondellBasell

   Apr 2022 — Present · Houston, TX, US

   Working in Data Infrastructure & Integration team as Data Engineer. Major contributions are- Implemented ETL/ELT pipelines for data from different sources like APIs, SAP, SharePoint, File Share etc. using Azure Data Factory, Snowflake and Azure Databricks- Performed data transformations across multiple formats like JSON, CSV, Parquet, XML etc. using ADF dataflows, SQL and PySpark- Worked on rapidly changing data sources using Change Data Capture (CDC) technique through HVR and QLIK- Processed high-volume time-series data from plant sensors using Azure Event Hub- Successfully led end-to-end data integration projects, ensuring timely and high-quality deliverables using Agile development methodology- Collaborated with Data Security teams to ensure sensitive data handling complied with data privacy regulations, implementing security techniques such as RLS, CLS, and data masking- Developed monitoring dashboards for data pipelines and cloud resources for timely updates about Failures, throttling issues, CPU utilization, Storage consumption, Cost incurrence etc. Used Azure log analytics and integrated threshold based email notifications- Optimized data storage and query performance by implementing indexing, partitioning, and aggregation strategies

Education

• NED University of Engineering and Technology

  Bachelors in engineering, Computer Systems Engineering

  2014 — 2018