Yashkaranpreet Singh Gill

WORK HISTORY

EDUCATION

ABOUT YASHKARANPREET SINGH GILL

Seasoned Data Engineer with 4+ years of experience designing, building, and optimizing scalable data pipelines, ETL/ELT frameworks, and cloud-native data architectures supporting enterprise analytics and AI/ML use cases.•Advanced expertise across cloud platforms Azure, AWS, and GCP including hands-on work with Azure Data Factory, Azure Synapse, Azure Databricks, AWS Glue, Amazon Redshift, AWS EMR, AWS Lambda, Ki-nesis, GCP BigQuery, Dataflow, Dataproc, and Pub/Sub.•Strong big data engineering background leveraging Apache Spark, Hadoop, Kafka, Hive, YARN, MapRe-duce, HBase, Pig, Impala, Sqoop, Zookeeper, and Flume to process large-scale, distributed datasets with reliability and performance. Hands-on experience engineering data lakes and data warehouses using Snowflake, Amazon Redshift, Azure Synapse, and BigQuery, including schema design, performance tun-ing, and data governance across PostgreSQL, MySQL, Oracle, and MongoDB.• Proficient in Python, SQL, Scala, and Java, with extensive experience building reusable processing frame-works, optimizing SQL queries, and automating workflows using Apache Airflow, ADF triggers, and Oozie, supported by CI/CD tools such as Azure DevOps, Jenkins, and GitHub Actions.• Strong background in machine learning pipeline engineering, developing and operationalizing ML work-flows with PySpark, Azure Machine Learning, AWS SageMaker, and implementing MLOps practices for model training, feature engineering, and deployment.• Skilled in Infrastructure-as-Code (IaC) using Terraform, Bicep, and CloudFormation to automate cloud re-source provisioning and support consistent, scalable multi-cloud deployments.• Adept at delivering actionable insights using Power BI, Tableau, and Looker by integrating diverse data sources, implementing advanced data models, and enabling real-time analytics dashboards.