Ekamdeep Kaur
Data Engineer @Brambles
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Brambles
Mississauga, ON, CA
Develop AWS Glue data ingestion pipelines to process data from S3 files, transforming it into Parquet format across three layers: raw, cleansed, and curated, with Athena tables created for querying.• Collaborate with multiple teams to enhance data flows, optimize integration, resolve issues, and improve data reliability and operational efficiency across various projects.• Optimized Python notebooks in Databricks by improving joins, changing SQL queries to PySpark code, and eliminating redundant table reads to enhance performance and minimize resource consumption.• Enhanced and optimized PySpark Glue job for the location dimension table by decommissioning redundant fields, removing unnecessary joins to improve efficiency and reduce resource usage.
EDUCATION
PEC University of Technology, Chandigarh
Bachelor of Technology (B.Tech.), Computer Science
DCM Group of Schools
10+2, Non-Medical
Indira Gandhi National Open University
Post Graduate Diploma, Computer Applications
ABOUT EKAMDEEP KAUR
Data Engineering Professional with 7+ years of experience in designing and building scalable, data-intensive applications across cloud platforms like GCP and AWS. Proven expertise in developing robust ETL and real-time Spark pipelines, managing big data ecosystems, and optimizing workflows for high performance and efficiency. Skilled in tools such as Spark, Kafka, Parquet, and Airflow, with hands-on experience in both batch and streaming architectures. Passionate about data quality, automation, and building reliable, scalable systems that enable advanced analytics and business intelligence.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.