Mamta Choudhary
Sr.Data Engineer
- Role
- Sr Data Engineer at Capital Group
- Location
- Boston, MA, US
- LinkedIn followers
- 500 followers
About Mamta Choudhary
With over 6+ years of experience in designing and implementing enterprise-level data solutions, this individual is a highly skilled Big Data Engineer and ETL Developer. Proficiency in various cloud platforms (AWS, Azure, GCP), ETL processes utilizing Python, PySpark, SQL, and Unix automation, and Big Data technologies (Hadoop, Spark, Hive, Cassandra). Proficient in the development of data pipelines, the automation of workflows, and the utilization of tools such as Snowflake, Databricks, and Jenkins to facilitate the processing and deployment of data. Strong expertise in sophisticated analytics, Tableau, and Power BI for data visualization. Proficient in providing scalable, fault-tolerant solutions in Agile environments to enhance performance and facilitate business intelligence initiatives.
Experience
Sr Data Engineer
Oct 2023 — Present · MA, US
Developed and executed ETL pipelines in Databricks that enable the analysis of customer utilization patterns by extracting, transforming, and aggregating data from various file formats. This was accomplished using Scala and Spark-SQL.• HBase was integrated with Spark to facilitate data ingestion, and CRUD operations were executed on HBase to optimize storage and retrieval.• Utilizing Azure Data Factory (ADF) pipelines and Python scripts, automated file validation procedures were implemented in Databricks.• Utilized Linked Services, Datasets, and Activities to create ADF pipelines that extract, transform, and import data from a variety of sources, including Azure SQL, Blob Storage, Synapse, and Azure Data Warehouse.• Optimized performance and seamless transitions were achieved by migrating on-premises ETL pipelines from MS SQL Server to Azure Cloud using ADF and Databricks.• Led the migration of DAGs from a legacy Airflow platform to Managed Airflow to enhance reliability and orchestration.• Developed data ingestion workflows for Azure services, including Azure Data Lake, Azure Blob Storage, Synapse Analytics, and Databricks, to facilitate large-scale data processing.
Education
University of Delhi
Bachelor of Science - BS
2014 — 2017
Clark University
Master of Science - MS
2023 — 2024
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.