Anjali T
Azure Data Engineer
- Role
- Azure Data Engineer at Comcast
- Location
- Jersey City, NJ, US
- LinkedIn followers
- 500 followers
About Anjali T
Highly skilled and experienced Azure Data Engineer with over 10 years of expertise in…
Experience
Azure Data Engineer
Mar 2022 — Present · Englewood, CO, US
Designed and implemented scalable data ingestion pipelines using Azure Data Factory, ingesting data from various sources such as SQL databases, CSV files, and REST APIs. Developed data processing workflows using Azure Databricks, leveraging Spark for distributed data processing and transformation tasks. Ensured data quality and integrity by performing data validation, cleansing, and transformation operations using Azure Data Factory and Databricks. Designed and implemented a cloud-based data warehouse solution using Snowflake on Azure, leveraging its scalability and performance capabilities. Created and optimized Snowflake schemas, tables, and views to support efficient data storage and retrieval for analytics and reporting purposes. Collaborated with data analysts and business stakeholders to understand their requirements and implemented appropriate data models and structures in Snowflake. Developed and optimized Spark jobs to perform data transformations, aggregations, and machine learning tasks on big data sets. Leveraged Azure Synapse Analytics to integrate big data processing and analytics capabilities, enabling seamless data exploration and insights generation. Configured event-based triggers and scheduling mechanisms to automate data pipelines and workflows. Implemented data lineage and metadata management solutions to track and monitor data flow and transformations. Identified and resolved performance bottlenecks in data processing and storage layers, optimizing query execution and reducing data latency. Implemented partitioning, indexing, and caching strategies in Snowflake and Azure services to enhance query performance and reduce processing time. Conducted performance tuning and capacity planning exercises to ensure the scalability and efficiency of the data infrastructure.
Education
Jawaharlal Nehru Technological University
Bachelor's degree, Computer Science
2007 — 2011
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.