Divya Anand
Data Engineer
- Role
- Software Engineer at EPAM Systems
- Location
- Gurugram, HR, IN
- LinkedIn followers
- 500 followers
About Divya Anand
Graduated with a Bachelor of Technology in Information Technology from Heritage Institute…
Experience
Software Engineer
Oct 2024 — Present · Gurugram, IN
I\'m currently involved in a healthcare project with multicultural team, where my responsibilities are:1 - Designing and Implementing Idempotent Data Pipelines: Developing robust, idempotent data ingestion pipelines to ensure data consistency and reliability across processes.2 - Client Collaboration and Requirement Analysis: Collaborating with customers to gather requirements, clarify technical specifications, and align on project deliverables.3 - Library Design Pattern: Designing reusable libraries and applying design patterns, leveraging OOPs concept to build efficient, maintainable code.4 - Database Version Control with Liquibase: Utilizing Liquibase for database versioning to manage schema changes effectively and ensure consistency across environments.5 - Data Transformation and Product Pipeline Development: Implementing modern data transformation pipelines and data products using Azure Databricks and Apache Spark.6 - Query Optimization and Performance Tuning: Analyzing and optimizing long-running queries by applying performance optimization techniques to enhance processing efficiency.7 - Configuration-Based Flexible Pipelines: Building flexible, contract-based pipelines using configuration-driven approaches to accommodate evolving business needs.8 - Big Data System Development with Delta Tables: Developing modern big data systems using Delta Tables, ensuring data consistency through idempotent partitioning strategies.Technologies and Tools:Cloud Platform: Microsoft AzureBig Data & Analytics: Databricks, Apache Spark, Delta LakeDatabase Management: Microsoft SQL Server, LiquibaseData Warehousing: Modern data warehousing techniques with optimized query performanceTeam Structure:Working collaboratively within a team of 5 data engineers, fostering a multicultural and collaborative work environment.
Education
Heritage Institute of Technology
Bachelor of Technology - BTech
2016 — 2020
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.