Dona Sunny
Azure Data Engineer @UST
Signup · Get unlimited contacts
WORK HISTORY
Azure Data Engineer @UST
Designed, developed, and maintained end-to-end data pipelines to efficiently extract, transform, and load (ETL) data from various sources like Snowflake,Cosmos DB, MySQL etc. into centralized data repositories, ensuring data accuracy, integrity, and timeliness• Utilized cloud-based platforms such as Azure Platform to architect and implement scalable and reliable data solutions, leveraging services like Azure Data Factory, Azure Synapse Analytics, andAzure Data Lake• Developed and optimized Azure Databricks jobs for efficient data processing, achieving a 30% reduction in processing times• Conducted data profiling, cleansing, and transformation activities using tools like Apache Spark, Python, or SQL• Automated data processing tasks and workflows using scripting languages (e.g, Python)workflow orchestration tools (Azure Data Factory) to improve efficiency and reduce manual intervention• Adept at working with big data technologies and leveraging Azure Data Lake Storage for scalable solutions• Proficient in utilizing Azure Data lake Storage Gen2 as a flexible and scalable object storage solution, enabling the storage of unstructured data, backups, and data archives for diverse data processing and analytics needs• Expertise in code branching, merging, and tracking changes across distributed development teams, ensuring code integrity, and facilitating continuous integration and deployment (CI/CD) workflows• Knowledge in utilizing Jira Confluence as a collaborative project management, Agile development methodologies such as Scrum, and knowledge sharing through centralized documentation, task tracking, and communication tools• Designed and implemented real-time data processing solutions for streaming data ingestion, processing, and analysis, enabling timely insights and actionable intelligence• Implemented monitoring and alerting mechanisms to proactively detect and resolve data pipeline issues, ensuring high availability and reliability of data services
EDUCATION
Mar Baselios Institute of Technology and Science, Nellimattom P. O. , Kothamangalam
Bachelor of Technology - BTech
Fanshawe College
Postgraduate Degree
ABOUT DONA SUNNY
Data Engineer with experience in data ingestion, transformation, and end-to-end pipeline development, with a strong track record of following development and maintenance processes to ensure high-quality data solutions. • Proven expertise in SQL, Python, Scala, Power BI, and cloud data engineering tools, particularly within Azure. • Experience in Azure Data Engineering expertise in designing, implementing, and maintaining end-to-end data solutions, leveraging Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure SQL Database. • Skilled in agile methodologies, experienced in collaborating on medium to large-scale projects, and adept at building strong relationships with stakeholders to ensure alignment with business needs.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.