Kartheek Dhupati
Azure Data Engineer @Wells Fargo
Signup · Get unlimited contacts
WORK HISTORY
Azure Data Engineer @Wells Fargo
Plano, TX, US
Expertly executed data transformation in Azure Data Lake Storage Gen-2 with medallion architecture,revolutionizing workflows, elevating data quality, and driving efficient decision-making in the Azure cloudenvironment.Integrated on-premises (MySQL, Cassandra) and cloud-based (Azure Blob Storage, Azure SQL Data Base) data using Azure Data Factory, applying transformations, and loading data into Snowflake.Architected and executed a robust Azure Lambda architecture, seamlessly enabling real-time and batch data processing. Leveraging Azure cloud services, it ensured peak performance and scalability for mission-critical business functions.Implemented automated data cataloging processes, drastically reducing manual labor and ensuring real-time metadata accuracy across all data systems. This innovation streamlined data management to its pinnacle.Leverage the power of UNIX shell scripting in combination with Azure CLI and PowerShell commands toautomate repetitive Azure management tasks, ensuring consistent deployments and configurations across your cloud environment.Created 100+ ETL transformations and validations using Spark-SQL, processing 5TB of data weekly in Azure Data bricks.Implemented robust security and monitoring solutions, and optimized cost management using Azure services including Azure Key Vault, Azure Security Centre, Azure Monitor, and Azure Cost Management.Collaborated with Azure Logic Apps administrators, resolving 150+ issues annually, enhancing data pipeline efficiency by 25%.Orchestrated seamless movement of over 5TB of data into SQL databases monthly, reducing data transfer times by 25% using Data Factory pipelines.Collaborated effectively on ETL tasks, prioritizing data integrity and ensuring the reliability of stable datapipelines. This proactive approach contributed to efficient data management and a seamless flow of information critical for decision-making.
EDUCATION
The University of Memphis
Master's degree, Computer Science
Jawaharlal Nehru Technological University, Kakinada
Mechanical Engineering
ABOUT KARTHEEK DHUPATI
Here is the Contact Details: Phone:(90••••••22 Email: k••••••••@gmail.com. I\'m Kartheek, a data engineer with over a decade of experience in the IT industry, specializing in data engineering with a strong focus on Azure technologies. In my current role as an Azure Data Engineer at Transportation Insight, I excel in building efficient data pipelines and delivering actionable insights that drive strategic decisions. My technical proficiency extends to databases such as Oracle SQL Developer, Microsoft SQL Server, and MySQL. I adeptly create and manage ETL pipelines using industry-standard tools like Informatica and SSIS. My expertise also lies in designing both star and snowflake schema models, ensuring optimized data organization and streamlined retrieval processes. My experience in performance-tuning Spark applications is a testament to my commitment to achieving optimal data processing and system efficiency. In addition to my technical skills, I am a strong advocate for continuous learning and professional development. I regularly update my skills to keep pace with the evolving tech landscape, and I hold several certifications in data engineering and Azure technologies. This commitment to growth ensures that I bring the most current and effective solutions to any project. Furthermore, I have a proven track record in project management and team leadership. I have successfully led cross-functional teams in complex data migration and integration projects, consistently delivering results that meet and exceed business objectives. I am also an active participant in the data engineering community, contributing to forums, sharing insights at industry events, and mentoring aspiring data professionals. My passion for data-driven solutions drives me to seek new challenges and opportunities for collaboration. If you need a skilled data engineer with extensive Azure expertise and a deep passion for solving complex data challenges, I welcome the opportunity to connect. I am eager to explore new opportunities, collaborate on innovative data-driven projects, or engage in meaningful industry discussions.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.