Vivekanandareddy Kopparthi

Senior Data Engineer @Molina Healthcare

Bothell, WA, US

I have 10+ years of experience in Big Data Development and Data Engineering, specializing in Hadoop, Spark, Azure, and Snowflake ecosystems. Over the years, I’ve designed and implemented scalable BI solutions, optimized data pipelines, and worked extensively with cloud platforms like AWS and Azure.In my current role, I focus on building and optimizing data pipelines using Azure Data Factory, Databricks, and Snowflake. I’ve led large-scale data migrations from on-premises systems (Oracle, SQL Server, DB2, MongoDB) to Azure Data Lake and Snowflake, ensuring smooth transitions and performance optimizations.I have hands-on experience with ETL/ELT workflows, designing historical and incremental data loads using Databricks, Delta Lake, and ADF. I also work with Collibra for data governance, ensuring metadata management, compliance, and centralized data access.Additionally, I’ve developed real-time and batch processing frameworks using Spark, Kafka, and Hive, and created enterprise-wide analytics dashboards with Power BI and Tableau. I’m experienced in automating data workflows using Apache Airflow and Oozie while integrating various enterprise systems (CRM, ERP, HR) for real-time data synchronization.I’m passionate about optimizing query performance, ensuring scalability in cloud-based data solutions, and continuously learning emerging technologies in Big Data, AI, and cloud analytics.