Raghavendra N

Data Engineer @Thomson Reuters

Eagan, MN, US

Designed and optimized large-scale data pipelines and ETL workflows using Databricks and Spark, ensuring smooth integration for complex datasets. Collaborated with data scientists and stakeholders to implement KPIs and enhance data-driven decision-making. Applied advanced SQL techniques for relational and distributed systems, optimizing performance. Ensured data integrity through testing and documentation. Developed data solutions using SQL Server 2021, SSIS, SSRS, ADF, and Power BI for real-time insights. Integrated C# applications with cloud platforms for scalability. Participated in scrum teams, implementing unit tests and delivering accurate data solutions. Built end-to-end data pipelines in GCP with BigQuery, Dataflow, and Apache Beam, enhancing data accessibility. Managed GCS Buckets and Cloud SQL to reduce retrieval times by 30%, automating processes with G-Cloud Functions and Dataflow for a 25% efficiency boost. Designed data warehousing solutions on Snowflake integrated with BigQuery. Automated workflows with Cloud Shell and Gsutil. Led cloud migrations using GCP Databricks and Dataproc. Configured VM instances and optimized databases in MySQL, PostgreSQL, and SQL Server. Developed custom ETL processes in Python, Scala, and Spark, integrating Spark-SQL. Orchestrated multi-source data integration with Cloud Composer and implemented Cloud Pub/Sub for real-time data insights.