Goutham B
Azure Data Engineer @Syntel
Signup · Get unlimited contacts
WORK HISTORY
Azure Data Engineer @Syntel
Contributed to the development of Azure-based data warehouse solutions, supporting the full SDLC including design, development, testing and deployment. Designed and implemented dimensional data models including Star and Snowflake schemas in Azure Synapse Analytics to support reporting and analytical workloads. Designed and developed scalable enterprise data ingestion frameworks using Azure Data Factory (ADF) to integrate structured and semi-structured data from multiple enterprise systems. Engineered distributed data transformation pipelines using Azure Databricks and PySpark to process large scale datasets and prepare curated data layers for analytics and reporting. Implemented Delta Lake on Azure Data Lake Storage (ADLS Gen2) to enable reliable data processing with ACID transactions and version control. Optimized data pipeline performance using partitioning, caching, and efficient Spark transformations to improve data processing efficiency. Designed and implemented batch and near real-time data processing frameworks using Apache Spark and Spark Structured Streaming to process high-volume enterprise event data. Migrated legacy SSIS based ETL workflows to Azure Data Factory and Databricks, improving pipeline scalability and maintainability. Implemented pipeline orchestration and scheduling using Azure Data Factory triggers and workflow dependencies. Implemented CI/CD pipelines using Azure DevOps to automate deployment of Azure Data Factory pipelines, Databricks notebooks and Synapse resources across development and production environments. Developed data validation and quality checks using Python and SQL to identify and resolve data inconsistencies. Designed and optimized Synapse SQL pools by implementing indexing strategies, partitioning, and materialized views to improve large-scale analytical query performance. Implemented RBAC and access policies in Azure Data Lake and Synapse to ensure secure and controlled access to enterprise data.
ABOUT GOUTHAM B
Azure Data Engineer with 5+ years of experience designing and delivering scalable, high-performance data platforms and analytics solutions on Microsoft Azure. Skilled in building end-to-end data pipelines, from ingestion to transformation and visualization, supporting enterprise-level reporting and data-driven decision-making. Proficient in developing ETL/ELT workflows using Azure Data Factory, Azure Databricks and Azure Synapse Analytics, with strong expertise in processing large-scale structured and semi-structured data using PySpark, Spark SQL and Delta Lake. Experienced in building both batch and real-time data processing solutions leveraging technologies such as Apache Kafka, Event Hub and Spark Structured Streaming. Hands-on experience with modern data architectures, including data lakes and data warehouses using Azure Data Lake Storage Gen2, Azure SQL Database and Synapse Analytics. Strong understanding of dimensional modeling techniques (Star and Snowflake schemas) to support analytical workloads. Skilled in SQL and Python for data transformation, automation and performance optimization. Experience working with a wide range of databases including SQL Server, PostgreSQL, Oracle, MySQL and NoSQL systems like MongoDB, Cassandra and HBase. Proficient in BI and data visualization tools such as Power BI and Tableau with experience building semantic models, implementing Row-Level Security (RLS) and optimizing reports using DAX and incremental refresh strategies. Experienced in implementing CI/CD pipelines using Azure DevOps, GitHub Actions, and Jenkins, along with Infrastructure as Code tools like Terraform and Bicep. Strong exposure to Agile/Scrum methodologies with a focus on collaboration, code quality and continuous improvement. Passionate about building reliable, scalable and efficient data solutions that enable organizations to unlock the full value of their data.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.