Find Unlimited Emails.For Free.
Discover prospects, find their business emails, and build your pipeline with Unifers.
Start for FreeHarshad P
Data Engineer @Fiserv
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Fiserv
Irving, TX, US
Managed end-to-end ETL operations using Azure Data Factory to orchestrate extraction, transformation, and loading of large-scale data, supporting enterprise fraud detection and prevention workflows.•Leveraged Azure Synapse Analytics and Apache Spark for distributed, large-scale data processing, handling complex analytical workloads with parallel computing to improve pipeline throughput and performance.•Designed and implemented a cloud-native Snowflake data warehouse architecture, including DBT models, macros, data marts, and Time Travel for historical auditing, regulatory compliance, and advanced analytics.•Implemented Slowly Changing Dimensions (SCD) techniques and developed DDL scripts for Stage and ODS tables in Azure SQL Database, ensuring accurate historical tracking and structured data storage.•Architected real-time, event-driven data pipelines using Apache Kafka and Apache Airflow, ensuring fault-tolerant, scalable streaming and automated workflow orchestration across distributed systems.•Applied Python programming for data analysis, automation, and machine learning, developing robust solutions across data science and software development use cases.•Spearheaded CI/CD pipeline implementation using Azure DevOps, enabling a streamlined, automated development lifecycle across multiple deployment environments.•Containerized data processing applications using Azure Kubernetes and built custom automation activities with Azure Functions and PowerShell scripts, enhancing operational efficiency and solution portability.•Implemented Azure Logic Apps with Azure Key Vault integration for secure, automated workflows with robust data governance and access controls.•Built automated pipelines to ingest security test results into centralized analytics storage, enabling continuous trend analysis and scoring for improvement of defensive controls.
EDUCATION
Midwestern State University
Master of Business Administration - MBA
Jawaharlal Nehru Technological University, Kakinada
Bachelor of Technology - BTech
ABOUT HARSHAD P
Azure Data Engineer with 5+ years of IT experience, including 3+ years in Data Engineering and 2 years in Data Warehousing, specializing in end-to-end ETL/ELT pipeline design and large-scale data integration on Azure. Proficient in Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Snowflake for batch and real-time data processing, with hands-on experience building scalable, cloud-native data architectures. Skilled in Python, PySpark, Scala, SQL, and Spark SQL for data extraction, transformation, aggregation, and machine learning workflows across structured, semi-structured, and unstructured datasets. Experienced with real-time streaming platforms including Apache Kafka, Azure Event Hubs, and Spark Streaming to architect fault-tolerant, event-driven data pipelines at enterprise scale. Deep expertise in Snowflake Data Warehouse design, DBT modeling, Slowly Changing Dimensions (SCD), Time Travel, and data marts to support advanced analytics and regulatory compliance. Delivered measurable impact: 50% reduction in ETL processing time via Azure Data Factory optimization, 30-60% log storage cost reduction through Cribl pipeline tuning, and $750K+ in operational efficiency gains. Strong background in CI/CD pipeline development using Azure DevOps and Git, infrastructure-as-code with Terraform, and containerization via Azure Kubernetes for scalable, production-grade data solutions. Hands-on with Power BI and Tableau for business intelligence reporting, and experienced collaborating with cross-functional teams in Agile/Scrum environments to deliver data solutions aligned with business goals.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.