Mani K

Senior Data Engineer @AbbVie

Vernon Hills, IL, US

As a Data Engineer, I specialize in designing and optimizing large-scale data processing pipelines, leveraging cloud technologies, and building end-to-end data solutions that enhance business intelligence and efficiency. My expertise spans SQL, Python, PySpark, Azure, Hadoop, and Power BI.Key Skills & ExperienceAgile Development: Worked in Agile environments, utilizing sprints and stand-ups for efficiency.ETL Development: Designed optimized ETL jobs in Azure Data Factory, transforming and loading data into Azure Synapse Analytics & Blob Storage.SQL Optimization: Expertise in SQL programming, handling complex queries, transformations, and tuning.Cloud & Big Data: Migrated on-premise databases to Azure, leveraging Azure Synapse, Data Factory, & Functions.Data Pipelines: Built scalable data ingestion pipelines using PySpark & Scala.Monitoring & Automation: Configured Azure Monitor for tracking VMs, SQL DB, & Blob Storage.Event-Driven Processing: Developed Python scripts in Azure Functions for real-time transformations.Hadoop & Spark: Designed ETL workflows in Hive & Teradata, utilizing Sqoop, Kafka, Unix Scripts.Terraform & DevOps: Managed Azure infrastructure with Terraform & ARM, integrating CI/CD pipelines via Azure DevOps & Jira.Data Visualization: Assisted in Power BI reporting, creating insightful dashboards.Projects & ImpactOptimized SQL queries, reducing execution time by 40%.Automated ETL pipelines, reducing manual workload by 35%.Implemented real-time monitoring, reducing system downtime.Developed predictive analytics, forecasting key business trends.Enhanced cloud automation, improving deployment stability with Terraform & CI/CD.I am passionate about leveraging data engineering & cloud to drive insights, optimize workflows, and build scalable solutions. Let’s connect and discuss how data can transform business operations!