Manik Kapoor
Senior Data Engineer @Positivity
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer @Positivity
Technologies - Azure Data Factory, AWS RDS, AWS Aurora, Azure Devops, Azure Data Lake, Terraform, Docker, Kubernetes, Kafka, Tableau, SQL, Python, Agile Methodologies, Azure data services, databricksDesign the process and architecture for the data flow through to the games intelligence.Database and data streaming support utilizing Cloudwatch and Azure Appinsights.Creating the support documentation for the first line of support.Working in Infrastructure-as-Code, and developing the terraform files (terraform plans)and implementing the data engineering solution.Developing azure pipelines (YAML), for implementing database and application changes.Developing and managing the data and the delta lakesMentoring the new data engineers with the new skills and strategiesExperience in developing application in databricks for data extraction, transformationand aggregation form multiple file formatsResponsible for estimation of cluster size, monitoring and troubleshooting ofdatabricks clustersData ingestion to one or more azure services and processing data in databricks.
EDUCATION
Delhi Public School, Ranipur, Haridwar
High School, Science and Maths
College Of Engineering Roorkee
B.Tech, Electronics and Telecommunication
University of Edinburgh Business School
Master of Science - MS, Business Analytics
CDAC, Mohali
Networking and System Security, Networking and System Security
SKILLS
ABOUT MANIK KAPOOR
Globally experienced Data Engineer | AWS Services | Microsoft Azure | Databricks | Python | Data Modeling | Data WarehousingClients: Accenture (Telia Sonera/ Barclays/ Bank of America), IBM (Suncorp Group), I2SBS (MayBank/CIMB), BMW Automotive, PwC (Ministry of Housing/Ministry of Transport), Dubai Airports, Abu Dhabi Health Services, Games Global, TeachFirstPassionate about transforming data into actionable insights that drive business success. With 11 years of industry experience, I specialize in AWS services, Microsoft Azure, Databricks, Python, data modeling, and data warehousing techniques. I have successfully delivered 18 end-to-end implementations for cloud and data warehouses, collaborating with diverse industries such as telecom, healthcare, insurance, finance, automotive, education, and gaming.Technical Expertise:AWS Services: Proficient in S3, EC2, Redshift, Glue, Athena, and EMR, leveraging them to design robust data pipelines and storage systems.Microsoft Azure: Skilled in Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics, building comprehensive data solutions.Databricks: Utilizing its advanced analytics capabilities to process and analyze large-scale datasets, uncovering real-time insights.Python Programming: Proficient in Pandas, NumPy, and PySpark, automating data processes and enhancing efficiency.Data Modeling & Warehousing: Expertise in dimensional modeling and entity-relationship modeling, designing scalable data models for efficient data warehousing solutions.Leadership & Team Management:Team Leading: 7 years of experience leading teams ranging from 6 to 18 members, fostering collaboration and driving successful project delivery.Goal Alignment: Strong focus on aligning team goals with organizational objectives, ensuring effective execution and outcomes.Communication: Clear and concise communication to facilitate knowledge sharing and maintain a cohesive team environment.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.