Praveen M
Senior Cloud Data Engineer | Expert in Architecting Scalable Data Solutions | AWS, Azure, GCP, Big DataTechnologies
- Role
- Senior Data Engineer at AIG
- Location
- Houston, TX, US
- LinkedIn followers
- 500 followers
About Praveen M
With over six years of experience as a Senior Cloud Data Engineer, I specialize in…
Experience
Senior Data Engineer
Jul 2023 — Present · US
Designed and implemented scalable data ingestion pipelines using Apache Kafka and Apache NiFi, enabling real-time streaming of insurance policy data, claims information, and customer interactions from various sources.• Architected and deployed a cloud-based data lake solution leveraging AWS S3, Azure Data Lake Storage, and Google Cloud Storage, facilitating centralized storage, management, and analysis of structured and unstructured insurance data at petabyte scale.• Implemented data governance frameworks using Alation and Apache Atlas to ensure data lineage, quality, and compliance with regulatory standards such as GDPR and Solvency II.• Engineered event-driven microservices architecture using Apache Kafka and Kubernetes, enabling seamless integration and orchestration of data processing tasks across distributed systems while ensuring fault tolerance and scalability.• Leveraged machine learning frameworks such as TensorFlow and scikit-learn for building predictive models and implementing automated underwriting and risk assessment algorithms.• Designed and implemented data warehouse solutions using Snowflake, facilitating efficient storage, management, and analysis of large volumes of insurance data. • Developed and operationalized data APIs and microservices using GraphQL, FastAPI, and Flask, enabling self-service access to curated insurance datasets and analytical capabilities for business users and applications.• Conducted performance optimization and tuning of data processing workflows using techniques like parallelization, partitioning, and caching to improve system throughput, latency, and resource utilization.• Implemented robust monitoring and observability solutions using tools such as Prometheus, Grafana, and ELK Stack, enabling proactive detection, alerting, and troubleshooting of system anomalies and performance bottlenecks.
Education
University of Houston
Master's degree
Jawaharlal Nehru Technological University
Bachelor's degree
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.