Manoj Kumar
Data Science & Analytics Graduate | Ex-Tcser |GATE CS 2020 AIR 4612 | Seeking Full-time Opportunities
- Role
- Aws Data Engineer at Community Dreams Foundation
- Location
- Miami-Fort Lauderdale, FL, US
- LinkedIn followers
- 500 followers
About Manoj Kumar
Risk Analyst and Data Science & Analytics graduate (M.S, May 2025) with 4+ years of…
Experience
Aws Data Engineer
May 2024 — Present · Bengaluru, IN
Developed and maintained end-to-end ETL pipelines using AWS Glue and S3, processing 1.5 TB of pharmaceutical datasets daily for research and clinical analytics.• Automated ingestion of structured and semi-structured data into AWS Glue jobs, reducing manual intervention and pipeline errors by 50%.• Implemented incremental data updates in Glue jobs to handle ~200 GB daily of clinical data efficiently.• Processed historical trial data in AWS EMR using PySpark, reducing batch processing time by 25%.• Developed complex SQL transformations and queries in Redshift to manage large-scale datasets efficiently.• Designed Redshift schemas optimized for pharmaceutical reporting and analytics, improving query speed and report generation by 40%.• Designed partitioning strategies and optimized storage formats in S3 to improve Athena query performance and reduce query costs by 35%.• Configured monitoring and alerting in AWS CloudWatch to proactively detect job failures and performance anomalies.• Orchestrated workflows using AWS Lambda and Glue triggers to process daily pharmaceutical data updates.• Built CI/CD pipelines using AWS CodePipeline for automated deployment of Glue jobs and Redshift scripts.Developed data quality validation frameworks in Glue and Python, ensuring accurate clinical and research datasets.• Configured Lambda functions for event-driven processing, automatically triggering Glue jobs upon file arrivals in S3.• Optimized Redshift and Athena queries by tuning schemas and partitions, improving report generation speed and query efficiency.• Integrated AWS SageMaker to develop predictive models on patient outcomes, enhancing data-driven decision-making.• Collaborated with business analysts and data scientists to define validation rules and KPIs, aligning ETL pipelines with research goals.
Education
Florida Atlantic University
Master's degree, Data Science and Analytics
Jawaharlal Nehru Technological University, Kakinada
Bachelor's degree, Computer science and engineering
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.