Pradeep Manickam
Data Engineer @Cavu
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Cavu
Built and optimized data pipelines in AWS and Databricks to manage API data ingestion, backfill, and daily updates-Developed a metadata catalog with Datahub for data governance, improving accessibility and consistency across teams-Established data quality checks and lineage tracking with Datadog, Cloudwatch, Athena, and Redshift Spectrum for reliable data operations-Created a customer intelligence platform by integrating Google Analytics and CRM data using SQL and AWS Glue, driving actionable insights-Set up reverse ETL pipelines with Eventbridge and SQS for real-time user updates in CRM, enhancing targeted marketing-Deployed AWS resources through AWS CDK and Terraform for scalable, automated cloud infrastructure.Experienced in Python, SQL, Pyspark, Databricks, AirflowExperienced in AWS, CDK Infrastructure as Code (IaC) and TerraformData warehousing, Architecture data pipelinesGitHub actions to perform CI/CD to deploy data pipelinesAWS services Redshift, Athena, Glue, S3, Lambda, ECS, SES, EMR, Crawler, Cloudwatch.
EDUCATION
Loughborough University
Doctor of Philosophy (PhD), Computational Fluid Dynamics
Anna University Chennai
BE, Mechanical Engineering
College of Engineering, Guindy
ME, Internal Combustion Engineering
SKILLS
ABOUT PRADEEP MANICKAM
Data Engineer skilled in architecting scalable, cloud-based data solutions that drive insights and operational efficiency. Proficient in AWS services, Databricks, Airflow, and SQL, I specialize in building robust data pipelines, implementing metadata governance, and enabling real-time analytics. Experienced in pipeline architecture, automating data quality checks, and deploying Infrastructure as Code (AWS CDK, Terraform) for resilient, optimized workflows.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.