Abhinav Ahuja
Data Engineer II at Amazon
- Role
- Data Engineer Ii at Amazon
- Location
- Hyderabad, TG, IN
- LinkedIn followers
- 500 followers
About Abhinav Ahuja
A seasoned Data Engineer who loves writing code and reading books. I thrive on solving complex problems and experimenting with different models and technologies to accomplish my task beautifully. Storytelling, visualization, descriptive statistics, I do it all.
Experience
Data Engineer Ii
Apr 2024 — Present · Hyderabad, IN
DETSO – Data Engineering Tracking, Segregation & OptimizationBuilt a platform to monitor and optimize Lastmile’s $3M Redshift budget. Developed real‑time dashboards for query and cluster performance, integrated MageAI for pipeline orchestration and dataset governance, and automated tools (e.g,>120‑min Query Killer, auto‑scaling, advanced alarms) to boost resource efficiency.Tech: MageAI, AWS Redshift, Lambda, S3, CDK, Athena, ECS, Python, QuicksightSQL Converter using GenAIDeveloped a GenAI-powered Streamlit app that automates query conversions between Redshift SQL, Spark SQL, and PySpark. Reduced analyst effort by ~2 weeks per query set and eased migration of heavy ETLM workloads to Spark. Containerized with Docker and deployed on AWS ECS via CDK.Tech: Streamlit, AWS Bedrock, ECR, ECS, CDK, Claude 3.5 Sonnet, LangChain, DockerRedshift Compute for Sciences TeamDeployed a 4‑node RA3.4xlarge Redshift cluster for the Sciences team. Configured complex IAM policies; onboarded 200 datasets; and optimized performance with ETLM Unload and WLM.Tech: AWS Redshift, IAM, CloudFormation, S3Athena ComputeLaunched Athena for server‑less SQL querying supporting BI, Tech, Program, and Science teams. Established cost tracking with an AWS Glue & Lambda pipeline, onboarded datasets, and implemented role‑based access via IAM.Tech: AWS Athena, Glue, Lambda, IAM, S3SageMaker EMREnabled BI teams to deploy Andes3‑compliant EMR clusters directly from SageMaker Notebooks. Automated provisioning via CloudFormation and delivered one‑click deployment through SageMaker Service Catalog.Tech: AWS SageMaker, EMR, CloudFormation, SageMaker Service Catalog, VPCAndes3 MigrationMigrated ETLM profiles and tables to Andes3—delivering a VP‑level goal three months ahead of schedule. Automated access requests, saving over hours and optimizing Redshift performance by eliminating redundant sync jobs.Tech: Python (Pandas, Regex), Redshift, Andes SDK
Education
Punjab Technical University
Bachelor’s Degree
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.