Rahul Reddy
Lead Data Engineer at Hd Supply
- Role
- Lead Data Engineer at HD Supply
- Location
- Decatur, GA, US
- LinkedIn followers
- 500 followers
About Rahul Reddy
Having 9+ years of professional IT experience which includes in Big Data ecosystem and…
Experience
Lead Data Engineer
May 2020 — Present
Constructed a Data ingestion pipelines to process semi-structured and relational data from variousdata sources to Google Cloud Platform• Maintained data Pipelines up to 99.8% while ingesting streaming and transactional data across variousdata sources using python and Prefect.• Ingested data from disparate data sources using a combination of SQL, and Google Analytics API usingPython to create data views to be used in BI tools like Tableau.• Worked on Scala and Spark to perform several aggregation logics.• Created multiple code snippets of DBT for Data Transformation.• Design and implement large scale distributed solutions in GCP Cloud.• Migration from GitHub to DBT, while automating the ETL process across billions of rows of data.• Communicated with project managers and analysts about data pipelines that drove efficiency.• Build basic ETL that ingested historical and transactional data from a Web API with about dailyactive users.• Analyze and understand the ETL Informatica workflows that have been developed• Analyzed data of developer in the SecAPI where the issues are about a million records in a day andingested this data in Big Query through the Google Storage Buckets
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.