Arvind Reddy

WORK HISTORY

EDUCATION

ABOUT ARVIND REDDY

Working as a Data Engineer on Google Cloud Big data services. • I am a Google Cloud Certified Professional Data Engineer. Roles and Responsibilities:• As a role of Data Engineer in GCP my responsibilities include, analyze and organize raw data, Build data systems and pipelines, Evaluate business needs and objectives, Interpret trends and patterns, Conduct complex data analysis and report on results, Prepare data for prescriptive and predictive modeling. • My project responsibilities were selecting and integrating any Big Data tools and frameworks required to provide requested capabilities, Implementing ETL process, Monitoring performance and advising any necessary infrastructure changes, Defining data retention, collecting, storing, processing, and analyzing of huge sets of data.• Architected and optimized ELT pipelines using dbt within a Databricks Lakehouse, cutting data latency by 35%. Enforced production standards via CI/CD, automated testing, and comprehensive data lineage for production datasets.• Working directly with customers and with offshore and on shore developers. Ensuring high quality bug free build to project deadlines alongside transparent communication strategy.Project Experience:I have worked on three projects for the UK client. In my first project, I played a role of Data Engineer where I was involved in the ETL part using GCP services like Big Query, Dataform, Airflow, Cloud storage, Cloud Function.In my second project, I worked as Junior technical solution architect and Data Engineer. I used to assess the technical work in the other projects such as code reviews like docstrings, efficiency, approved tech stack, separation of environment(dev, qa, prod) CI/CD, End to End and Data Quality testing, documentation, robustness etc. Based on the assessment, I used to provide the rating/score. If the score is high, the project will go to production, if the score is low then project will be refactored.In my third and current project, I am working as a Data Engineer. I am doing ETL work using Google Dataform, Cloud Function, Big Query. I am also working in the Google kubernetes Engine, Cloud run, Cloud Scheduler, pub/sub, Terraform. For the CI/CD I am using GitLab. I am also playing the role of scrum master in my current project.