Chaitanya Jarugula
Data Engineer @ Bayer | Skilled in Data Processing and Big Data Technologies | SQL | Python | AWS | Hadoop | Spark | GCP Certified Professional Data Engineer
- Role
- Data Engineer at Bayer
- Location
- Dallas-Fort Worth, TX, US
- LinkedIn followers
- 500 followers
About Chaitanya Jarugula
I have 5 years of Full time work experience with proven expertise in the field of data…
Experience
Data Engineer
Jun 2023 — Present · MO, US
Transformed intricate data entities in BigQuery by leveraging Ralph Kimball’s Dimensional Modeling principles to architect a data framework using Hackolade, resulting in a 40% enhancement in data visibility compared to source. Employed Git version control for source code management and GitHub Actions for continuous integration/continuous deploy- ment (CI/CD) of the Kafka and Apache beam pipelines, ensuring rapid, secure, and efficient code releases.Architected and implemented Apache Beam pipelines, reducing data processing time by 50% and delivering robust data handling capabilities; Incorporated Dataplex APIs to enable seamless data discovery and metadata management. Leveraged proficiency in Apache Airflow to design and implement custom operators and DAGs, orchestrating data pipelines on GCP. Integrated SQL scripts to optimize workflow efficiency and streamline data processing. Engineered terraform scripts to provide infrastructure for AWS Fargate, AWS Cloudwatch, defined all the necessary IAM rules ensuring least-access privilege policies. Implemented Kafka Producers and Consumers wrappers using Python client and enabled data migration from Oracle to Google Cloud BigQuery Staging datasets. Engineered GitHub Actions workflows to Deploy Kafka wrapper image on AWS Fargate cluster, enabling seamless Integration between Dev and production deployments. Collaborated with principal data engineers to create and enhance data solutions, writing clean and efficient code and gaining hands-on experience in software development life cycle and data structures along with detailed technical documentation. Tools and Technologies: Google Cloud (BigQuery, Cloud Functions, Composer, DataFlow, Data Catalog), AWS (Cloud- watch, Fargate, EC2), Apache Airflow, Apache Beam, GitHub Actions, Git, Python, SQL, Oracle, Hackolade, Docker.
Education
Vardhaman College of Engineering (VCEH)
Bachelor of Technology, Electrical, Electronics and Communications Engineering
2016 — 2020
Missouri University of Science and Technology
Master's degree, Computer Science
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.