Astha Vikram

About Astha Vikram

As a Data Engineer at Tata Consultancy Services (TCS), I work on data engineering…

Experience

1. Data Engineer

   Tata Consultancy Services

   Nov 2021 — Present · Pune, IN

   Designed and implemented robust data pipelines using Python and GCP services, including Cloud Data flow and Pub/Sub, to support batch and real-time data processing, handling over 10 TB of data daily- Developed and integrated diverse data sources into the GCP Data Lake, leveraging BigQuery for large-scale data analysis and extracting actionable insights to drive strategic business decisions- Optimized BigQuery performance through advanced techniques including partitioning, clustering, and query optimization, resulting in a 25% cost reduction and a 40% improvement in query speed- Orchestrated workflows with Apache Airflow (Cloud Composer) for scheduling and monitoring DAGs and data pipelines, ensuring timely and reliable data processing- Implemented serverless, event-driven processing with Google Cloud Functions, enhancing scalability and operational efficiency- Managed Extract, Transform, Load (ETL) processes using Informatica MDM, ensuring seamless data integration and data accuracy across platforms- Proficient in data modeling and warehousing concepts, applying ETL best practices to ensure data reliability- Collaborated cross-functionally with stakeholders and data scientists to deliver effective data solutions aligned with business objectives- Utilized GitLab for version control and GitLab CI for continuous integration and deployment, ensuring efficient code management- Documented Agile workflows and project details using JIRA and Confluence, facilitating effective team collaboration and project management.