Vinayak Shegar
🚀 Data Engineer | Python • SQL • Modern ETL | Architecting Cloud(GCP, Azure, AWS) & GenAI-Ready Pipelines | BigQuery • dbt • PySpark • Terraform • LLM Integration | Future-Ready Architect
- Role
- Data Engineer at Tata Consultancy Services
- Location
- Pune, IN
- LinkedIn followers
- 500 followers
About Vinayak Shegar
About Me | Data Engineer (GCP/AWS)| Building Scalable Cloud Data Systems …
Experience
Data Engineer
Mar 2022 — Present · Pune, IN
Key Responsibilities & Achievements: • Developed and maintained cloud-based ETL pipelines using Apache Airflow, Python, and SQL • Worked across Google Cloud Platform (GCP) tools: BigQuery, GCS, and Cloud SQL • Automated batch processing of files with data validation, retries, and cleanup • Implemented CDC (Change Data Capture) and incremental loading strategies for large datasets (~1.5B records) • 🧱 Applied data normalization, schema recreation, and partitioning techniques for optimized querying • Improved data flow reliability, reduced manual intervention, and ensured scalability of pipelines • Collaborated with team to troubleshoot, optimize, and monitor Airflow DAGs in production Tech Stack:Languages: Python, SQL, BashCloud & Tools: GCP (BigQuery, Cloud Storage, Cloud SQL, Composer), Apache AirflowDatabases: MySQLVersion Control: GitLearning: PySpark, dbt, Dataflow, Terraform This role helped me build a strong foundation in modern data engineering practices and large-scale, cloud-native pipeline development.
Education
Savitribai Phule Pune University
Bachelor of Engineering - BE
2018 — 2021
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.