Jay Trivedi

About Jay Trivedi

With a foundation in Project Management from Missouri State University, my role at Tata…

Experience

1. Data Engineer

   Tata Consultancy Services

   Mar 2022 — Present · Summit, NJ, US

   1) Built scalable ETL pipelines using Azure Data Factory and Databricks Workflows to ingest and transform terabytes of data daily from 20+ data sources, resulting in seamless and efficient data flow for business analytics2) Developed robust data transformation scripts using SQL and Python to automate KPI reporting, improving decision-making for business stakeholders3) Improved data processing efficiency by 30% by leveraging PySpark, Spark SQL, and Databricks to perform complex data transformations, reducing runtime and resource consumption4) Modeled and optimized core data tables using dimensional modeling techniques to develop reusable data assets, improving data accessibility and reducing report generation time by 40%5) Reduced overall data load time by 60% by optimizing long-running scripts and streamlining data pipelines, enabling earlier access to data for downstream processing6) Successfully implemented Delta Lake on the existing data lake by converting Parquet tables to Delta format across multiple repositories, in collaboration with senior engineers, resulting in improved data performance, scalability, and operational efficiency7) Deployed batch ETL pipelines and transformation scripts using an in-house CI/CD tool, and Jenkins, enabling frequent, reliable data updates and supported ad hoc off-cycle deployments to meet urgent business needs8) Improved team transparency and task tracking by leveraging tools like Jira and Confluence for documentation, project coordination, and release management processes9) Spearheaded cross-functional collaboration with business analysts to gather requirements, estimate user stories, and translate them into development tasks, increasing sprint predictability and ensuring timely delivery10) Oversaw team-wide business communications and incident resolution by acting as the primary point of contact for end-user queries and issue escalations, enhancing stakeholder trust and reducing turnaround time for fixes

Education

• Missouri State University

  Master of Science (MS)

• Alpha College Of Engineering

  Bachelor of Engineering (B.E.)

• Missouri State University

  Masters

• Missouri State University

  Certificate

Skills

• Mysql
• Programming
• Javascript
• C++
• Sql
• Microsoft Office
• Matlab
• C
• Microsoft Excel
• Html