Shivansh Mishra
Software Developer @TCS | Data Engineer | Gen AI Engineer
- Role
- System Engineer at Tata Consultancy Services
- Location
- Indore, MP, IN
- LinkedIn followers
- 500 followers
Experience
System Engineer
Nov 2024 — Present · Indore, IN
As a Software Developer at Tata Consultancy Services (TCS), I have been pivotal in modernizing data infrastructure for a prominent client in the Banking, Financial Services, and Insurance (BFSI) sector. My role encompasses the development and deployment of scalable applications using Python, PySpark, AWS Glue, and AWS Lambda, facilitating the transition from legacy systems to advanced data processing solutions.Key Responsibilities:Legacy System Migration: Led the transformation of data processing frameworks by migrating from Hadoop MapReduce to PySpark, resulting in a significant reduction in execution and processing times. Data Pipeline Development: Designed and implemented efficient data pipelines utilizing Python and PySpark, enabling seamless data integration and transformation.AWS Glue Implementation: Developed and managed ETL processes with AWS Glue, enhancing data accessibility and analytics capabilities.Serverless Application Deployment: Utilized AWS Lambda to deploy serverless applications, optimizing performance and reducing operational costs.Production Deployment: Oversaw the end-to-end deployment process, ensuring the smooth transition of applications from development to production environments.Achievements:Performance Enhancement: Achieved a 50% reduction in job execution and processing times by transitioning from Hadoop MapReduce to PySpark, significantly improving data processing efficiency. Cost Optimization: Implemented serverless architectures with AWS Lambda, leading to a 20% reduction in infrastructure costs.Successful Production Launches: Directed the deployment of multiple critical applications into production, achieving zero downtime and adhering to all project deadlines.Through these initiatives, I have substantially contributed to the client\'s operational efficiency and data-driven decision-making capabilities, driving the evolution from legacy systems to modern, scalable data solutions.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.