Shourya Pant
Data Engineer (Systems Engineer) @Tata Consultancy Services
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer (Systems Engineer) @Tata Consultancy Services
Indore, IN
Created a Python script for automating a manual Excel task in which I took data from multiple Excel files and then merged them into a single Excel file and uploaded it to the AWS S3 Bucket, which has improved the computation time by 80%.• Worked on Complex AWS Lambda and Glue use cases to perform some tasks involving ETL of data and analysis tasks using PySpark and Python.• Developed and executed PySpark code in Azure Databricks, converting SAS code to PySpark code that optimized complex ETL and data analysis tasks, increasing customer environment computation speed by over 50%.• Accomplished a POC in which I wrote a Python/ Pyspark script that enabled my Databricks environment cluster to read a huge SAS7BDAT dataset all at once without losing the data, improving the overall performance efficiency by 90%.
EDUCATION
Oriental Institute of Science & Technology
Bachelor of Technology - BTech, Computer Science Engineering
Campion School Bhopal
Schooling, 12th,PCM stream
ABOUT SHOURYA PANT
Hi, I’m Shourya Pant, a Data Engineer with a strong foundation in Python, PySpark…
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.