Sagar Kumar Singh
Data Engineer at Tata Consultancy Services | Actively seeking opportunities
- Role
- Big Data Engineer at Tata Consultancy Services
- Location
- Bengaluru, KA, IN
- LinkedIn followers
- 500 followers
About Sagar Kumar Singh
As a Data Engineer, I design,develop and maintain various scalable data pipelines and workflows that supports various business needs.I collaborates with cross-functional teams to gather and understand data requirements and ensure data solution align with business goals and standradsI have 5 years of experience in data engineering, with proficiency in AWS platform. I am skilled in ETL operations,data modelling,data ingestion, data transformation and data qualityI use pyspark script to perform complex data manipulation, transformation and analysis. I have good knwoledge of Python,MySQL,Pyspark,Spark.I was recently part of a project that migrated the large scale data warehouse from cloudera platform to databricksinvloving the use of various big data tools such as Airflow,Databricks,AWS S3, AWS Glue,Jenkins. We have also impleamented data quality framework. Earlier we used to work on CDH(Cloudera Hadoop) platform, were I have worked extensible on scheduling jobs using Airflow.Creating pipleine to ingest new data source into our datahub/Hive. Created curated data pieline based on stakeholders requirementsCreated CI/CD pipelines on Github. Carried out bi-weekly QA and Production releases.
Experience
Big Data Engineer
Nov 2018 — Present
Education
Heritage Institute of Technology
Bachelor of Technology - BTech
2014 — 2018
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.