Sachin Kumar Singh
Data Engineer at Fractal | AI enthusiast | Pyspark | Python | Azure
- Role
- Data Engineer at Fractal
- Location
- Gurugram, HR, IN
- LinkedIn followers
- 500 followers
About Sachin Kumar Singh
A skilled and dedicated Data Engineer with 4 years of experience in developing data processing solutions using PySpark and related technologies. Seeking a challenging position where I can utilize my expertise in data modeling, big data processing, and data analytics to contribute to the success of data-driven projects
Experience
Data Engineer
Aug 2020 — Present · Gurugram, IN
Designed and implemented end-to-end data solutions on the Azure platform using services such as Azure Data Lake. Azure Data Factory, and Azure Databricks. Developed ETL processes to extract data from various sources, transform it to meet business requirements, and load it into delta lake tables stored in blob storage. Sourced, processed, validated, transformed, aggregated, and distributed data from different sources. Implemented complex data transformations, aggregations, and calculations using PySpark RDDs and DataFrames. Optimized PySpark jobs for performance by leveraging partitioning, caching, and tuning Spark configurations to save cost for Business. Created insights with the latest market intelligence, consumption projection based on time series algorithm, and trade inventory analytics to help businesses access forecast reasonability, risks and opportunities resulting in better business operation. Utilized stats models, pmdarima to forecast with a curated collection of models. Collaborated with cross-functional teams including data scientists, analysts, and stakeholders to understand data requirements and provide data engineering support. Documented business requirements, data sources, data structure, and infrastructure and provided cost/effort breakdowns. Contributed to the documentation of PySpark development best practices and guidelines. Participated in a collaborative, agile environment to understand stakeholder’s requirements and continuous improvement at every stage.
Education
Army Public School, Agra
10+2
2013 — 2015
Army Institute of Technology, Pune
Bachelor of Engineering - BE
2016 — 2020
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.