Uttam Navadiya
Python | SQL | PySpark | Azure Databricks | Apache Airflow | Amazon S3 | ETL | pandas | NumPy
- Role
- Data Engineer at Appscale Infotech
- Location
- Surat, GJ, IN
- LinkedIn followers
- 500 followers
About Uttam Navadiya
Aspiring Data Engineer with practical experience in building ETL pipelines using PySpark,…
Experience
Data Engineer
Jun 2023 — Present
Developed and maintained scalable ETL pipelines using PySpark and Spark-SQL to process large volumes of stock market data from AWS RDS, APIs, and CSV files.Designed and automated data workflows using Apache Airflow, ensuring timely data refresh and efficient task orchestration.Implemented incremental and full-load strategies with Parquet storage in Amazon S3, enabling reliable data access for analytics teams.Integrated GitHub with Databricks for CI/CD workflows and managed cost-efficient compute with auto-terminating clusters.Transformed raw API data into clean, structured formats for analysis, handling schema validation and null filtering.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.