Devarshee Das
Data Engineer @Apexon | Pyspark | Python | SQL | AWS | Airflow | Snowflake | Gen AI
- Role
- Data Engineer at Apexon
- Location
- Mumbai, MH, IN
- LinkedIn followers
- 500 followers
About Devarshee Das
Data Engineer with near 4 years of hands-on experience designing and building scalable, cloud-native data pipelines using PySpark, Python, and Apache Airflow. I specialize in automating high-performance ETL workflows, ensuring data quality, and optimizing pipelines for production environments.Proficient in AWS services including S3, Glue, and EMR, with a strong foundation in SQL, data modeling, and data warehousing. I\'ve successfully delivered end-to-end solutions and led a client-facing engagement in Belgium, enhancing delivery and stakeholder trust.My tech stack includes Spark, Hadoop, Airflow, Linux, DBMS, UAC, and version control tools like Git and Bitbucket. I\'m well-versed in Agile development using Jira and ServiceNow (SNOW).I enjoy solving complex data challenges, streamlining workflows, and continuously learning to stay ahead in the evolving data ecosystem.
Experience
Data Engineer
Feb 2025 — Present
Over the course of approximately one year, I led the migration and deployment of 20+ critical data pipelines from on-premises Hadoop environments to cloud-based storage on AWS S3, designing and optimizing scalable data pipelines using PySpark, Airflow, and Python on the AWS Edison platform, resulting in a 15% improvement in runtime efficiency. I developed high-performance ETL workflows using SQL and Spark SQL to transform raw data into structured warehouse tables, while architecting a centralized Airflow DAG to orchestrate and monitor over 400 data pipelines for operational excellence. I applied data modeling and normalization principles to build robust integration workflows, automated metadata extraction and data validation using AWS Lambda for S3 file ingestion, and streamlined schema discovery through AWS Glue Crawlers. Additionally, I collaborated on-site with clients in Belgium to enhance project execution and mentored junior data engineers through structured knowledge-transfer sessions, supporting faster onboarding and team productivity.
Education
Scaler
Certificate, Data Science
Atomic Energy Central School
XII, Computer Science
Terna Engineering College
Bachelor of Technology - BTech, Electrical and Electronics Engineering
2018 — 2022
Atomic Energy Central School
Central Board of Education, Computer Science
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.