Aditi Chaubey
Big Data Engineer at Persistent Systems| GCP Certified | AWS Certified | Azure Certified | Python | SQL | Pyspark | Snowflake | DBT | Databricks (Immediate Joiner)
- Role
- Software Engineer at Eviden
- Location
- Gurugram, IN
- LinkedIn followers
- 500 followers
About Aditi Chaubey
Big Data Engineer skilled in ELT/ETL processes, data orchestration, and data modeling…
Experience
Software Engineer
Dec 2021 — Present
Ingestion Framework on AWS with PySpark :Migrated data from Hadoop to AWS S3, enhancing cloud storage access.Used AWS Glue for data anonymization and converted file formats (JSON, CSV, DAT) to Parquet, reducing storage costs by 84% and improving query performance by 45%.Implemented AWS Kinesis Firehose for real-time streaming, handling high-volume IoT data.Transferred data securely with AWS DataSync, ensuring reliable synchronization.Automated workflows with Python, reducing storage costs by 30% by transforming and loading data into Snowflake.Built scalable models with DBT and SQL for Snowflake external tables, boosting query efficiency by 55%.Integrated AWS Redshift for fast querying of processed data, enhancing business intelligence.Enabled cross-platform querying with Snowflake and AWS S3 integration.Processed ~10TB (~14B records) of JSON data over 1 year.Data Engineering on Google Cloud Platform (GCP):Migrated Oracle to BigQuery, integrating SQL Server and SFTP for seamless data transfer and processing.Optimized workflows using Apache Airflow and Python, reducing processing time by 78%.Deployed BigQuery ETL processes with SQL, ensuring data quality and high accuracy.Reduced pipeline latency by optimizing Pub/Sub and improved scalability with serverless architecture.Streamlined data modeling with DBT, improving query performance.Led cost-saving initiatives, resulting in $8.3K savings and a 75% performance boost.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.