Aditya K.
π€π AI & DATA | Generative AIπ»π§ || DATA ENGINEER | BIG DATA | DATABRICKS |PY-SPARK | Airflow | HADOOP | SQL | AZURE | AWS | GCP | DBT SNOWFLAKE | POWER-BI || || 2X DATABRICKS || AWS Certified || γγπ¨π»βπ»π§πβοΈγγ
- Role
- Senior Data Engineer at EY
- Location
- Pune, MH, IN
- LinkedIn followers
- 500 followers
About Aditya K.
Senior Data Engineer Senior Data Engineer | AWS Certified | Big Data & Cloudβ¦
Experience
Senior Data Engineer
Apr 2023 β Present Β· Pune, IN
Developed scripts to create external tables and analyze incoming and intermediate data for analytics applications in Hive & Spark.β’ Optimized spark jobs using various optimizationtechniques like broadcasting, executor tuning, persisting etc.β’ Responsible for developing custom UDFs,UDAFS and UDTFS in Hive & Sparkβ’ Analyze the tweets json data using hive SerDe API to deserialize and convert into readable format.Orchestrating Hadoop and Spark jobs using Airflow workflow to create dependency of jobs and run multiple Jobs in sequence for processing data.β’ Continuous monitoring and managing the AWS EMR cluster
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included Β· No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.