Avinash Waghole
Specialist Data Engineering @LTIMindtree
Signup · Get unlimited contacts
WORK HISTORY
Specialist Data Engineering @LTIMindtree
Mississauga, ON, CA
Processing of small and large scale data sets using data pipelines with Apache Airflow• Scheduling and monitoring data pipelines• Design, develop pipelines to process data from different sources and load to snowflake • Transforming formatted excels using Pandas API to Snowflake compatible file formats• Worked to reusable common library functions• Optimised ETL processes to reduce processing time and avoid tool dependency• Large datasets processing using Spark DataFrame• Up-skilled myself and team with required skills to make individual efficient• Evaluating and identifying right candidate to fulfil requirements
EDUCATION
Liverpool John Moores University
Master of Science
Shri Bhairavnath Vidya Mandir & Jr College, Pabal
SSC
International Institute of Information Technology Bangalore
Post Graduate Diploma
Governmant Polytechnic, Pune
Diploma
University of Pune
BE
SKILLS
ABOUT AVINASH WAGHOLE
IT professional with total 12+ years of experience. Currently working as Specialist Data Engineering since 4+ year with LTIMindtree. Total 8+years into data engineering. 8+ years experience in Bigdata tools and technologies- Bigdata technologies - Apache Hadoop, Apache Hive, Apache Spark, Snowflake, Databricks, AWS EMR, Airflow, AWS EC2 etc Programming/Scripting Languages- Scala, Core Java, Bash Shell, XML, Python, VBScript Databases- Microsoft SQL Server, Oracle, MYSQL. Dataware house- Databricks Lakehouse, Snowflake, Apache Hive. Unit testing- Junit, Scala test Code repositories- Bitbucket, Git IDE- Jupyter/Databricks Notebooks, Eclipse, Visual Code Studio. 3 years and 10 months experience in automation testing- Testing tools used- HP UFT/QTP, Selenium, Excel Macros Automated Web, Java, WPF, Standard windows applications.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.