Jitendra Chauhan
Cloud Data Consultant @Co-operators
Signup · Get unlimited contacts
WORK HISTORY
Cloud Data Consultant @Co-operators
Guelph, ON, CA
Description:Led the first enterprise-scale implementation of Guidewire Claim Data Analytics (GW CDA), delivering a modern Azure data platform with ADF, Synapse Analytics, and Databricks. Designed and built ingestion and ETL frameworks from scratch to enable scalable, governed, and business-ready data pipelines.Responsibilities:(Management: 20%, Architecture: 40%, Development: 40%)• Ingestion Framework Development: Designed and developed an enterprise ingestion framework from the ground up using Databricks, PySpark, Poetry, and Databricks Asset Bundles (DAB), enabling modular, reusable, and version-controlled pipeline deployment.• ETL/ELT Framework: Designed and built a scalable ETL framework in Databricks to process silver layer delta tables as a source and creation of the gold layer tables based on the mapping document.• SFTP Framework: Designed and built sftp key rotation process in Databrick’s pyspark code that automatically handle public key rotation every 90 days for Prod env. And a sftp file transfer process that transfer the files from Cooperators server to third party client’s server.• Cloud Migration: Led migration of Guidewire Parquet datasets from AWS S3 into Azure Synapse Analytics and Oracle, orchestrated via ADF and transformed with PySpark.• ADF & Synapse Pipelines: Engineered automated ADF pipelines for ingestion, transformation, and loading into Synapse dedicated SQL pools; optimized workloads through partitioning, external tables, and query tuning.• CI/CD & DevOps: Automated deployments with GitHub Actions + Databricks Asset Bundles, enabling consistent delivery across Dev, Development, Lab and Prod environments.• Optimization: Improved PySpark pipeline performance by 30% and reduced infrastructure costs by 40% through IR tuning, Synapse DWU optimization, and auto-scaling strategies.Environment: Azure Cloud, ADF, Synapse, Databricks, PySpark, Poetry, Databricks Asset Bundles (DAB), Guidewire CDA, Oracle, ADLS, AKV, GitHub, VS Code
EDUCATION
Mohawk College
Post Graduate Diploma, Computer System Technician- Software
University of Toronto
Certificate, Data Science
SVIT, Gujarat University
Bachelor Degree, Computer Science
SKILLS
ABOUT JITENDRA CHAUHAN
Seasoned IT Professional with over 10 years of experience as a Data Architect, Data Engineer, Big Data Technical Lead, Developer, and Data Scientist in the software development industry.• Certified Data Scientist from the University of Toronto, School of Continuing Studies, showcasing a commitment to ongoing professional development and expertise in the field.• Extensive experience working with leading cloud platforms such as AWS and Azure, demonstrating proficiency in leveraging cloud-based technologies for data engineering and analytics solutions.• Expertise in Big Data Architecture, technologies, and tools/platforms, including Hadoop, Cloudera, Hortonworks, MapReduce, Hive, HBase, Spark, Scala, PySpark, and more, showcasing a deep understanding of the Big Data ecosystem.• Proven track record in developing various Big Data ingestion frameworks for both batch and real-time processing, demonstrating hands-on experience in designing and implementing efficient data pipelines.• Strong background in working with Big Data Hadoop Data Lakes for processing diverse data formats such as flat, EBCDIC, delimited, and XML files, including metadata management, data analysis, lineage, and documentation for end-to-end data extraction projects in Hadoop filesystem environment.• Expertise in machine learning techniques and algorithms, such as K-NN, K-Mean, Time Series, Linear/Logistic Regression, SVM, Classification, Decision Tree, TensorFlow, Neural Network, XGBoost, and more, showcasing proficiency in applying advanced analytics to derive insights from data.• Proficient in popular data science toolkits such as Python, PySpark, NumPy, Pandas, SciPy, Scikit-Learn, and Jupyter Notebook, showcasing strong technical skills in data science programming and analysis.• Experience with data visualization and business intelligence tools and libraries such as Power BI, Pentaho, Tableau, Plotly, Matplotlib, and effective communication of results to diverse audiences.• Accomplished Senior QE Manager with a proven track record in managing test teams of 20+ senior QE professionals for multiple lines of business, successfully delivering and deploying highly complex projects on time.• Proficient in software testing automation tools such as Selenium, Cucumber, SoapUI, JIRA, and Quality Center, along with expertise in various automation frameworks and continuous integration, showcasing a strong foundation in software quality assurance.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.