Shalmali Joshi
Senior Data Science Solutions Consultant@Elevance Health| GSU MS in Data Science | ETL Snowflake| AWS Glue EMR Document DB S3| Airflow orchestration| Python programming| Hadoop -Hive,Sqoop,Spark,Mapreduce,Kafka
- Role
- Senior Data Science Solutions Consultant at Elevance Health
- Location
- Atlanta, GA, US
- LinkedIn followers
- 500 followers
About Shalmali Joshi
Data becomes powerful when it moves from hindsight to foresight — and ultimately to…
Experience
Senior Data Science Solutions Consultant
May 2022 — Present · Atlanta, GA, US
Developed and maintained complex ETL pipelines using Snowflake to facilitate data transfers from Teradata and migrations from on-premises HDFS, optimizing data workflows and storage solutions.• Implemented automation of Snowflake feature pipelines using Snow SQL, achieving fully automated data processes without manual intervention, enhancing pipeline efficiency and reliability.• Executed machine learning models and successfully deployed into production environments while also managing regular data refresh processes to ensure up-to-date and accurate predictions.• Managed data pipelines from various external sources, including Teradata and Hadoop, to ensure high data quality and consistency across diverse data products.• Facilitated ETL transformations via AWS Glue, utilizing S3 and EMR to Document DB, achieving 100% code reusability through a standardized configuration setup for source and destination databases.• Automated monthly and quarterly ETL data refreshes using Airflow DAG orchestration, reducing manual effort by 75% and ensuring timely, accurate data availability.• Enhanced the logging mechanism by transitioning to Avro files, resulting in a 60% reduction in storage usage and faster processing times, while optimizing data processing capabilities with Hive, Spark, and Kafka.• Defined and managed SLAs for data products and production processes, implementing systems integration, security, performance, and data management best practices to maintain operational excellence.• Assessed API performance using JMeter to ensure optimal data delivery and system responsiveness.• Built and maintained robust automation and monitoring frameworks to capture critical metrics and operational KPIs.
Education
Georgia State University - J. Mack Robinson College of Business
Master's degree, Data Science and Analytics
Savitribai Phule Pune University
Bachelor of Engineering (BE), Information Technology
Skills
- Eclipse
- Qc Tools
- Metrics Reporting
- Functional Testing
- System Integration Testing
- Test Planning
- Microsoft Sql Server
- Alm
- Client/Server
- Testng
- Mysql
- Defect Tracking
- Test Execution
- Hp Quality Center
- Regression Testing
- Test Driven Development
- Agile Methodologies
- Web Applications
- Web Testing
- Selenium Webdriver
- Test Estimation
- Agile Testing
- Test Automation
- Software Testing Life Cycle (Stlc)
- Test Strategy
- User Acceptance Testing
- Jira
- Bug Tracking
- Core Java
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.