Sharad Sharma
Software Engineer at Amazon AGI - Data Information
- Role
- Software Engineer at Amazon
- Location
- Seattle, WA, US
- LinkedIn followers
- 500 followers
Experience
Software Engineer
Jul 2021 — Present · Seattle, WA, US
Devised an algorithm and implemented PySpark-based pipelines for extracting publication dates from raw_html and web page content, elevating yield from 20% to 70% and precision from 40% to 82%* Enhanced primary language detection accuracy by 110% through the implementation of a tailored fasttext- based algorithm for web documents, introducing multilingual detection, and improving the quality of spam and sensitive models* Designed Apache Airflow-based workflows to integrate new enrichments into the existing infrastructure, preserving modularity, preventing disruptions and ensuring an efficient mechanism for future iterations while fulfilling customer demands for improved content quality assessment on a corpus of 1 trillion web documents* Constructed a PySpark graph-based pipeline utilizing Amazon Textract to extract plaintext and markdown content from PDFs, incorporating language detection, sentence boundary mapping, deduplication, and successfully processing 10 billion PDFs on a monthly basis* Built an automated infrastructure on EMR Serverless and AWS Lambda which enabled scientists and customers to generate enrichments for their customized data without manual intervention, reducing experimentation timelines by 3 days and facilitating daily table indexing, treatment refreshes* Mitigated EMR instability by designing bootstrap scripts to execute after node provisioning and EMR package installation, yielding zero provisioning-related failures and a significant 75% reduction in high-severity tickets* Optimized data extraction tasks for web documents by fine-tuning EMR configurations and joins, resulting in a processing time reduction of over 90%, pivotal for the successful launch of a 1 trillion-document corpus
Education
Vellore Institute of Technology
Bachelor of Technology - BTech, Computer Science
2013 — 2017
University of Southern California
Master of Science - MS, Applied Data Science
2019 — 2021
Delhi public school - Ruby Park, Kolkata
12th Standard, CBSE
2011 — 2013
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.