Viswadeep M B
Senior Data Engineer @Ltimindtree
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer @Ltimindtree
Hartford, CT, US
Integrated OpenAI APIs into Databricks-based Spark pipelines to generate SIC code recommendations from account business descriptions implementing an accuracy scoring framework that improved classification consistency by 25% and supported underwriting decisions.• Developed a proof of concept using Spark declarative pipelines in Databricks to enable near-real-time data ingestion with built-in data quality checks, improving pipeline reliability and readiness for production adoption.
EDUCATION
Florida State University
Master of Science - MS, Data Science - Computer Science
SV University College of Engineering
Bachelor of Technology - BTech, Electronics and Communication Engineering
ABOUT VISWADEEP M B
Senior Data Engineer with 6+ years of experience building and operating scalable data platforms and pipelines on Databricks, using Apache Spark (PySpark), SQL, and Python across Azure and AWS.I specialize in developing and optimizing Databricks-based ETL pipelines that process tens of millions of records per day, designing Delta Lake and medallion architectures, and improving pipeline performance by 30%+ through practical Spark and SQL optimizations. I have hands-on experience with Spark declarative pipelines and incremental data processing patterns.I’ve integrated OpenAI APIs into data workflows to enable AI-driven analytics and automation, and have implemented CI/CD pipelines for data workflows to improve reliability and deployment consistency. I take end-to-end ownership of pipelines from ingestion and transformation to monitoring and production support.M.S. in Data Science, Florida State University.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.