Thanmai Gupta
Senior Data Engineer @ Wells Fargo | ETL, Hadoop, Kubernetes, SQL, Python, AWS
- Role
- Senior Data Engineer at Wells Fargo
- Location
- Charlotte, NC, US
- LinkedIn followers
- 500 followers
About Thanmai Gupta
As a Senior Data Engineer at Wells Fargo, I build models using statistical and machine…
Experience
Senior Data Engineer
Feb 2023 — Present · Charlotte, NC, US
Built models using Statistical techniques like Bayesian HMM and Machine Learning classification models like XG Boost, SVM, and Random Forest. Solid in-depth understanding of Information security concepts, Data modeling, and RDBMS concepts. Experience in integrating Spark-MySQL connector and JDBC connector to save the data processed in Spark to MySQL. Responsible for creating tables and MySQL pipelines which are automated to load the data into tables from Kafka topics. A highly immersive Data Science program involving Data Manipulation Visualization, Web Scraping, Machine Learning, Python programming, SQL, GIT, UNIX Commands, NoSQL, MongoDB, and Hadoop. Proficient in developing ETL applications on large volumes of data using different tools: MapReduce, Spark-Scala, Hive, PySpark, Azure Databricks, Data Factory Spark SQL, Azure HDInsight and Pig. Managed the activities required to maintain a data & process governance structure. Utilize data from external provider to properly class MDM data components (customer category, sub-category, etc.). Made DataStage jobs utilizing various stages like Transformer, Aggregator, Sort, Join, Merge, Lookup, Data Set, Funnel, Remove Duplicates, Copy, Modify, Filter, Change Data Capture, Change Apply, Sample, Surrogate Key, Column Generator, Row Generator, Etc. Perform data manipulation, data preparation, normalization, and predictive modelling. Improve efficiency and accuracy by evaluating model in Python and R. Setup storage and data analysis tools in Amazon Web Services cloud computing infrastructure. Used pandas, NumPy, seaborn, SciPy, MatPlotLib, scikit-learn, NLTK in Python for developing various machine learning algorithms. Performing ETL data pipelines, from ingestion of data to consumption by business intelligence and advanced analytics teams. Launching Amazon EC2 Cloud Instances using Amazon Images (Linux/ Ubuntu) and Configuring launched instances concerning specific applications to improve robustness.
Education
Sri Indu College Of Engineering & Technology
Bachelor's degree
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.