Yasmeen Abdul

Sr Data Engineer Cloud Engineer @New York Community Bank Nycb

NY, US

Designed a data workflow model to create a data lake in hadoop ecosystem so that reporting tools like Tableau can plugin to generate the necessary reportsAI/ML & LLMs: GPT-based models, LLaMA, Falcon, RAG pipelines, Vertex AI, Vector DBs (FAISS, Pinecone)Microservices Deployment: Docker, Kubernetes, Istio/Anthos, gRPC, REST APIs, Helm* Created Source to Target Mappings (STM) for the required tables by understanding the business requirements for the reports* Developed custom SQL scripts and stored procedures in Netezza to preprocess large datasets before migrating to the cloud data warehouse* Developed PySpark and SparkSQL code to process the data in Apache Spark on Amazon EMR to perform the necessary transformations based on the STMs developed* Hive tables were created on HDFS to store the data processed by Apache Spark on the Cloudera Hadoop Cluster in Parquet format.* Written multiple MapReduce programs in Java for data extraction, transformation and aggregation from multiple file formats including XML, JSON, CSV and other compressed file formats.* Loading log data directly into HDFS using Flume.* Optimized Netezza queries and distribution keys to improve query performance for high-volume financial datasets* Designed and implemented scalable data processing pipelines on the DataBricks platform, leveraging Apache Spark\'s distributed computing capabilities to handle large volumes of data efficiently.* Collaborated with cross-functional teams, including data scientists, data engineers, and business stakeholders, to develop and deploy data solutions using DataBricks, fostering effective teamwork and achieving project goals.* Demonstrated proficiency in data visualization techniques using DataBricks, creating insightful charts, graphs, and dashboards to communicate complex data patterns and trends to non-technical stakeholders.

University of Missouri-Kansas City

Master of Science - MS