Mehnaz Sarwar

WORK HISTORY

EDUCATION

ABOUT MEHNAZ SARWAR

12 years of IT experience which includes around 9 years of experience as Data Engineer, Hadoop developer using Big data technologies like Hadoop Ecosystem, 4+ years of extensive experience into Data Analytics Technologies in Devops / Data Engineer ecosystem which include (Spark, Cassandra, Docker, Kubernetes, Jenkins, Code pipeline, Code build, Lambda, Sqoop, Oozie, Flume, Kafka, Airflow, CI/CD).• Possesses hands on experience in Cloudera Hadoop, Horton Works Hadoop, various ETL tools, Cassandra, and various Confidential IaaS/PaaS services.• Sized and designed scalable Big Data landscapes with central Hadoop processing platforms and associated technologies like ETL tools and NoSQL databases on both Cloud and On-Prem hardware to enable end to end business use cases.• Experience in working on various Hadoop data access components like MAPREDUCE, PIG, HIVE, HBASE, SPARK and KAFKA. Used NoSQL Database including Hbase, MongoDB, and Cassandra.• Exploring with Spark using Scala improving the performance and optimization of the existing algorithms in Hadoop using Spark context, Spark-SQL, Data Frame, pair RDD\'s, Spark YARN. • Develop quality code adhering to Scala coding Standards and best practices.• Experience in Developing Spark applications using Spark - SQL in Databricks for data extraction, transformation and aggregation. Good experience in writing Spark applications using Python and Scala.• Experience in Designing, Architecting, and implementing scalable cloud-based web applications using AWS and GCP.• Set up a GCP Firewall rules in order to allow or deny traffic to and from the VM\'s instances based on specified configuration and used GCP cloud CDN (content delivery network) to deliver content from GCP cache locations drastically improving user experience and latency.• Worked with Oozie and Zoo-keeper to manage the flow of jobs and coordination in the cluster.• Experienced in migrating ETL transformations using Pig Latin Scripts, transformations, join operations.• Experience on handling Hive queries using Spark SQL that integrates with Spark environment• Having good knowledge on Hadoop data management components like HDFS and.• Hands on experience in using various Hadoop workflow components like SQOOP, FLUME and KAFKA.