Bindu V

About Bindu V

8+ years of experience in Data Engineering, Data Pipeline Design, Development and Implementation as a Sr. Data Engineer/Data Developer and Data Modeler. Strong experience in Software Development Life Cycle (SDLC) including Requirements Analysis, Design Specification and Testing as per Cycle in both Waterfall and Agile methodologies. Strong experience in writing scripts using Python API, Pyspark API and Spark API for analyzing the data. Experience in Google Cloud components, Google container builders and GCP client libraries and cloud SDK’s Hands on experience with Big Data core components and Ecosystem (Spark, Spark SQL, Hadoop, HDFS, Map Reduce, YARN, Zookeeper, Hive, Pig, HBase, Sqoop, Python). Excellent experienced on NoSQL databases like MongoDB, Cassandra and write Apache Spark streaming API on Big Data distribution in the active duster environment. Hands on experience in AWS services like Glue, Redshift, Athena, IAM, Ec2, Step function, S3, EMR, RDS, Hive Queries and PIG Scripting. Designed and Developed Real Time Stream Processing Application using Spark, Kafka, Scala, and Hive to perform Streaming ETL Working with AWS/GCP cloud using in GCP Cloud storage, Data-Proc, Data Flow, Big- Query, EMR, S3, Glacier and EC2 Instance with EMR cluster. Implemented large Lambda architectures using Azure Data platform capabilities like Azure Data Lake, Azure Data Factory, HDInsight, Azure SQL Server, Azure ML and Power BI Experienced working with various services in Azure like Data Lake to store and analyze the data. Have good experience designing cloud-based solutions in Azure by creating Azure SQL database, setting up Elastic pool jobs and design tabular models in Azure analysis services. Expertise in transforming business resources and requirements into manageable data formats and analytical models, designing algorithms, building models, developing data mining and reporting solutions that scale across a massive volume of structured and unstructured data. Knowledge of working with Proof of Concepts (PoC\'s) and gap analysis and gathered necessary data for analysis from different sources, prepared data for data exploration using data munging and Teradata. Well experience in Normalization and De-Normalization techniques for optimum performance in relational and dimensional database environments. Experienced in building Automation Regressing Scripts for validation of ETL process between multiple databases like Oracle, SQL Server, Hive, and Mongo DB using Python.

Experience

1. Data Engineer

   Microsoft

   Apr 2024 — Present