Priya C

About Priya C

Around 8 years of professional experience in all phases of SDLC including requirements analysis, applications design, development, Integration, maintenance, Installation, Implementation and testing of various client server and web applications on Big Data Eco-System. • Strong experience in writing scripts using Python API, PySpark API and Spark API for analyzing the data. • Extensively used Python Libraries PySpark, Pytest, Pymongo, cxOracle, PyExcel, Boto3, Psycopg, embedPy, NumPy and Beautiful Soup. • Experience implementing Cloud based Linux OS in AWS to Develop Scalable Applications with Python. • Experience in Google Cloud components, Google container builders and GCP client libraries and cloud SDK\'s • Hands-on use of Spark and Scala APIs to compare the performance of Spark with Hive and SQL, and Spark SQL to manipulate Data Frames in Scala. • Expertise in Python and Scala, user-defined functions (UDF) for Hive and Pig using Python. • Experience in developing Map Reduce Programs using Apache Hadoop for analyzing the big data as per the requirement. • Hands on Spark MLlib utilities such as including classification, regression, clustering, collaborative filtering, dimensionality reduction. • Experience in working with NoSQL databases like HBase and Cassandra. • Expertise in Big Data processing using Hadoop, Hadoop Ecosystem (Map Reduce, Pig, Spark, Scala, Hive, Sqoop, Flume and HBase, Cassandra, Mongo DB, Kafka Framework) implementation, maintenance, ETL and Big Data analysis operations Adapt at implementing E2E solutions on Big Data using Hadoop framework, executed, and designed big data solutions on multiple distribution systems like Cloudera (CDH3 & CDH4), Hortonworks. • Expert in developing SSIS/DTS Packages to extract, transform and load (ETL) data into data warehouse/ data marts from heterogeneous sources. • Good working knowledge and experience in Amazon Web Services (AWS) Cloud Platform which includes services like EC2, S3, VPC, ELB, IAM, DynamoDB, Cloud Front, Cloud Watch, Route 53, Elastic Beanstalk (EBS), Auto Scaling, Security Groups, EC2 Container Service (ECS), Code Commit, Code Pipeline, Code Build, Code Deploy, Dynamo DB, Auto Scaling, Security Groups, Red shift, CloudWatch, CloudFormation, CloudTrail, Ops Works, Kinesis, IAM, SQS, SNS, SES.

Experience

1. Senior Data Engineer

   United Airlines

   Nov 2022 — Present · Houston, TX, US