Palwinder Singh

About Palwinder Singh

Professional SummaryResults-driven and highly skilled Big Data and Cloud Solutions Engineer with over 9 years of experience in designing, developing, and managing large-scale data processing pipelines, data warehouse solutions, and cloud-native architectures. Proficient across multiple cloud platforms including AWS, Azure, GCP, and Snowflake, with strong expertise in modern data tools, real-time streaming, and distributed systems.Key Expertise: •Big Data & Cloud Technologies:Extensive hands-on experience with Hadoop (HDFS, MapR, Spark), Kafka, PySpark, AWS Glue, Athena, S3, EMR, AWS Lambda, Managed Apache Airflow, AWS Kinesis, and GCP Cloud Dataflow. Skilled in Database Migration Service (DMS) for cloud database transitions. •Data Warehousing & Databases:Proficient in both SQL and NoSQL databases including Microsoft SQL Server, MySQL, AWS Redshift, DynamoDB, HDFS, and Timeseries databases. Specialized in graph databases such as Cassandra, Datastax, ArangoDB, and JanusGraph. •Business Intelligence & Reporting:Strong experience with BI tools like Power BI and Tableau for creating interactive dashboards and data visualizations. •Application Development (Android & API):Solid experience in developing, deploying, and debugging Android applications using Java (v8), Kotlin (v1.5), and C/C++ across various Android and POS terminals. Knowledgeable in ePOS systems, payment integrations (biometric, card/contactless), and web service integration using REST/SOAP with Retrofit. •UI/UX & API Development:Proficient in designing adaptive UI components based on Google Material Design, creating widgets for Android devices with various screen resolutions. Experienced in developing RESTful APIs using C# in Visual Studio.Professional Attributes: •Quick learner with proven ability to adapt to evolving technologies and fast-paced environments. •Strong problem-solving skills with a focus on performance, scalability, and security. •Demonstrated ability to manage multiple projects simultaneously while maintaining high standards of quality. •Excellent team collaboration and communication skills.

Experience

1. Senior Consultant

   StatusNeo

   Aug 2021 — Present · Gurugram, IN

   process semi-structured data by integrating 150 millionraw records from 30+ data sources using Azure, Kafkaand PySpark. Working on real-time data to Predict, find Anomalies,Causations, doing Aggregations using different DataModels. Integrated Datastax - Tool for graphical representationof data having different KPI\'s (Cell/Grid) usingCassandra DB. Created API\'s for smooth insertion of data fromdifferent sources like Azure blob to pipelines tointegrate it with kepler-A data visualisation tool. Designed Cassandra table schema for JC anomaly andCell anomaly for Datastax and Janusgraph Implemented 4-node Cluster Cassandra Db and 4 nodecluster Elasticsearch for smooth and fast quering andinsertion of Data Integration of Janusgraph withGremlin using JanusGraph’s query language, whichis used to retrieve data from and modify data in thegraph. Gremlin helps us to succinctly expressescomplex graph traversals and mutation operations Created API’s using Tornado to ingest data fromdisparate data sources using a combination ofMySQL,CassandraDB, Arango dB and Influx DB (ATimeseries Database) using Python to create dataviews. Outlier detection by creating segments on the basis ofCustomer, Grid and at cell level. Extracting data from different data sources like NoSQL Cosmos DB, MS SQL server etc. using Python and Sparkcode in AWS and then performing data transformationson it.

Education

• Guru Tegh Bahadur Institute Of Technology

  BTech, Information Technology

  2011 — 2015

• Guru Tegh Bahadur Institute Of Technology

  BTech (IT), Information Technology

  2011 — 2015

Skills

• C
• Android Development
• Sql
• Team Management
• C++
• Microsoft Office
• Java
• Javascript
• Mysql
• Html