Raja Shekar

About Raja Shekar

Motivated Data Engineer having 8+ years of professional experience in Data Engineering, Analytics, DataModeling, Data Science, Data Architecture, Programming Analysis and Database Design of OLTP andOLAP systems with sound knowledge in Cloud Technologies (AWS, Azure).• Domain expertise in E-commerce, Healthcare, Enterprise Systems, Financial Sector. Skilled in workingwith cross-functional teams to design, develop and implement data-driven solutions with large data sets tosolve complex business problems and executed data-driven action-oriented solutions with StorytellingCapabilities using agile methodologies.• Performed data engineering functions: data extraction, transformation, loading, and integration to supportenterprise data infrastructures - data warehouse, operational data stores, and master data management.• Good experience in creating and designing data ingest pipelines using technologies such as ApacheStorm- Kafka and Experienced in writing live Real-time Processing using Spark Streaming with Kafka asa data pipeline system.• Strong programming capability using Python and Hadoop framework utilizing Cloudera HadoopEcosystem projects (HDFS, Hadoop, Sqoop, Hive, HBase, Oozie, Impala, Zookeeper, etc.)• Experience in Hadoop 2.0. Led development of enterprise-level solutions utilizing Hadoop utilities such asSpark, MapReduce, Sqoop, Pig, Hive, HBase, Oozie, Flume, streaming jars, Custom SerDe, etc.• Experienced in Agile development, specification, and performance tuning on Oracle databases byleveraging explain plans, tuning SQL queries, and excellent experience in writing Complex SQL queriesto validate data movement between different layers in the data warehouse environment.• Expert in Building reports using SQL Server Reporting Services (SSRS, Crystal Reports, Power BI, andBusiness Objects.• Highly Skilled at Python coding using SQL, NumPy, Pandas, and Spark for Data Analysis and Modelbuilding, deploying, and operating highly available, scalable, and fault-tolerant systems using AmazonWeb Services (AWS).• Hands-on experience in developing web applications implementing Model View Control architectureusing Django, Flask web application frameworks.• Good Experience in developing web applications, RESTful web services, and APIs using Python Flask,Django; good knowledge of web services with protocols SOAP, REST.

Experience

1. Senior Data Engineer

   AbbVie

   Jul 2019 — Present · IL, US

   Responsible for sessions with business, project manager, Business Analyst, and other key people to understand the business needs and propose a solution from a Warehouse standpoint.• Designed the ER diagrams, logical model (relationship, cardinality, attributes, and candidate keys) and physical database (capacity planning, object creation and aggregation strategies) for Oracle and Teradata as per business requirements using ER Studio.• Importing the Data using Sqoop from various source systems like Mainframes, Oracle, MySQL, DB2 etc, to Data Lake Raw Zone.• Responsible for developing data pipeline with Amazon AWS to extract the data from weblogs and store in Amazon EMR and worked with cloud-based technology like Redshift, S3, AWS, EC2 Machine, etc. and extracting the data from the Oracle financials and the Redshift database.• Implemented solutions for ingesting data from various sources and processing the Data-at-Rest utilizing Big Data through Hadoop, Map Reduce Frameworks, HBase, and Hive.• Worked on predictive and what-if analysis using Python from HDFS and successfully loaded files to HDFS from Teradata and loaded from HDFS to HIVE.• Used AWS Lambda to perform data validation, filtering, sorting, or other transformations for every data change in a DynamoDB table and load the transformed data to another data store with heavy user experience.• Worked on Amazon Redshift and AWS kinesis data, create data models and extracted Meta Data from Amazon Redshift, AWS, and Elastic Search engine using SQL queries to create reports.