Praveen Kumar Sampath Kumar
Senior Data Engineer / Project Manager
- Role
- Senior Data Engineer at Citi Bank at Wipro
- Location
- Jersey City, NJ, US
- LinkedIn followers
- 500 followers
About Praveen Kumar Sampath Kumar
Senior Data Engineer with 18+ total experience in IT and 8+ Years in Data Engineering. Good experience in Spark(Scala and Pyspark), AWS components like EMR, S3, Glue, Lambda. Good experience in Big Data tools like Nifi, Kafka, NoSQL DBs like Hbase, cassandra nd Mongodb. Vast experience in Oracle/Sybase/MySQL Database, Development, Support and maintenance. Excellent experience in unix/python scripting. Performing additional role as Scrum Master. Strong analytical, organizational abilities.
Experience
Senior Data Engineer at Citi Bank
Aug 2023 — Present · Jersey City, NJ, US
Migration of On-prem Data Pipelines to Azure Involved in creating metasheets which behaves as metadata for the pipelines. Involved in reading data from different sources like Mainframe, DBMS and Delimited data. Involved in Data Ingestion of Pipelines from more than 130+ System of Records. Validation of ingested data in Azure by comparing with on-prem data Monitoring daily ingestion of data pipelines into Azure in Oracle, Airflow and Postgres Analyzing and resolving of issues arising in Data Processing in Azure. Analyzing logs from Splunk and Datadog. Used various Azure Synapse Analytics apps like Synapse SQL and Synapse Notebooks to view the data processed in Azure Creation of Synapse notebooks to validate on-prem vs Azure Data. Created SQL scripts to pick the data for File Identification process which transfers the raw files from on-prem to Azure for Data Processing. Loaded and transformed large sets of structured and semi structured data likes XML, ORC, Parquet. Handled complex data processing for JSON Data. Developed Spark applications using Scala and Pyspark and Spark-SQL for data extraction, transformation, and aggregation from multiple file formats. Scheduled different jobs using Airflow, Autosys for data pipelines. Code & peer review of assigned task. Unit testing and Bug fixing.
Education
Anna University Chennai
Bachelor of Engineering (BE), Computer Science
2001 — 2005
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.