Sandeep Kumar

About Sandeep Kumar

ETL Lead with 9 years of comprehensive experience in designing, developing, anddeploying data integration solutions. Expertise in AWS, Snowflake, Informatica PowerCenter, IICS(CDI), Unix shell Scripting, Python, Pyspark and various database technologies (Oracle, SQL Server, Postgres etc.).Roles and Responsibilities:• Designed and developed robust ETL solutions using Informatica IICS (CDI) andPowerCenter for data integration across heterogeneous sources like Mainframe DB2, FlatFiles, SQL Server, and Snowflake.• Design and developed mapping using the REST/SOAP API and used transformation likewebservice, business service.• Implemented and maintained data warehousing solutions using concepts like dimensionmodelling (Star/Snowflake schemas), fact/dimension tables, data marts, partitioning, anddata lineage.• Developed ETL pipelines in AWS Glue to load the Parquet data from S3 to Redshift table.• Built and optimized ETL flows for CDC (Change Data Capture) and SCD (Slowly ChangingDimension) Types 1, 2, and 3 using IICS, PowerCenter, and Glue.• Designed and implemented real-time and batch ingestion pipelines using Snowpipe, AWSS3, and Glue crawlers, leveraging IAM for secure access control.• Utilized Redshift for analytics and reporting, including data loading, transformation (ELT),schema design, and performance tuning via distribution/sort keys.• Designed complex SQL and PL/SQL queries, stored procedures, and user-defined functionsfor data transformation, business logic, and reporting layers.• Developed replication, synchronization, and mapping tasks in IICS, integratingexpression macros, Web Service transformations, and file-based ingestion patterns.• Applied optimization techniques in Snowflake, Redshift, and AWS Glue, including querytuning, partitioning, clustering, pruning, and resource monitoring with CloudWatch.• Created automated shell scripts for data file handling, job triggering, and monitoring inUNIX environments.• Scheduled, monitored, and managed jobs using Tivoli Workload Scheduler and Tidal,ensuring timely delivery and alert-based remediation.• Ensured ingestion and transformation of unstructured/semi-structured data (JSON, XML)using Snowflake functions and IICS parsing capabilities.• Collaborated in an Agile environment with business analysts, architects, and QA teams,delivering scalable and high-performance data solutions.• Mentored junior developers, enforced best practices for coding, testing, and deployment,and conducted regular code reviews to ensure delivery quality.

Experience

1. Senior Data Engineer

   Horizontal

   Sep 2025 — Present · Noida, IN

Education

• Deenbandhu Chhotu Ram University of Science & Technology

  Bachelor of Engineering - BE, Electrical, Electronics and Communications Engineering