Srikanth Ch

Experience

1. Sr Data Engineer

   American Express

   Apr 2023 — Present · Phoenix, AZ, US

   Developed data pipelines in airflow on GCP for ETL-related jobs utilizing various airflow operators. Gained experience in writing Spark applications in Scala and Python. Knowledge of BigQuery, Cloud functions, and GCP Dataproc Using HDFS MapReduce, Kafka, Spark, HBase, Hive, Hive UDF, and Spark to analyze massive and important datasets. used the Scala Kafka Consumer API to get data from Kafka topics. Demonstrated deep expertise in Palantir Foundry and Palantir Gotham, leveraging Kappa (streaming data) and Lambda (batch data) architectures to design and optimize scalable data integration workflows for financial datasets Designed and implemented API development and consumption workflows, creating RESTful APIs to enable secure data exchange between Palantir platforms and external systems, enhancing interoperability across enterprise applications. Ensured data security and compliance by implementing best practices aligned with GDPR and HIPAA standards, safeguarding sensitive financial and customer data during ingestion, transformation, and storage processes. Successfully optimized Ab Initio ETL workflows, reducing processing time by 30% through efficient graph design and parallel processing. Developed and implemented complex data integration solutions to consolidate data from multiple systems into a unified repository. Implemented robust error handling and logging mechanisms to ensure reliable and accurate data processing. Experience in building and architecting multiple Data pipelines, end-to-end ETL process for Data ingestion and transformation in GCP, and coordinating tasks among the team. Experience in building and architecting multiple Data pipelines, end-to-end ETL, and ELT processes for Data ingestion and transformation in GCP.

Education

• KL University

  B.tech

  2009 — 2013