Trinanjan Das

About Trinanjan Das

I have 6+ yrs Experience in Data Engineering/ Big Dara development field. Currently working as a Data engineer at Amazon. My previous companies that I have worked on are Deutsche Bsnk, Optum & Cognizant. My Big Data Skills are :AWS techstacks, Hadoop,Spark,Scala,Python,Shell scripting,Hive,Impala,Hbase,Sqoop,Control-m,Oozie scheduler,Git,Bitbucket,Teamcity,Oracle,MySql,Big data,Distributed computingOther skills are : Taking ownership of products,Debugging,Critical thinking,Data Engineering enthusiastic,Good Client Handling capability.DEUTSCHE BANK -CTD Trade data ingestion and enrichment (Trade Surveillance Process):• Built ETL pipeline: API call -> HDFS storage.• Processed data using Spark-scala.• Enriched data with reference fields.• Stored enriched data in external Impala table.cRDS Ingestion Migration (CDN to SDP Model):• cRDS Data Analysis: In-depth analysis of CDN and SDP data models.• gRPC Migration: Migrated CRDS ingestion from standard API to gRPC.• gRPC Module: Developed complete gRPC connection module from scratch.• Pipeline Development: Built new build process and E2E pipelines in spark-scala including all the controls.• Data Ingestion & Storage: Ingested data, stored in HDFS, exposed Impala entities.• Backward Compatibility: Maintained backward compatibility for existing trade data enrichmentusage.• Spring boot to Spark-Scala Migration for PNL Data Ingestion:PNL data pipeline migrated from Spring boot to Spark-Scala Maintaining existing business logic.• Jobs transitioned from Oozie to Control-M.• ~50% improvement achieved in performance.Pipeline Optimization & Enhancement:• Enhanced & optimized multiple pipelines, built for different business units like AAR, EUBMR, ENPR etc.• Reduced execution time by 50% which results in cost savings. Also improved storage consumption.OPTUM GLOBAL SOLUTIONS (United Health Group)->• Development and Maintenance of Big Data Application for Healthcare domain with Spark-Scala on Hadoop Cluster (Cloudera) with current size of 50 data nodes running on Yarn mode.• Redesigned some of the pre running jobs with more optimized stages.• Developed ETL Pipeline, Complex SQL queries to retrieve data from databases as well as for performance tuning.• Handling huge amount of HealthCare data of mostly semi structured type.• Worked on reporting-based project for analyzing huge data.• Created external Hive tables for analyzing the data. Also done Spark processing to gather structed information and stored the data in Datawarehouse for visualization.

Experience

1. Data Engineer Ii

   Amazon

   Jun 2025 — Present · Bengaluru, IN

Education

• Techno india saltlake

  B.tech, Electrical engineering

  2015 — 2019