Laxminath Dewangan

Product Architect @Trinity Life Sciences

Bengaluru, IN

Used data factory activities to make the production pipeline for data copy with transformationUsed databricks notebooks for data transformationAzure data lake gen 2 storage used.Fixed broken and failed Azure data factory pipelines on prodStore processed data to azure delta lake tablesHandled TBs of data to the production pipelinesElastic search was integrated to the reporting tabUsed Spark and Scala to process the data (Including Json parsing)Parsed JSON file to Scala case classes and used to map them in PipelineUsed Impala, Hive and Kudu to maintain data hot and cold storage in Parquet formatHandled production issue’s and maintained pipeline.Involved in Sprint planning and requirement refinement