Hitesh Agrawal

About Hitesh Agrawal

In my career, I have been lucky enough to have worked on a variety of things ranging from \'Application design and development\' to \'Search and Analytics\' to \'Data Platform creation and maintenance\' to \'AI Tools & MCP Server\'. I believe in continuous self-growth and don\'t shy from facing new challenges head-on outside of comfort zone.Data Science Major from Bangalore. Gaming Enthusiast. Like to read Fiction Novels.

Experience

1. Data Engineer

   Trafigura

   Apr 2021 — Present · Mumbai, IN

   Part of global Data Science and Engineering team.We help help traders, data scientists and analysts by understanding their needs and building cutting edge solutions for the same. I am responsible for end to end delivery of products, currently I have 3 products in my folio and 1 jointly managed.1> Event driven ingestion pipeline ingesting high volume of data in near real time into Iceberg. Support for reconciliation and automated maintenance along with lineage information of each and every event flowing through the pipeline.2> A extendible config based ingestion framework for easily migrating data from various sources to Iceberg. Framework takes care of creating schedules / S3 Triggers, corresponding iceberg tables if they don\'t exist, running maintenance on the iceberg tables. Framework can be extended to include custom extract, transform or load stages.3> An On-Prem Hosted Service which provides masking & unmasking capabilities for tokens, generating a pair of (DEK + HMAC) key for file encryption / decryption.4> A MCP Server integration framework connected to TeamsBot, which allows for multiple MCP servers to be integrated and then interact with them via Teams in a authorized way to run various operational tasks. Apart from that I am also responsible for maintenance and improvements in our data platform, researching and incorporating new technologies.Tech : AI Integration Tools, MCP Servers, Glue, Redshift, RDS, MWAA, Lambda, Athena, EMR, MSK, ECS, Kinesis, Flink, Iceberg on S3

Education

• International Institute of Information Technology Bangalore

  Master of Technology (M.Tech.), Data Science

  2015 — 2017

• Medi-Caps Institute of Technology & Management Rau, Indore

  Bachelor of Engineering (B.E.), Computer Science

  2011 — 2015

Skills

• Amazon Ec2
• Php
• Representational State Transfer (Rest)
• Cascading Style Sheets (Css)
• Protege
• Ontologies
• Java
• Apache Jena
• Python
• Mysql
• Apache Kafka
• Scala
• Spring Framework
• Hadoop
• C
• C++
• Semantic Web
• Owl
• Microsoft Powerpoint
• Angular2