Hemanth B

About Hemanth B

9+ years of experience as Data Engineer in Design, Analysis and Development of software…

Experience

1. Senior Python Data Engineer

   Morgan Stanley

   Jul 2023 — Present · Chicago, IL, US

   Work closely with Engagement managers and Data Scientists to understand the requirements. • Ingest and integrate different datasets from various sources. • Built spark applications to reduce workload on SQL. • Creating pipelines using python with spark framework to ingest data from different sources to the client’s destination. • Validating data by making data profiling around it with the databases like Hive. • Experience in data sets processing and storage. • Designed and managed public/private cloud infrastructures using Confidential Web Services (AWS) which include EC2, S3, Cloud Front, Elastic File System, RDS, VPC, Direct Connect, Route53, Cloud Watch, Cloud Trail, Cloud Formation, and IAM which allowed automated operations. • Deployed Cloud Front to deliver content further allowing reduction of load on the servers. Created IAM policies for delegated administration within AWS and Configure IAM Users / Roles / Policies to grant fine - grained access to AWS resources to users. • Developed Chef Cookbooks and Recipes to manage systems configuration. • Experience in using Snowflake Clone and Time Travel. • Experience in various data ingestion patterns to Hadoop. • Participates in the development improvement and maintenance of snowflake database applications • Automated the cloud deployments using chef, python and AWS Cloud Formation Templates. • Experienced with Docker container service. Involved in building own PaaS with Docker; deployed various applications through Dockers containers • Improved infrastructure design and approaches of different projects in the cloud platform Confidential Web Services (AWS) by configuring the Security Groups, Elastic IP\'s and storage on S3 Buckets. • Customized Confidential Machine Images (AMIs) & deployed these customized images based on requirements • Experience in using XML, Parquet, CSV and JSON file formats and other compressed file formats like Gzip and Snappy.

Education

• Lovely Professional University

  Bachelor's degree, Computer Science

  2010 — 2014