Amit Patra

About Amit Patra

Seeking a challenging position, with a strong emphasis on Hadoop and Java technologies, where I can use my abilities and explore the best of skills and acumen to become a valuable asset to the organization.

Experience

1. Big Data Consultant

   Tata Consultancy Services

   Mar 2019 — Present · Kolkata, IN

   Loaded processed data into HBase/Phoenix for high-performance NoSQL storage and real-time data access.Created and managed Hive tables for structured querying and BI integration.Built and optimized PySpark jobs for aggregations, joins, and data transformations for analytics and reporting.Delivered curated Hive data for Qlik Sense dashboards to enable actionable business insights.Contributed to data architecture and lake strategy discussions leveraging EMR and AWS ecosystem.Ensured best practices in data modeling, partitioning, and validation for scalable multi-terabyte environments.Actively participated in Agile ceremonies and collaborated with cross-functional teams to deliver end-to-end analytics solutions.Designed and developed scalable data pipelines on Amazon EMR using PySpark, Hive, and Hadoop for processing structured and semi-structured data.Built and managed cost-effective EMR clusters using auto-scaling, spot instances, and EC2 instance fleets to ensure high availability.Automated cluster provisioning and job orchestration via bootstrap actions and EMR steps.Integrated EMR with Amazon S3 for raw and processed data storage with optimized partitioning and compression.Used AWS Glue Data Catalog to manage Hive metadata and support seamless querying via Athena and Presto.Tuned Spark jobs using dynamic allocation, caching, partition pruning, and broadcast joins to improve performance.Secured EMR using Kerberos authentication, IAM roles, and S3 encryption with SSE-KMS.Developed reusable PySpark ETL libraries and orchestrated pipelines using AWS Step Functions, Lambda, and MWAA.Monitored EMR jobs via CloudWatch Logs, Spark UIs, and performance dashboards; conducted diagnostics and tuning.Migrated legacy on-prem Hadoop/Spark workloads to EMR, maintaining performance and compatibility.

Education

• West Bengal University of Technology, Kolkata

  Bachelor of Technology (B.Tech.), Information Technology

  2008 — 2012

• Sheoraphuli Surendranath Vidyaniketan

  Higher Secondary, Science

  2006 — 2008

Skills

• Sqoop
• C
• Html
• Cascading Style Sheets (Css)
• Web Services
• Hive
• Java Enterprise Edition
• Javascript
• Xml
• Spring
• Hbase
• Mysql
• Jdbc
• Sql
• Oracle
• Hibernate
• Big Data
• Struts
• Jsp
• Hadoop
• Servlets
• Java
• Css
• Core Java
• Pigs
• Pl/Sql
• Sun Certified Java Programmer