Sushovan Karmakar
Lead Software Engineer @Airtel Digital
Signup · Get unlimited contacts
WORK HISTORY
Lead Software Engineer @Airtel Digital
Gurugram, IN
Working on high volume data ingestion & quering data in near real time.• Working as lead backend developer in the data engineering domain• We designed and implemented a resilient ingestion and processing pipeline capable of handling over 60 GB of data per hour—more than 1.3 TB daily—while maintaining data integrity and operational efficiency.• Developed data models for over 10+ modules, to solve complex business problems using Spark, S3, Iceberg etc. and automated them using Airflow.• Leading the development of a scalable software analytics platform using Apache Iceberg, with datastored in S3 as Parquet files, enabling table versioning and schema evolution.• Integrated Trino to query Iceberg tables using SQL, and deployed Apache Superset for customdashboard reporting and data visualisation across teams.• Implemented fine-grained access control using Open Policy Agent (OPA), ensuring secure,policy-driven governance of data access.
EDUCATION
KIIT - Kalinga Institute of Industrial Technology
Bachelor of Technology - BTech, Computer Software Engineering
Katwa Kashiram Das Institution
High School, Mathematics and Computer Science
ABOUT SUSHOVAN KARMAKAR
Key Technical Skills- Programming Languages: Java, Python- Data Warehousing: Spark, Hadoop, Hive, Airflow, Oozie, Iceberg, S3- APIs: Spring Boot, REST- Databases: SQL Server, MySQL- Technologies: Docker, Kafka, Redis, Microservices, Maven- DevOps: Jenkins- Methodologies: Agile, TDD - Principles: OOPS, SOLID Principles, System Design, Design Patterns- Data Structures & Algorithms- Monitoring & Performance: GrafanaSkills in brief - Java, Spark, Hadoop, SQL- Good in Data Structures and Algorithms- Good in Problem Solving- Demonstrated proficiency in Java(8 and 11), Well-versed with High-Throughput Distributed Systems, API optimisation, MySQL Database(SQL), Microservice Architecture, Spring Framework.In my leisure time, I try to solve programming questions on various websites.I\'m open for new job opportunities.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.