Sayantan Barat

About Sayantan Barat

Dynamic, results-driven Senior Software Engineer with 10+ years of experience in data engineering, cloud platforms, and software development. I currently lead offshore delivery for a major U.S. healthcare client at Capgemini, working as an individual contributor to design and build robust, production-ready data solutions using Databricks, PySpark and SQL.I specialize in cloud-native data pipelines and migrations — recently driving a first-of-its-kind Redshift → Databricks migration: architecting Medallion-based ETL, building automated Databricks notebooks and workflow jobs, and implementing end-to-end orchestration. I automate Unity Catalog schema creation, AD-group validation and permission assignment, schema-size threshold monitoring with alerts, and ownership-transfer processes to improve governance and reduce manual effort.Core strengths:Databricks, PySpark, SQL, Unity Catalog, Medallion architectureAWS ecosystem: S3, Redshift, Aurora, Glue Studio, DynamoDB; orchestration with AirflowAutomation of notebooks, job pipelines, AD group permission models and OAuth-based access flowsTechnical documentation, client-facing requirements gathering, and knowledge transferCertifications & recognition:Databricks Certified Generative AI Engineer — AssociateDatabricks Certified Data Engineer — AssociateAzure FundamentalsAwards: Best Regional Oracle PLSQL Developer; Client Value Creation RecognitionMultilingual communicator (English, Hindi, Bengali, Spanish A1–B2) with a passion for continuous learning. Open to relocation and mid–senior level data engineering roles where I can drive scalable, secure data platforms and deliver measurable client value. Let’s connect — I’m excited about opportunities to build data products that matter.

Experience

1. Senior Manager

   Capgemini

   May 2024 — Present · Kolkata, IN

   Data Engineer (Individual Contributor) — working with a US healthcare client to design and build Databricks-based data pipelines and lead a Redshift → Databricks migration. Develop PySpark/SQL notebooks and automated Databricks workflow jobs, implement Medallion architecture, and automate Unity Catalog schema and AD-group permission management.Directly engage with the client on weekly standups to gather requirements and review approach documents prior to development.Build Databricks notebooks and jobs (PySpark, SQL) to create automated ETL pipelines following the Medallion architecture (Bronze/Silver/Gold).Lead development for the first Redshift → Databricks migration, implementing pipelines and orchestration from scratch.Automate Unity Catalog schema creation, validate AD group membership, assign permissions, and orchestrate ownership-transfer of catalog objects.Implement schema-size threshold checks and alerting for monitored Unity Catalog namespaces.Work with JSON, Parquet and CSV flat files; integrate with AWS S3 and Databricks.Gained exposure to Redshift, Aurora DB, AWS Glue Studio, DynamoDB and Airflow.Prepare connectivity and knowledge-transfer documentation; define AD group permission models, sandbox requirements and OAuth flows.Certifications: Databricks Certified Generative AI Engineer (Associate); Databricks Certified Data Engineer (Associate)

Education

• SRM IST Chennai

  Bachelor of Technology (B.Tech.), computer science and engineering

  2006 — 2010

Skills

• Pl/Sql
• Oracle Sql
• Sql
• Informatica
• Oracle
• Software Project Management
• Requirements Analysis
• Oracle Sql Developer
• Goldengate
• Testing
• Oracle Pl Sql
• Java Enterprise Edition
• Oracle Certified Associated (Oracle 9i)
• Unix
• Oracle Database