Yajvendra Payal
Principal Technical Product Manager - Data Platform @Schneider Electric
Signup · Get unlimited contacts
WORK HISTORY
Principal Technical Product Manager - Data Platform @Schneider Electric
Franklin, TN, US
Driving enterprise-scale data accessibility and availability by architecting a centralized, fully automated platform for data product development. My core focus is on building robust frameworks to support data processing, data security and governance, prioritizing data sharing over replication.Key responsibilities include:Solving challenges related to enterprise data access and availability at scale.Building a centralized layer for secure data publishing, supporting data products that consume diverse sources (ERP, API, flat files, RDS, streaming, and batch data).Leveraging AWS services for the data lake (Glue, Iceberg, S3) and codifying infrastructure using Terraform with GitHub Workflows for CI/CD, ensuring strict governance and security compliance
EDUCATION
COER University
Bachelor of Technology - BTech, Electronics and communication
SKILLS
ABOUT YAJVENDRA PAYAL
A Big Data platform engineer(AWS) with over 15+ years’ experience in the Development, Design and maintenance of Data Intensive applications.Hands on experience of building Enterprise Data Platform for processing Data using Batch and Streaming work flows.Flexible team player who also works well independently. Technology Stack in the current engagement : Data Storage : AWS S3(Lake House)Data Processing : Spark 3.0(Databricks Delta API\'s), Scala, Java(core),Python Streaming: Kafka(Confluent),Kafka connect, KSQL DB SQL Query Engine : Presto with Apache Ranger for access control Workflow Orchestrator : Airflow, Databricks job scheduler, AWS Step functionMisc Services : AWS Lambda,Elasticsearch,Jenkins,Redshift,EKS,Lambda,EC2,TerraformOther experience : Big Data :EMR,Kinesis,Talend 7.1,AWS GlueRDBMS : Aurora Postgres, Mysql 5.0, SQL Server 2008/12, Oracle 10gData Virtualization : Denodo 6.0, Implementing Data virtualization solution at the Enterprise levelLanguages : T- SQL, PL/SQL, Scala,Java(core), PythonBI/ETL Tool : Talend 7.1, SSIS 2008, SSAS 2012, Informatica 8.0,Glue,Spark 3.0BI Reporting Tools : Looker 4.0, SSRS 2008, Power BI, SpotfireBusiness Domain : Electronic device insurance, Health Care, Aircraft Insurance
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.