Kaviprakash Selvaraj

WORK HISTORY

EDUCATION

ABOUT KAVIPRAKASH SELVARAJ

Lead Engineer in Data, Analytics and AI space with around 14 years of experience.My core competencies include building data engineering, analytics and AI solutions using various technologies and skills such as Azure Data Factory (ADF), Azure Databricks, Power BI, SQL, Python, Spark, ADLS Gen2, Azure SQL DB, Unity Catalog, Delta Lake, Lake house, DAX, Azure Event Hub, Kafka, Structured Streaming, Azure Logic Apps, Azure Key Vault, Power Automate, SSIS, SQL Server, Mongo DB, Generative AI, Prompt Engineering, Github copilot, Azure Open AI, LLM, GPT 3.5, GPT 4, Lang chain, Semantic search, Vector DB, Master Data Management, Microstrategy and Tableau. Key Responsibilities:* Design and implement scalable and robust data models (conceptual, logical and physical), data flows and data integration solutions to support company’s data-driven initiatives.* Work with business stake holders, data analysts and data engineers to gather requirements and define data architecture solutions.* Expertise in consuming the internal and external data from cloud-based storage accounts, RDBMS systems, REST API end points, FTP servers, file extracts etc.* Expertise in build, schedule and maintain efficient batch and streaming data pipelines to integrate, cleanse, transform data and load into data warehouses for building analytics solutions.* Expertise in working with Relational databases such as SQL server and no sql databases such as Mongo DB.* Extensive experience on designing reporting data models, semantic layers, interactive reports and dashboards, mobile dashboards.* Experience with version control systems, CI/CD pipelines, and agile development methodologies.* Extensive experience in release management, deployment, support and maintenance of ETL and Reporting solutions.* Experience in troubleshooting the performance issues in data pipelines and BI reports and optimize them.* Good understanding of Master Data Management and experience with ETL for MDM projects.* Work on estimating cost, infrastructure and licensing for migrating the solutions from on premise to cloud.* Create and maintain data standards, and best practices to ensure data quality, security and compliance.* Experience in designing data governance solutions to provide centralized access control, auditing, lineage and data discovery capabilities.* Experience in working with Gen AI such as Open AI, Copilot, LLM\'s, Python, Prompt Engineering, Lang chain etc