Vishnu K

Senior Data Engineer @Centene Corporation

St Louis, MO, US

Analyzed data and developed models, algorithms, visualizations, and simulations for complex business problems.• Using rest API with Python to ingest Data from and some other sites to BIGQUERY.• Build a program with Python and Apache beam and execute it in cloud Dataflow to run Data validation between raw source files and BigQuery tables.• Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL, and U-SQL Azure Data Lake Analytics. Data Ingestion to one or more Azure Services -(Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks• My primary responsibility involved creating and maintaining ETL workflows using Informatica and SQL, integrated across Oracle, Teradata, and other databases. • I utilized CA7 for job scheduling to automate ETL tasks, achieving efficient data updates. My work with complex data modeling and metadata repository management was instrumental in structuring processes for enhanced accuracy and scalability, and I frequently collaborated with data architects to align on complex data transformation requirements.• Ensured data storage and management using Azure Blob Storage, implementing best practices for security and scalability• Performed statistical analysis to establish causal relationships between drivers and outcomes.• Built analytics processes for anomaly detection, knowledge discovery, decision-making, insights, optimization, monitoring, and new capabilities.• Partnered, supported, and collaborated with Business teams to assess business needs, defined project scope and requirements, managed expectations, facilitated communication, and provided project updates.• Translated business requirements into technical requirements and worked with Enterprise Architects, Solution architects, and technical teams to assess implementation methods and solution feasibility.