Abhilash Manchikanti

Azure Data Engineer @Tata Consultancy Services

NY, US

Designed and implemented large-scale ETL pipelines using Azure Data Factory to ingest and transform multi-terabyte clinical trial, research, and drug manufacturing datasets.• Developed PySpark data transformation jobs in Azure Databricks to cleanse, aggregate, and standardize genomic, patient, and lab datasets for advanced analytics.• Integrated curated datasets into Azure Synapse Analytics for business intelligence, predictive modeling, and regulatory reporting.• Optimized Synapse queries through partitioning, materialized views, and result set caching, reducing execution times.• Implemented secure data storage and access control using Azure Data Lake Gen2, RBAC policies, and Azure Key Vault for secrets management.• Automated metadata management and lineage tracking using Azure Purview, ensuring compliance with HIPAA and FDA regulations.• Enabled near real-time ingestion of IoT-enabled lab instrument data via Azure Event Hubs and Stream Analytics.• Configured Power BI reports and dashboards for R&D leadership to monitor clinical trial progress, drug efficacy, and manufacturing efficiency.• Developed CI/CD workflows using Azure DevOps Pipelines to automate deployment of data engineering workloads and infrastructure as code.• Collaborated with cross-functional R&D teams, regulatory experts, and data scientists to deliver curated datasets for drug discovery and trial optimization.