Mahesh B
Azure Data Engineer @Sentara Health
Signup · Get unlimited contacts
WORK HISTORY
Azure Data Engineer @Sentara Health
VA, US
Designed and implemented scalable data ingestion pipelines, ingesting data from various sources such as SQL databases, CSV filesExtensive experience in developing Apache Spark applications within the Databricks environment for scalable data processingDesigned and implemented into automate clinical data workflows, enabling seamless integration between on-premises healthcare systems and cloud-based storage while ensuring HIPAA compliance. Designed and implemented scalable FHIR data pipelines using Azure Databricks to process and analyze healthcare data efficientlyDeveloped and deployed Pyspark script to perform real-time data transformations and PII masking for incoming patient data streams from various healthcare sources. Managed version control and collaboration using GitHub for all data engineering codebases, including ETL pipelines and infrastructure-as-code. Developed and deployed Generative AI models using OpenAI Service to enhance data-driven decision-making. Designed and implemented efficient data engineering pipelines using Databricks to transform and process large volumes of data. Developed ETL workflows in PySpark to ingest, transform, and store FHIR-compliant data in Azure Data Lake and Delta Lake. Designed and developed interactive dashboards and reports in Tableau to drive data-driven decision-making. Utilized Azure Policy and Compliance Center to enforce and monitor regulatory compliance, ensuring that data handling practices align with HIPAA & PHI standards.
ABOUT MAHESH B
Experienced Data Engineer with 12+ years of expertise in designing and building robust, scalable data pipelines and architectures. Skilled in developing end-to-end ETL/ELT workflows to move and transform data from diverse sources into structured and unstructured storage systems. Proficient in data warehousing, data modeling, and analytics solutions, with a strong foundation in scripting, automation, and performance optimization. Adept at collaborating with cross-functional teams to deliver data-driven solutions that support business intelligence and advanced analytics I\'m well-versed in big data technologies like Map Reduce, HDFS, Hive, Sqoop, Oozie, HBase, Pig, Spark, Scala, Kafka, and ETL (DataStage). I\'m dedicated to staying updated with the latest trends and best practices in the dynamic field of data engineering. Collaboration is essential to me, and I enjoy helping junior data engineers. I seamlessly work with DevOps teams to ensure smooth data pipeline deployment and management. I have a proven ability to evaluate new technologies and provide insightful recommendations for integration. Let\'s connect and explore how we can collaborate in the exciting world of data engineering.211
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.