Thota Venkata
Data Engineer @Tenet Healthcare
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Tenet Healthcare
Designed and implemented scalable ETL pipelines using Python, Apache Spark, PySpark, Scala, and SQL, processing over 1 TB of data weekly and reducing processing time by 30%.• Migrated workflows to AWS Redshift and Azure Synapse Analytics, enhancing scalability and reducing operational costs by 20%.• Developed real-time streaming solutions with AWS Kinesis and Lambda, achieving 99.9% availability and reducing latency by 35% for critical healthcare applications.• Automated data workflows and ETL pipelines with PySpark, Databricks, and AWS Glue, reducing manual intervention by 40% and improving workflow reliability.• Optimized SQL queries in AWS Redshift for data transformation and aggregation, improving performance and reducing execution time by 25%.• Built machine learning pipelines with AWS SageMaker, improving forecast accuracy for patient outcomes by 20%.• Orchestrated data workflows with Apache Airflow and Azure Data Factory, reducing failures by 20% and ensuring seamless integration across various systems.• Managed secure, scalable data storage on AWS S3, optimizing costs with lifecycle policies and ensuring high availability for healthcare data.• Designed and optimized data processing workflows on AWS EMR using Spark and Scala, reducing job execution time by 25%.• Created real-time dashboards with AWS QuickSight and Power BI, enabling stakeholders to monitor KPIs and make data-driven decisions.• Designed graph database models with Neo4j, facilitating advanced analysis for treatment patterns and resource optimization.• Integrated NoSQL and graph databases (MongoDB, HBase, Neo4j) into data pipelines, enabling faster data retrieval and real-time analytics.• Ensured data integrity and compliance with healthcare standards (e.g, HIPAA) through encryption, robust data governance practices, and periodic audits.• Collaborated using Git and JIRA to align with cross-functional teams, ensuring timely and effective delivery of data solutions.
EDUCATION
Velagapudi Ramakrishna Siddhartha Engineering College
Bachelor's degree
The University of Memphis
Master's degree
ABOUT THOTA VENKATA
I am a highly skilled Data Engineer with over 4 years of experience specializing in designing and optimizing scalable data pipelines, integrating diverse datasets, and implementing data processing solutions across the healthcare and technology industries. My expertise includes working with cutting-edge technologies in cloud platforms such as AWS and Azure, and utilizing tools like Apache Spark, PySpark, AWS Glue, Databricks, and Azure Data Factory to deliver high-performance, reliable data solutions.Currently, at Tenet Healthcare, I am responsible for integrating healthcare data from multiple sources, including AWS S3 and NoSQL databases, and transforming it through efficient data pipelines. My work supports real-time insights and decision-making via AWS QuickSight and Power BI dashboards. I have also orchestrated end-to-end data workflows using Apache Airflow and Azure Data Factory, ensuring seamless data integration and transformation across systems.One of my key achievements includes designing and deploying machine learning models using AWS SageMaker, which significantly improved the accuracy of patient outcome predictions. I also enhanced data security and compliance using AWS IAM for role-based access control, aligning with healthcare regulations like HIPAA.Before Tenet, I worked on large-scale data migrations and optimizations, focusing on platforms like Azure Synapse Analytics and AWS Redshift. These efforts resulted in reduced infrastructure costs and improved query performance for large-scale data warehousing. Additionally, my proficiency in CI/CD automation using tools such as Jenkins and GitHub Actions streamlined data workflows and accelerated deployment cycles.I am adept at real-time streaming and big data technologies like Kafka, Snowflake, and Azure Databricks, driving faster data retrieval and analytics. Working in Agile environments, I collaborate with cross-functional teams to align technical solutions with business needs, ensuring that the data infrastructure supports organizational goals and enhances operational efficiency.With a strong foundation in both technical and collaborative skills, I am always eager to contribute to innovative data solutions that drive business transformation, operational efficiency, and actionable insights.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.