Donpal Rajitha

Experience

1. Data Engineer

   Charles Schwab

   Aug 2024 — Present · US

   Designed and maintained scalable ETL pipelines using SQL, Apache NiFi, and SSIS to extract, transform, and load healthcare data from various sources, ensuring efficient data integration and processing.• Developed automated data workflows for daily, weekly, and monthly data processing, leveraging SQL, Apache Airflow, and Talend to optimize data ingestion and reporting processes. • Engineered and optimized data warehouses using PostgreSQL, SQL Server, and Snowflake to centralize and streamline healthcare application data, improving data accessibility and analytics capabilities. • Utilized big data technologies such as Apache Spark and Hadoop to process large healthcare datasets, enabling advanced analytics, predictive modeling, and time series forecasting for operational decision-making. • Built real-time data streaming solutions with Apache Kafka and AWS Lambda to facilitate continuous data flow between healthcare systems, enhancing patient monitoring and reporting efficiency. • Developed interactive dashboards and data visualization tools by integrating BI tools like Tableau and Power BI with data warehouses, improving decision-making for healthcare providers. • Ensured data integrity and governance by implementing validation rules, anomaly detection, and data quality checks using Python (Pandas, NumPy) and DBT, maintaining compliance with healthcare regulations. • Performed advanced data modeling and feature engineering for predictive analytics in healthcare operations, supporting decision-making in patient care and resource allocation. • Implemented DevOps practices using Docker, Jenkins, and GitLab CI/CD to automate deployment and monitoring of data pipelines, reducing operational overhead and improving data reliability. • Collaborated in Agile environments with cross-functional teams using JIRA, SharePoint, and Rational Team Concert (RTC), ensuring timely delivery of healthcare data solutions.