Rahul Sripada

About Rahul Sripada

Data Engineer with 4+ years of experience in finance and healthcare sectors, proficient in building robust data pipelines using Python and SQL to manage and transform complex datasets, ensuring seamless data flow across systems. Skilled in cloud platforms, including AWS and Azure, with hands-on experience in services such as AWS EMR, S3, Redshift, Azure Data Lake, and Azure Data Factory to design and optimize scalable data solutions. Experienced with big data frameworks such as Apache Spark and Hadoop, enabling efficient handling of large data volumes and advanced analytics for finance and healthcare data. Strong knowledge of ETL processes and tools like Apache Airflow, Talend, and Informatica, ensuring data quality, reliability, and consistency across multiple sources. Proficient in data warehousing and database management systems, including Redshift, Snowflake, and MySQL, to support secure storage and retrieval of structured and unstructured data. Expertise in data governance, data security, and regulatory compliance standards such as HIPAA for healthcare data and SOXfor finance, ensuring privacy and compliance. Hands-on experience with data visualization tools like Tableau and Power BI to create insightful dashboards and reports for stakeholders, supporting data-driven decision-making. Adept at performance tuning and optimizing query performance for large datasets, ensuring high efficiency and scalability in data processing and retrieval operations.

Experience

1. Data Engineer

   American Express

   Jan 2024 — Present · NY, US

   Engineered and optimized data pipelines for batch and real-time data processing in Hadoop and Spark ecosystems, improving data accessibility and supporting rapid decision-making. Developed a robust data solution using PySpark and Hive for a financial reporting project, reducing processing time by 30% and enabling near-real-time data insights for stakeholders. Led a small team of developers to implement continuous integration and delivery (CI/CD) using GitHub, automating code deployment across test, integration, and production environments, and enhancing deployment efficiency. Designed and developed optimized SQL queries for data extraction and transformation in PostgreSQL, and executed Hive scripts to process large datasets, implementing optimization techniques to streamline join operations and reduce memory usage. Automated deployment scripts using UNIX shell scripting, minimizing manual intervention and achieving smoother deployments and scaling based on demand projections. Actively participated in Agile ceremonies, including sprint planning, user story analysis, and code reviews, ensuring code quality and adherence to best practices. Integrated cloud solutions on AWS to manage data scalability, leveraging S3 for storage and Redshift for data warehousing, resulting in a highly available, cost-effective data infrastructure. Utilized Tableau data visualization tool to create interactive dashboards, enabling stakeholders to gain valuable insights from complex data through clear and accessible visual formats.

Education

• ACE Engineering College, Hyderabad

  Bachelor of Technology - BTech

  2017 — 2021

• Saint Louis University

  Master's degree

  2023 — 2024