Prudviraju Tirumalasetti
Data Engineer @IBM
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @IBM
Hyderabad, IN
Domain: Banking Project: GenAI Data Marts (Jan 2025 – Present). Developed PySpark pipelines for processing customer and account data to create data marts for GenAI-based insights. Developed python scripts to create User Defined Functions (UDFs) for code reusability and modular data transformations. Implemented Spark optimization strategies and deployed SCD Type-2 tables in Hive. Automated data exports to AWS S3 and job orchestration using Airflow. Used Git for version control: regularly committed code, created feature branches, managed pull requests, and performed merges via Bitbucket. Deployed code across QA and PROD environments; scheduled and monitored jobs using Airflow Project: Next Best Conversation (NBC)(Oct 2021 – Dec 2024). Built PySpark ETL pipelines for ingesting and transforming financial data to support personalized customer nudges. Maintained metadata in Collibra and optimized Spark configurations for performance.
EDUCATION
Army Institute of Technology (AIT), Pune
Bachelor of Engineering - BE, Computer Engineering
Jawaharlal Nehru Technological University Hyderabad (JNTUH)
Master of Technology - MTech, Information Technology
SKILLS
ABOUT PRUDVIRAJU TIRUMALASETTI
11+ years of experience in IT with a strong focus on data engineering.• Experienced in Big Data technologies like Spark, PySpark, HiveQL, Hadoop, HDFS and Cloud technologies like GCS, Cloud Composer, Data Proc, DAGs in GCP.• Expertise in data ingestion, transformation, optimization, Data Quality and Governance.• Skilled in building ETL pipelines, Hive data marts, and managing large-scale data processing workflows.• Proficient in Python, Unix shell scripting and orchestration tools like Oozie and Airflow.• Experienced in Agile and Waterfall methodologies; strong team collaboration and stakeholder communication.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.