Sree Varun B.
System Engineer Big Data @Tata Consultancy Services
Signup · Get unlimited contacts
WORK HISTORY
System Engineer Big Data @Tata Consultancy Services
Hyderabad, IN
Installed, configured, and managed Cloudera CDP clusters. Provided L2/L3 support, RCA, and resolved incidents within SLA Monitored and optimized HDFS, YARN, Hive, Spark, Oozie, and other Hadoop ecosystem components to ensure 24/7 availability. Developed, tuned Spark & PySpark jobs (partitioning, caching, resource optimization), reducing runtimes, & improving cluster efficiency. Executed cluster upgrades, patching, and migrations like CDP v7.1.9SP1 & 7.11.3, RHEL 8.10, Spark3, python v3.8 & JRE 1.8.0.46 and DR activity. Built and optimized ETL workflows for ingestion and transformation of large datasets across Hadoop and cloud environments. Optimized resource usage, cluster performance, node health via CM. Performed capacity planning, scaling, and cost optimization while collaborating with BFSI stakeholders to design scalable data solutions. Built real-time data pipelines with Kafka,Spark for low-latency analytics. Working on Integration Hadoop with cloud platforms (AWS S3, EMR, Glue, Athena, Azure Data Lake & Data factory) for hybrid data solutions. PI and Automation of admin tasks with Bash scripts:1. Disk Space Alert: Developed a Bash script to monitor disk usage and send alerts when thresholds (>80%) exceeded.2. Automated start/stop of CM services (Cloudera, MariaDB, PostgreSQL) via Bash scripts, eliminating 100% of manual intervention.3. Optimized DistCp jobs with tuning parameters, reducing Prod-to-DR transfer time to 4 hrs.
EDUCATION
GITAM Deemed University
Bachelor of Technology - BTech, Electrical and Electronics Engineering
ABOUT SREE VARUN B.
Experience with 6 years and strong expertise in Big Data Engineering, Cloudera Hadoop…
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.