Vijay Muralidharan

Solutions Architect @Cloudwick

Working as a Big data Engineer (Admin and developer) • proficient in designing efficient and robust ETL workflows • involved in installing, Configuring and managing the Hadoop ecosystem • Assisting the team in building, monitoring, operating development clusters on physical hardware • Involved in Hadoop cluster environment administration that includes adding and removing cluster nodes, cluster capacity planning, performance tuning, cluster monitoring, troubleshooting. • Translating business requirements into system requirements, • Supporting batch and real-time analytical solutions leveraging transformational technologies. • has knowledge of data modeling and understanding different data structures and their limitations. •Supported issues on the security components such as Kerberos and Ranger on HDP. • Implemented High availability for Namenode,ResorceManger,Mysql • installed and supported HDP 2.4 • Constructed sqoop queries for importing data from MySQL and oracle database. • Implemented performance benchmarking of services HIVE, PIG, and spark • performed join operation on skew and messy data using different standardized services which affect the performance of the services. • performed cost-based optimization on Hive and Pig • Captured the outcome of different services by systematically tweaking the JVM parameters. • Comparing streaming services based on throughput and latency