Brahma Sai K.
Big Data Developer @Synechron
Signup · Get unlimited contacts
WORK HISTORY
Big Data Developer @Synechron
ON, CA
Developed spark jobs using dataframes, datasets and RDDs using Scala spark API.• Developed PySpark jobs using python to transform the data using spark and persist on HDFS.• Created external tables on top of Hive for querying and analyzing the data using HQL and hive queries.• Developed Tableau reports on top of RDBMS and Hive• Built and maintained Kafka consumer to consume data from Kafka topic. Avro data format was used for transmission of data and effective schema management.• Built Data pipelines, Data ingestion and transformation using Apache NiFi to do ETL operations and then data is sent to Elastic search.• Experience developing ETL pipelines using Apache Spark Using Scala and java.• Used spark to read the data from different systems and store it on HDFS and RDBMS.• Worked with the management to gather a detailed understanding of the Business Requirements and converted them into technical specifications.• Experience in the Software Development Life Cycle (SDLC) including requirements collection, design, development, and testing.• Strong experience working with batch and real-time data using spark-streaming and kafka.• Developed Spark code in Scala using Spark SQL & Data Frames for aggregation.• Spark is used to process parquet data from hdfs and transform it and send to different down streams.• Worked on automating the Batch Jobs using shell scripts and schedule on Autosys for easy monitoring.• Wrote custom SQL Queries to generate reports as per the client requirements.• Databricks notebooks were created using SQL and Python, as well as automated notebooks utilising tasks.• Created on-demand tables on S3 files using Lambda Functions and AWS Glue using Python and PySpark.• Used java to create custom parsing of xml while consuming the data.• Used SFTP to transfer the data from different source systems into edge node on big data cluster.
EDUCATION
KL University
Bachelor's degree, Electrical, Electronics and Communications Engineering
University of Windsor
Master's degree, ECE
ABOUT BRAHMA SAI K.
o 6 years of professional IT experience as Big Data/Python/Scala developer and being passionate about Big Data technologies. Worked on Developing, Implementing, Configuring and Testing Hadoop ecosystem components. Familiar with data architecture including data ingestion pipeline design, data modeling, data mining, machine learning and advanced data processing.o Supporting a world class Oracle Applications environment to help shape the strategy, architecture, design, implementation and support of Oracle EBS.o Provide broad leadership, functional and technical expertise in the support and operations of business applications.o Provide functional leadership and support for Oracle Applications with proven experience and ability to work in various Oracle Application Modules (Financials, Supply Chain and Manufacturing).o Provide hands on Oracle experience for large cross functional initiatives. Requires ability to be an effective leader for a diverse set of stakeholders including internal and external customers, IT team members, and software vendors.o Write business requirements, use cases and functional requirements for new functionality or modifications to existing functionality.o Gather business requirements and prepare BR150 documents with gap fitment analysis.o Handle full cycle implementation projects with active participation in post implementation support activities and Support projects.o Assist in the design, development and implementation of Oracle Apps applications of Modules like Inventory, Bills Of Materials, Work in Process, Order Management, Procurement, Cost Management Account Receivables, Account Payables, General Ledger.o Manage and govern Oracle ERP Design Architecture and IT custom solutions, and drive the Oracle CoE Architecture Program to Standardize the IT solutions across globe to stabilize the ERP environment.o Provide both Functional and Technical Architectural Support for Oracle ERP IT solutions and working closely with IM Module Owners to define solution models, approach across SCM & Finance module.o Perform application systems development tasks, which include working with users to define system needs, analyzing and designing applications to meet user needs, design and review Technical/Functional documents and provide sign off, preparing flowcharts and diagrams to illustrate logical sequence.o Schedule and prioritize work and plan a sequence of development activities that accomplish the planned targets. Set priorities and provide reports to the management.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.