Lekhasree Narayanagari

Data Engineer @BMO

Toronto, ON, CA

Communicated with the deployment team to deploy the packages and help to execute them. •Created various SQL scripts to perform ETL of daily, monthly and yearly data. •Executed the existing SQL scripts and fixed the scripts to run the packages successfully. •Communicated with various teams to gather the requirements and developed the packages accordingly.•Worked with various tools like Power BI, DBMS, SSIS and SSMS to develop and execute the SQL packages. •Effectively communicated with the incident team to make the changes in the production environment and followed up on the incidents. •Communicated with the QA team to test the solutions developed. •Created an overall progress report to communicate with the manager.•Worked with creating packages from the scratch and execute them.•Having Hands-on experience in writing complex SQL queries.•Worked with the Spark for optimization of the existing algorithms in Hadoop using Spark Context, Spark-SQL, Py Spark, Pair RDD\'s, and Spark YARN. •Worked with NoSQL databases like HBase in creating HBase tables to load large sets of semi-structured data coming from various sources. •Created Power BI Reports using the Tabular SSAS models as source data in Power BI desktop and publish reports to service.•Developed and published reports and dashboards using Power BI and written effective DAX formulas and expressions.•Involved in pulling the ELB logs & Python / S3 Logs from the S3 bucket.•Developed Shell, Perl and Python scripts to automate and provide Control flow to Pig scripts.•Worked on migration of data from On-prem SQL server to Cloud databases (Azure Synapse Analytics (DW) & Azure SQL DB, Azure HDInsight).•Designed, developed, and tested packages to extract, transform and load data using SQL Server Integration Services (SSIS).• Used Spark Streaming to divide streaming data into batches as an input to the Spark engine for batch processing.