Praveen G

Experience

1. Snowflake Data Engineer

   Msa

   Feb 2022 — Present · Pittsburgh, PA

   Involved in creation of Snowflake tables, views using Snow SQL and using Python connector.\\\\n• performed the Migration of tables and views to Snowflake from CDH cluster.\\\\n• Created Snowflake Stored procedures, Snow pipes, Streams and tasks as per the requirement.\\\\n• Using the streamliner did the migration from MYSQL to Snowflake conversion\\\\n• Custom changes to DDLs (Eg: Schema remapping impacted the view dependencies)\\\\n• Conversion of DDLs using SQL Morph (90% conversion)\\\\n• Involved snowflake users access management and provision management using Tram application\\\\n• Day to-day responsibility includes developing ETL Pipelines in and out of data warehouses, developing major regulatory and financial reports using advanced SQL queries in Snowflake.\\\\n• Loaded files finally into S3 buckets and then used snowflake for ELT processing of Data.\\\\n• Real time streaming the data using Spark, Spark Context, Spark-SQL, Data Frame, Pair RDD\'s, Spark YARN.\\\\n• Involved in loading and transforming large sets of structured data from router location to landing zone using a Kafka data pipeline flow.\\\\n• Used Spark for interactive queries, processing of streaming data and integration with popular NoSQL database for huge volume of data.\\\\n• Implemented Spark context, Spark- SQL, Data Frames, Pair RDDs, and Spark YARN, improve the performance and optimize current Hadoop methods.\\\\n• Working on version control systems like Git, and used Source Code management tools like Github, GitLab and command line applications.\\\\n• Data mapping, logical data modeling, created class diagrams, and ER diagrams and used SQL queries to filter data.\\\\n• Experienced in Agile Methodologies, Scrum stories, and sprint planning experience in a Python-based environment, along with data analytics and Excel data extracts.\\\\n \\\\n\\\\n \\\\n \\\\n\\\\n \\\\n