Deepak K.

About Deepak K.

Proven success as a Software Engineer on Data Platform (ETL, BI, Reporting, Analytics), providing a well-balanced understanding of business relationships, business requirements, and technical solutions. Demonstrated success in an environment that offers ambiguously defined problems, big challenges, and quick changes. Partner with internal stakeholders to understand business requirements, work with cross-functional data and products teams and build efficient and scalable data solutions. Design, implement and support an analytical data infrastructure providing ad hoc access to large datasets and computing power. Technical Skills: Data Curation, Data Ingestion pipelining, Data Modeling, Data Migration, Complex SQL Queries, Data Warehousing, Dimensional Modeling, Reporting, Data Visualization. Tools: BI/Data Mining Tools: SQL Server Integration Services (SSIS), Informatica. Language: Python,(Expert level), Java, Shell script Databases: MS SQL Server, Oracle, MySQL, PostgreSQL, MongoDB, Hbase, Redshift. Big Data Ecosystem: Hadoop, HIVE, Presto, Pig, Sqoop, Spark, Tableau, Airflow, Redshift Functional Skills: Data Engineering, Data Analysis, Data Quality Management, Problem Solving. Currently, I am working on a project that requires monitoring and managing the SLA for all data sets and systems in allocated different areas of ownership. Extensively involved with data infrastructure and data engineering teams to triage infra issues and provide resolution. On a personal note, I want to leverage analytics to help organizations predict and respond to changes that influence their domains in a sustainable manner. I would like to do so by building, and utilizing robust data analytics systems which quicken the information flow required to make fact-based decisions. I love to solve complex technical contexts challenge, and, above all else, am passionate about data and analytics. You can contact me at: d••••••••@gmail.com

Experience

1. Senior Data Engineer

   Meta

   Oct 2021 — Present · Menlo Park, CA, US

   Implemented data processing pipelines to clean, transform, and structure raw data, ensuring it meets quality and integrity standards- Spearheaded compliance initiatives, focusing on identifying and addressing instances of violence and unethical content within user videos and reels- Led efforts in deprecating outdated source data, proactively updating data ingestion pipelines to align with the evolving landscape of absolute source data- Created insightful dashboards utilizing Tableau and Unidash, providing stakeholders with a visually intuitive and comprehensive understanding of key performance indicators and data insights- Efficiently migrated a petabyte-scale dataset from one geographic region to another, optimizing resource utilization for enhanced performance and operational efficiency- Implemented several optimization initiatives by migrating Directed Acyclic Graphs (DAGs) from Presto to the Spark framework, enhancing overall performance and efficiency.

Education

• Visvesvaraya Technological University

  Bachelor's Degree

• San Francisco Bay University

  Master of Science - MS

  2015 — 2016

• University of the Cumberlands

  Doctor of Philosophy - PhD

  2018 — 2022