Lava Kumar

Experience

1. Senior Data Engineer

   Ford Motor Company

   Mar 2023 — Present · MI, US

   Led the architecture and implementation of Google Cloud Platform (GCP) solutions, focusing on GCP Big Query, Python, and SQL, aligning with the client data engineering requirements. Developed robust ETL processes, leveraging Python scripting for data extraction, transformation, and loading into GCP Big Query, ensuring optimal performance and efficiency. Utilized Agile methodologies throughout the Software Development Life Cycle (SDLC), emphasizing flexibility and responsiveness to evolving project requirements. Worked on development of data ingestion pipelines using ETL tool, Talend & amp; bash scripting with big data technologies including Hive, Spark, Kafka, and Talend. Created Databricks notebooks using SQL, Python and automated notebooks using jobs. Responsible for estimating the cluster size and troubleshooting of the Spark data bricks cluster. Designed and implemented the Enterprise Data Warehouse and Analytic project from scratch utilizing cloud- based infrastructure and the Data Vault 2.0 design pattern to ensure agility and reliability. Designed, developed and Implemented ETL Process using IICS Data Integration. Collaborated closely with cross-functional teams, including data scientists, business analysts, and client stakeholders, to understand requirements and deliver tailored data solutions. Developed data pipeline using Flume, Sqoop to ingest customer behavioral data into HDFS for analysis. Used Python and Django creating graphics, XML processing, data exchange and business logic implementation. Used Informatica Power Center for extraction, transformation, and loading (ETL) of data in the data warehouse. Conducted regular performance tuning of SQL queries, Spark jobs, and data pipelines to optimize resource usage and reduce processing time. Utilized tools like Cloud Monitoring and Logging for proactive system monitoring and issue resolution.