Mahitha K.

Senior Data Engineer @American Tech Vision Solutions Llc Atvs

TX, US

Designed and managed intricate SQL queries, stored procedures, & functions for data retrieval, manipulation across SQL Server environments.• Led end-to-end development and implementation of ETL processes for data ingestion into a Data Lake, resulting in processed data quality.• Implemented internal process improvements, automating 40% of manual processes, optimizing data delivery, and redesigning infrastructure for scalability, enhancing system performance by 20%.• Utilized Azure Synapse Analytics, Azure Data Lake Storage and Databricks for enhanced ETL processes, increasing data throughput by 15%. and to build robust and integrated data pipelines, enabling seamless data ingestion, processing, and storage. • Developed and maintained CI/CD pipelines using Jenkins and Git, enhancing deployment efficiency by 25%. Implemented Agile methodologies to streamline project management, reducing development cycle time by 20%.• Designed and implemented RESTful APIs and web services, improving data accessibility for internal and external stakeholders.• Collaborated with cross-functional teams to integrate Python-based automation scripts and deploy REST services.• Responsible for estimating the cluster size, monitoring, and troubleshooting of the Spark Databricks cluster. • Involved in performance tuning of Spark Applications for setting right Batch Interval time, correct level of Parallelism and memory tuning. • Leveraged Azure Synapse\'s integration with Azure Data Factory to automate and orchestrate data workflows, reducing manual intervention and improving overall data pipeline efficiency.• Collaborated with cross-functional teams to design and implement data-driven solutions using Azure Synapse, providing technical expertise and guidance throughout the project lifecycle to ensure successful delivery and adoption.

University of Houston

Master's degree