Nikhil Mylarusetty
Data Engineer at Microsoft ||MS Data Analytics Graduate student at San Jose State University
- Role
- Data Engineer at Microsoft
- Location
- Redmond, WA, US
- LinkedIn followers
- 500 followers
Experience
Data Engineer
Aug 2024 — Present · Redmond, WA, US
Engineered and optimized data pipelines in Azure Synapse, utilizing PySpark for automated ingestion and transformation of incident management data, achieving a 15% reduction in incident resolution times and enhancing system reliability.• Implemented real-time data streaming using Azure Event Hubs and Apache Kafka, integrated with Apache Spark Streaming, enabling sub-second processing of ICM ticket data and ensuring rapid incident resolution.• Orchestrated the integration of transformed incident data into Azure Data Explorer (ADX) using Lens Jobs.• Structured the data into fact and dimension tables within ADX, enabling robust querying with Kusto Query Language (KQL) for fast analytics and real-time operational insights.• Optimized data warehousing solutions by integrating Azure Data Lake and Azure Functions, improving data storage scalability and enabling automated data processing workflows.• Built and automated CI/CD pipelines using Azure DevOps and Jenkins to streamline the deployment of ETL workflows and data engineering solutions, ensuring consistent integration, version control, and faster delivery cycles.• Collaborated with the research team to architect a specialized data pipeline for outage data analysis, utilizing Apache Airflow for orchestration and Databricks for advanced data processing, enhancing analytics and operational intelligence.
Education
BML Munjal University
Bachelor of Technology - BTech, Computer Science
San José State University
Masters in Data analytics
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.