Kishore Reddy
Azure Data Engineer || Big Data Developer || Data warehouse Engineer
- Role
- Azure Snowflake Data Engineer at Wellington Management
- Location
- Dallas, TX, US
- LinkedIn followers
- 500 followers
About Kishore Reddy
Experienced Azure Data Engineer with over 9 years of experience in the software…
Experience
Azure Snowflake Data Engineer
May 2023 — Present · MA, US
Designed, built, and maintained scalable data pipelines using Python & MATLAB to ingest, process, & transform data from diverse sources.• Implemented ETL processes through SSIS to integrate data from various systems into MySQL databases for storage and analysis.• Designed and implemented data lake solutions using Azure Data Lake Storage (ADLS), allowing for scalable and cost-effective storage of structured and unstructured data.• Wrote complex SQL queries for data extraction, transformation, and loading, ensuring efficient data manipulation and retrieval.• Utilized Azure Databricks for big data processing and analytics, leveraging Apache Spark for high-performance data processing.• Implemented data pipelines using Azure Data Factory to orchestrate and automate data movement and transformation tasks.• Constructed & enforced cloud-based data solutions using Azure Logic Apps & Azure Synapse for seamless data integration & processing.• Utilized Apache Kafka for building real-time data pipelines, ensuring efficient data ingestion and processing.• Developed and optimized Spark jobs for efficient data processing, significantly improving data throughput and reducing processing times.• Implemented data partitioning and indexing strategies in Spark to enhance query performance and manage large datasets effectively.• Performed exploratory data analysis using Pandas, NumPy, Matplotlib, & Seaborn to derive insights from structured and unstructured data.• Developed interactive dashboards & reports using Tableau & SSRS to visualize key trends, facilitating data-driven decision-making.• Adhered within Agile/Scrum methodologies to collaborate with cross-functional teams and deliver data solutions in iterative sprints.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.