Sahithya Nimmala
Data Engineer | Expert in AWS, Azure, Snowflake & Kafka |Data Pipelines, Big Data Integration & Real-Time Streaming | 6 Years in Data Solutions.
- Role
- Data Engineer at Raven Software Solutions Inc
- Location
- Boston, MA, US
- LinkedIn followers
- 500 followers
About Sahithya Nimmala
As a dynamic and results-driven Data Engineer with over 5 years of experience, I…
Experience
Data Engineer
Feb 2023 — Present · Dallas, TX, US
Designed and implemented end-to-end ETL pipelines, transforming large datasets and reducing manual effort by 25%, improving data processing efficiency.• Developed and deployed scalable data solutions using PySpark, AWS Kinesis, and Spark Streaming for both batch and real-time processing, ensuring real-time data availability and reducing latency by 20%.• Integrated AWS services such as S3, Redshift, Glue, Athena, RDS, and EC2 for optimized data storage, querying, and analytics, enhancing the performance of data pipelines and the Enterprise Data Warehouse (EDW).• Automated workflows using Apache Airflow and Shell scripts in Oozie, streamlining data processing across multiple environments to ensure reliability and consistency.• Enhanced SQL and HQL query performance by optimizing DDL/DML scripts, reducing execution times by 20%.• Built data integration solutions using Azure Data Factory, Databricks, and Spark for Azure Data Lake and Data Warehousing, improving data flow and reducing processing time.• Implemented CI/CD pipelines using Kubernetes, Git, Docker, Jenkins, and Terraform, automating deployments and ensuring seamless integration across environments.• Processed both schema-oriented and non-schema data with Scala, Spark, Hive, Snowflake, and HBase NoSQL for real-time analytics and pattern recognition, reducing processing times by 15%.• Leveraged Talend for efficient data loading and optimized PySpark tasks for Kubernetes, improving task efficiency and deployment speed.• Developed real-time data streaming and storage solutions using Kafka, EMR, and Redshift, enabling efficient querying and reporting
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.