Sagar Solanki
Open to Data Engineer Roles | No sponsorship required
- Role
- Senior Data Engineer at Dwellfox
- Location
- Tyler, TX, US
- LinkedIn followers
- 500 followers
About Sagar Solanki
I am a Data Engineering & Business Intelligence professional with solid experience…
Experience
Senior Data Engineer
Nov 2024 — Present
Engineered scalable ETL pipelines using PySpark on AWS Glue, EMR and Databricks, optimizing performance for large-scale data processing workloads.• Migrated legacy Spark jobs to AWS Glue, enhancing efficiency and reducing operational overhead.• Designed and deployed serverless data pipelines using AWS Lambda, Glue Catalog, and Athena for real-time querying and analytics.• Built secure, compliant data ingestion and transformation workflows in AWS, collaborating with data stewards to ensure governance.• Led migration of on-prem data warehouse to AWS Redshift, utilizing AWS DMS and Schema Conversion Tool.• Created and managed DDL scripts for Redshift and Snowflake to support structured data loading and schema evolution.• Implemented monitoring and alerting for Glue Jobs, Lambda functions, Databricks and EC2 instances using CloudWatch, ensuring high availability and performance.• Configured Spark Streaming with Kafka and Flume to enable real-time data ingestion and analytics, storing results in HDFS.• Designed ETL processes to ingest campaign data from S3 (ORC/Parquet/Text) into Redshift using AWS Glue.• Automated infrastructure tasks using Python (Boto3), Bash, Ansible, and Terraform, including AMI backups and EBS encryption.• Participated in cloud architecture planning, deploying high-availability solutions with multi-AZ EC2, ELB health checks, and auto-scaling.• Maintained AWS services including IAM, VPC, RDS, S3, Route 53, CloudFront, and Step Functions, ensuring secure and cost-effective operations.• Contributed to AWS security posture by implementing SSO, MFA, KMS encryption, and threat detection protocols.• Supported containerized workloads using Docker and Kubernetes, integrating with AWS Step Functions for orchestration.• Created dashboards and ad-hoc queries using Athena, Quicksight, and Tableau for business intelligence reporting.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.