Saroj Kumar Sahoo
- Role
- Senior Data Engineer at Amazon Web Services (AWS)
- Location
- Seattle, WA, US
- LinkedIn followers
- 500 followers
Experience
Senior Data Engineer
Sep 2021 — Present · Seattle, WA, US
Amazon Web Services. Leveraged AWS cloud services such as EC2 auto-scaling and VPC (Virtual Private Cloud) to build secure, highly scalable and flexible systems that handled expected and unexpected load bursts and can quickly evolve during development iterations. • Worked with Data and Analytics team to architect and build Data Lake using various AWS services like EMR, S3, Athena, Glue, Redshift Spectrum, Redshift, Spark, Hive and Airflow. • Developed generic Spark frameworks to assist different data science teams on onboarding different datasets from various sources. • Leveraged AWS S3, Lambda and Glue to build serverless event driven data pipelines. • Developed end to end streaming data pipelines using Kinesis stream, S3 and Athena. • Ingested continues data from various API endpoints using Lambda. • Developed python code for different tasks, dependencies, SLA watcher and time sensor for each job for workflow management and automation using Airflow tool. • Deployed data pipelines with CICD process using Code pipelines, CDK.
Education
Indian Institute of Technology, Guwahati
EPPM
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.