Sourav Halder
Software Engineer @Snap Inc.
Signup · Get unlimited contacts
WORK HISTORY
Software Engineer @Snap Inc.
Berlin, DE
Engineered auto-scalable streaming and batch pipelines through the utilization of Dataflow, Python and Apache Beam, automating a previously manual client integration process and reducing integration time by 4x.‣ Designed and executed a comprehensive monitoring plan, delivering a monitoring dashboard for data pipelines using Stackdriver, Gcloud monitoring, and VictorOps. This solution not only enabled the detection and debugging of elusive system crashes but also helped to improve overall throughput.‣ Skillfully executed the migration of crucial data from the legacy system to a new platform using SQL, enhancing data reliability and simplifying maintenance for strategic business reasons.‣ Strategically redesigned the pipeline architecture to proactively address security concerns following extensive discussions with the Legal and Privacy teams, resulting in a more secure data environment.
EDUCATION
University Institute of Technology, The University of Burdwan
Bachelor of Engineering (B.E.), Applied Electronics and Instrumentation Engineering
Chakdaha Ramlal Academy
Secondary Examination, High School/Secondary Certificate Programs
Chakdaha Ramlal Academy
Higher Secondary, High School Equivalence Certificate Program
ABOUT SOURAV HALDER
I have over five years of experience as a Software Engineer, specializing in backend servers, data pipelines, integration, and DevOps. Currently, I am a Software Engineer at Snap Inc, where I engineer auto-scalable streaming and batch pipelines using Dataflow, Python, and Apache Beam, automating a previously manual client integration process and reducing integration time by 4x. I also design and execute a comprehensive monitoring plan, delivering a monitoring dashboard for data pipelines using Stackdriver, Gcloud monitoring, and VictorOps. This solution not only enables the detection and debugging of elusive system crashes but also helps to improve overall throughput. Previously, I was a Senior Software Engineer and Team Lead at ConvertCart, where I led a team of six developers using Agile Scrum methodologies to develop Email Marketing Software, driving a 22% increase in client retention. I achieved a tenfold improvement in email delivery speed through the implementation of load-balanced pub/sub architecture and horizontal scaling, addressing performance issues with Prometheus and Grafana. I also played a pivotal role in the design of key components, including the Workflow Engine, Bulk Emailing tool, and Email Editor. I am proficient in Node.js, Python, Apache Beam, Terraform, MySQL, and BigQuery, and skilled in orchestrating auto-scalable pipelines and crafting innovative monitoring solutions. I thrive in dynamic tech environments and enjoy solving complex problems with creative and collaborative approaches. My goal is to leverage my expertise and passion for data engineering to create value for my company and its users.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.