Sujay M
Senior Data Engineer | 10+ Years in Data Pipeline Design & Implementation | Expert in Azure, AWS, Big Data, Snowflake, and ETL | Skilled in Data Warehousing, Streaming, & Cloud Migration
- Role
- Sr Data Engineer at BNY
- Location
- Woodbridge, NJ, US
- LinkedIn followers
- 500 followers
About Sujay M
With 5+years of experience, I design and implement data pipelines, cloud integrations…
Experience
Sr Data Engineer
Mar 2023 — Present · New York, NY, US
Collaborated with data analysts and business teams to gather fraud detection analytics requirements and derive insights via Agile methodologies.• Evaluated AWS tools for cost-effective, scalable machine learning infrastructure, assessing feasibility and risks.• Designed machine learning workflows for fraud detection using clustering and classification methods on AWS.• Built batch data pipelines with PySpark, Hive, and Hadoop on AWS EMR for large-scale data processing.• Developed Kafka to Amazon S3 streaming architecture for near real-time data ingestion and transformation.• Constructed Snowflake data warehouses using Star and Snowflake schemas with structured fact and dimension tables.• Utilized Databricks for scalable data engineering and collaborative machine learning development, integrating with Amazon S3, AWS Glue, and Snowflake for ETL and analytics.• Built interactive fraud detection dashboards using Tableau and Power BI, delivering key insights to business stakeholders by connecting to Snowflake and AWS Redshift.• Created visualizations in Power BI and Tableau to monitor ML model performance, pipeline health, and fraud trends, aiding real-time decision-making.• Built and deployed machine learning pipelines using TensorFlow, PyTorch, and Scikit-learn.• Migrated ETL processes from Oracle and Teradata to PySpark, optimizing performance on AWS.• Enabled automated data ingestion into Snowflake using Snowpipe and stages, supporting multiple data formats.• Integrated AWS services (S3, Lambda, SageMaker, EKS, etc.) to build end-to-end machine learning and data workflows.• Implemented PyTest for unit and integration testing of pipelines to ensure data accuracy and performance.• Conducted end-to-end pipeline testing to validate reliability and maintain data integrity at scale.• Automated model deployment using CI/CD pipelines with Lambda and Terraform for consistent delivery.
Education
KL University
Bachelor of Technology - BTech, Computer Science
Bay Atlantic University
Master's degree, Computer and Information Systems Security/Information Assurance
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.