Nithin G
Sr Azure/AWS Data Engineer| Compliance Tech | Trade Data | Big Data | ETL | Azure | Databricks | Python | Spark | SQL | C2C
- Role
- Senior Data Engineer at SMBC Group
- Location
- Jersey City, NJ, US
- LinkedIn followers
- 500 followers
About Nithin G
With a good years of IT Experience as a Software Engineer in development of business applications, Data warehousing, Database Design, Development in Retailing, Finance domain and Data engineering. • Worked on creating Pipelines, Linked Services, Mapping Data Flows, Activities (Data movement and data transform) and Datasets. • Hands-on experience in ERP, Azure Cloud, Azure Data Factory, Azure Data Lake Storage Gen2, Azure Synapse Analytics, Azure Analytical services and Data bricks. • Strong communication skills and Management skills. • Provided technical guidance and mentoring to newcomers and junior-level software engineers.
Experience
Senior Data Engineer
Nov 2024 — Present · US
Designed and implemented scalable batch data pipelines using Azure Data Factory, handling data ingestion from diverse sources such as SQL databases and flat files into Azure Data Lake Storage (ADLS).Automated data load processes using Azure Data Factory, reducing manual intervention by 80% and improving data processing efficiency for high-volume datasets.Implemented incremental data load strategies using watermarking and delta detection in Azure Data Factory, reducing processing time by 50% for recurring batch jobs.Monitored and optimized batch processing pipelines by integrating Azure Monitor and Log Analytics, enabling proactive issue detection and reducing downtime by 40%.Developed data models and workflows for trade surveillance systems, integrating historical trade data with market benchmarks to improve anomaly detection accuracy by 30%.Automated compliance reporting pipelines by leveraging Azure Data Factory and Azure Logic Apps, ensuring timely submission of regulatory reports and reducing manual effort by 40%.Enhanced data quality and governance frameworks by applying data validation, deduplication, and encryption techniques across ETL processes, ensuring the integrity and security of trade surveillance data.
Education
Vellore Institute of Technology
Bachelor's of Technology - BTech
2007 — 2011
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.