Sandeep Kumar Lingampally
Data Engineer | Data Scientist | Data Analyst | SQL & Python Expert | ETL | Power BI & Tableau | Machine Learning | Cloud (AWS/Azure/GCP)
- Role
- Senior Data Engineer at TD
- Location
- Edison, NJ, US
- LinkedIn followers
- 500 followers
About Sandeep Kumar Lingampally
Senior Data Engineer with 8+ years of experience in Ab Initio ETL Development, Graph…
Experience
Senior Data Engineer
May 2024 — Present
Designed scalable data pipelines on Azure Data Factory & Databricks, processing 10TB+ daily transactions with Delta Lake optimizations, reducing costs by $1.2M/year via FinOps-driven cloud spend optimization.Built real-time fraud detection using Azure Event Hubs (Kafka API) & Databricks Streaming, cutting false positives while monitoring ATM/digital transactions via Power BI dashboards.Migrated legacy SAS/DB2 ETL to Azure Synapse, slashing costs with serverless SQL pools and dedicated compute, while enforcing data quality (Great Expectations) and GDPR/SOX compliancevia Azure Purview.Developed credit risk & CLV models in Azure ML (Python, Prophet, AutoML), improving default prediction accuracy and marketing campaign ROI.Automated transaction log ingestion from branches using ADF + self-hosted IR, and vendor data onboarding via Logic Apps, reducing manual effort by 80%.Optimized Spark jobs in Databricks via dynamic partition pruning & auto-scaling, accelerating customer segmentation and handling Black Friday surges with HDInsight scaling.Designed star-schema data models in Synapse for enterprise warehousing and Python UDFs for Customer 360° analytics, enabling cross-functional insights.Implemented CI/CD for pipelines with Azure DevOps and secured PII/PCI data using Defender for Cloud, ensuring Basel compliance while mentoring 5 engineers on Databricks best practices.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.