Nishitha V.

About Nishitha V.

I build data platforms that actually work — pipelines that don\'t break at 3 am…

Experience

1. Senior Data Engineer

   Capital One

   Mar 2025 — Present · Richmond, VA, US

   Column-level lineage for Python/Dask (filters, joins, aggregations, derivations) covering 1,200+ datasets /~85k columns; impact analysis is less than 60s (vs hours).• DQ gates (Great Expectations/Deequ): auto-generated tests, deploy blockers on failure, owner routing; DQ pass +33%, SLA 99.9%.• Serverless REST on AWS (API Gateway → Lambda → DynamoDB) for CRUD + complex, payload-driven queries; 30+ internal apps,~2.3M req/day, p95 < 200 ms; ad-hoc requests −58%.• Orchestrated retrieval & enrichment with Step Functions (Lambda + DynamoDB); idempotent retries, DLQs, circuit breakers → 99.9% reliability, MTTR −48%.• Scala microservices (notificationGenerator + monitors) scanning DynamoDB and triggering Lambda;~2.3M req/day, 99.9% availability; MTTD −92%(hours → minutes).• Unified Spark + Python lineage by operationalizing Spline and stitching to Dask; RCA time −70%.• Databricks → Tableau compliance across 120+ AWS accounts (CloudTrail/IAM); automated Slack/Email alerts; stale principals −58%(90d), revoke 7d → 6h, SOX closed 2 mo early,~$180k/yr saved.Stack: AWS (S3, Glue, EMR, Athena, Redshift, Lambda, Step Functions, DynamoDB, Lake Formation, IAM, CloudWatch), Databricks/Spark (PySpark, Delta), Dask, Spline, Tableau, Python, Scala, SQL.