Find Unlimited Emails.For Free.
Discover prospects, find their business emails, and build your pipeline with Unifers.
Start for FreeMeghana Karre
Data Engineer @State Street
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @State Street
TX, US
Optimized end-to-end batch processing by 48% by leveraging Spark Structured Streaming with AQE on Azure Databricks, reducing operational costs in treasury data reporting. Maintained 99% data availability SLA for regulatory and risk reporting pipelines, ensuring audit-readiness for SOX, PCI DSS and FFIEC compliance across investment banking platforms. Architected and deployed low-latency, fault-tolerant data pipelines using Apache Kafka, Spark Structured Streaming and Snowflake, enabling real-time ingestion of high-volume financial transactions. Designed KYC/AML data pipelines utilizing Data Vault 2.0 architecture with Erwin Data Modeler, supporting regulatory reporting for BSA, FATCA and OFAC compliance frameworks. Developed modular ETL/ELT pipelines using Apache Airflow, dbt and SQLAlchemy to automate ingestion from SWIFT, FIX and ISO 20022 feeds, improving reconciliation processes for capital markets data. Integrated Apache NiFi with ADLS Gen2 to enable real-time ingestion of multi-source retail and commercial banking data for fraud detection and transaction monitoring. Implemented robust data governance and security frameworks by enforcing RBAC, fine grained encryption and generating audit-ready artifacts to maintain compliance with SOX, GDPR, GLBA and CCPA. Executed phased migration of legacy Oracle ETL frameworks to Azure Synapse Analytics, achieving a 35% improvement in query execution times and reducing technical debt in enterprise data warehouses. Developed Kafka Connect pipelines to stream real-time transactional updates from core banking systems to downstream analytics platforms for risk and liquidity monitoring. Built enterprise-wide data lineage and metadata management frameworks using Collibra and Apache Atlas, enhancing data traceability, lineage visualization and ensuring regulatory audit readiness. Integrated Apache Flink CEP to process high-frequency trading event streams, enabling real time fraud detection and alert generation for AML workflows.
EDUCATION
Malla Reddy Engineering College for Women
Bachelor of Technology, Information Technology
Narayana Junior College
Intermediate, MPC
University of North Texas
Master of Science - MS, Information Technology
ABOUT MEGHANA KARRE
3+ years of experience as a Data Engineer specializing in architecting, optimizing and deploying robust, fault-tolerant data pipelines for high-volume, real-time financial and enterprise data. Proficient in Spark Structured Streaming, Apache Kafka, Snowflake, Azure Databricks, Azure Synapse Analytics and AWS services (S3, EMR, Lambda, EC2). Expertise includes ETL/ELT development with Apache Airflow, dbt and SQLAlchemy; implementing data governance, lineage and security frameworks using Collibra and Apache Atlas; and ensuring stringent regulatory compliance. Skilled in real-time data ingestion via Apache NiFi and Kafka Connect, leveraging Apache Flink CEP for complex event processing and fraud detection. Adept at data quality with Great Expectations, monitoring with Prometheus and Grafana and CI/CD automation with Jenkins and Docker. Experienced in developing recommendation engines using MLlib and Scikit-learn and delivering actionable insights through SQL and Power BI.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.