Anu Katila
Data Engineer | ETL & Data Integration Professional | Proficient in AWS & Azure | Big Data Solutions | Real-time Data Management
- Role
- Data Engineer at Capital One
- Location
- Woodbridge, VA, US
- LinkedIn followers
- 500 followers
About Anu Katila
Experienced Data Engineer with a comprehensive background in harnessing big data…
Experience
Data Engineer
Mar 2021 — Present · McLean, VA, US
At Capital One, I crafted and implemented scalable cloud architectures using AWS and Azure services. By orchestrating platforms like EC2, S3, RDS, Lambda, Glue, and Redshift, I improved system performance by 25%. Additionally, I integrated Apache Spark with HDFS and Hive to optimize data processing, boosting speed for a financial analytics platform.• Integrated Spark with various data sources; optimized HDFS, Hive, and Spark SQL for better data processing and analytics.• Expert in AWS (EC2, S3, RDS, Lambda, Glue, Redshift) and Azure services for scalable solutions.• Led Kafka streaming pipeline development, focusing on topic/partition distribution and security protocols.• Optimized Hadoop ecosystem interactions for efficient data storage and retrieval.• Enhanced Hadoop cluster performance, ensuring high availability and seamless operations.• Designed and optimized Snowflake and Redshift data warehouses for efficient SQL querying.• Proficient in Python and SQL, with a focus on maintainability and complex query crafting.• Engineered real-time data solutions on Azure with Delta Table Streaming, Cosmos DB, MongoDB, and Databricks.• Managed Kafka-based ETL processes for downstream compatibility and compliance.• Enhanced Databricks and Spark capabilities through cross-functional collaboration.• Documented ETL processes and database designs for team efficiency.
Education
Washington University of Virginia
Master of Business Administration - MBA
Washington University of Virginia
Bachelor's degree
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.