Lavanya Thotakura
Data Engineer | SQL | Python | Spark | AWS | Scala | Azure | Hadoop | Teradata | GitHub | HDFS | Map Reduce ||
- Role
- Senior Data Engineer at FIS
- Location
- Milwaukee, WI, US
- LinkedIn followers
- 500 followers
About Lavanya Thotakura
As a passionate Data Engineer, I specialize in designing, building, and optimizing…
Experience
Senior Data Engineer
Feb 2023 — Present · US
Designed and developed efficient ETL/ELT data pipelines using Python, AWS Glue, and various cloud-based tools to ingest, transform, and load data into the data warehouse. Leveraged AWS services such as Amazon S3, Redshift, AWS Lambda, Amazon EMR, and AWS Glue to build and maintain scalable cloud-based data architectures. Integrated structured, semi-structured, and unstructured data from multiple sources using tools like Apache Kafka and Apache Airflow, ensuring smooth data flow and synchronization. Developed and implemented data transformation logic in Python to ensure the availability of high-quality data for analysis and reporting.Built and maintained real-time streaming data pipelines using AWS Kinesis, Apache Kafka, and Apache Spark to handle high-volume transactional data. Optimized data models in cloud-based data warehouses like Amazon Redshift and Snowflake, ensuring efficient storage and processing of large datasets. Automated data pipelines and job scheduling with Apache Airflow, AWS Step Functions, and Terraform, ensuring reliability and fault tolerance. Ensured compliance with security protocols, implemented data pipeline monitoring using AWS CloudWatch, and developed data quality checks using Python. Worked on metadata management and documentation to ensure maintainability and knowledge sharing.
Education
Western Illinois University
Masters of Science
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.