Lalitha N
Azure Engineer @ Gathi Analytics | Data Analysis, SQL
- Role
- Azure Data Engineer at Gathi Analytics, An Apexon Company
- Location
- Arlington, TX, US
- LinkedIn followers
- 500 followers
About Lalitha N
With over nine years of experience in data engineering, I am passionate about…
Experience
Azure Data Engineer
Gathi Analytics, An Apexon Company
Apr 2022 — Present · Plano, TX, US
Implemented data ingestion pipelines using Apache Airflow and Kafka, optimizing data flow and storage.• Managed AWS S3 data storage, ensuring secure and efficient data accessibility for analytics.• Developed and maintained AWS Glue jobs for data transformation, preparing data for analysis.• Configured AWS EMR clusters for scalable data processing, enhancing computing resources dynamically.• Utilized AWS DynamoDB for high-performance, scalable NoSQL data storage solutions.• Orchestrated infrastructure as code (IaC) using Terraform, improving deployment efficiency.• Deployed containerized applications using AWS ECS and Docker, ensuring seamless environment consistency.• Integrated Apache NiFi for data routing, transformation, and system mediation logic.• Leveraged Databricks for big data analytics and machine learning model development.• Managed MLflow for machine learning lifecycle, including experimentation, reproducibility, and deployment.• Employed Python and SQL for data scripting and manipulation, addressing complex data challenges.• Utilized Git for version control, facilitating collaborative development and code management.• Applied Agile methodologies to enhance project delivery speed and adaptability.• Designed and implemented data quality frameworks to ensure accuracy and reliability.• Automated data pipeline testing, reducing errors and increasing reliability.• Collaborated with cross-functional teams to identify data needs and deliver comprehensive solutions.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.