Sai N

Experience

1. Lead Data Analyst

   Verizon

   Jan 2023 — Present · Irving, TX, US

   Experienced Data Engineer with expertise in building and architecting multiple data pipelines, end-to-end ETL/ELT processes, and large-scale data transformations. Proficient in AWS services (Glue, Lambda, S3, Athena, EMR), real-time data streaming (Kafka, Apache Spark), and serverless data processing. Designed and implemented OpenSearch for high-performance data retrieval and analytics. Built and optimized Databricks workflows using Spark SQL and Scala.Strong hands-on experience in data modeling, SQL-based transformations, and machine learning pipelines.Developed CI/CD pipelines using Jenkins and Terraform for automated deployments. Created and optimized AWS CloudFormation templates to automate cloud infrastructure, ensuring scalable and cost-effective solutions.Expert in Cloudera cluster setup, monitoring, and optimization, integrating with Hadoop, HDFS, and HBase. Applied security best practices using IAM, Apache Ranger, and Sentry. Designed and deployed scalable data models in Snowflake and utilized Snowpipe for efficient data ingestion.Developed and automated data workflows using Apache Airflow and integrated them with AWS and Snowflake. Built dashboards in Tableau and QuickSight, enabling real-time data visualization. Connected Athena to Tableau for interactive reporting and insights.Experienced in Python (PySpark, pandas, NumPy, SciPy), SQL, Scala, and big data processing. Worked on Kubernetes and Docker for auto-scaling and CI/CD integration. Proficient in Linux and shell scripting for automation.Mentored junior engineers, conducted code reviews, and enforced best practices in data engineering. Skilled in troubleshooting and optimizing distributed systems using APM tools like Dynatrace, New Relic, and AppDynamics.Dedicated to optimizing query performance, reducing data processing times, and enhancing system efficiency through advanced data engineering techniques. Passionate about delivering scalable, secure, and high-performance data solutions.