Naveen Reddy S.
Data Engineering Specialist @Fannie Mae
Signup · Get unlimited contacts
WORK HISTORY
Data Engineering Specialist @Fannie Mae
Dallas, TX, US
As a Lead and Senior Data Engineering Specialist, I bring over a decade of expertise and span solution architecture, development, and strategic guidance across Azure, AWS, and GCP ecosystems. Core Technical Competencies•Programming & Scripting: Python, SQL, Scala, Java, Bash – for ETL development, pipeline automation, microservices, and orchestration scripting.•Data Processing Frameworks: Apache Spark (batch/streaming), Apache Flink, PySpark – enabling low-latency and distributed data processing.•ETL/ELT Tools: ADF, Glue, DBT, NiFi, Informatica, Hive, Talend – used for modernizing data movement across environments.•Data Warehousing: Snowflake, Redshift, BigQuery, Synapse – where I applied data modeling, partitioning, and query optimization techniques.•Data Lakes: Delta Lake, ADLS, AWS Lake Formation, GCP Storage – implemented with schema evolution and transactional consistency.•Streaming & Messaging: Kafka, Kinesis, Azure Event Hubs, Pub/Sub – for building real-time ingestion, enrichment, and analytics platforms.•API & Access Layer: Spring Boot, GraphQL, RESTful APIs, Apache Druid APIs – developed secure, performant data access layers.•Workflow Orchestration: Apache Airflow, Autosys, Cloud Composer – to manage dependencies, retries, alerts, and job tracking.•Containerization & DevOps: Docker, Kubernetes, Terraform, Git, Jenkins, Azure DevOps – ensuring CI/CD and infrastructure-as-code across environments.•Databases: PostgreSQL, MongoDB, MySQL, Cassandra, DynamoDB – used in conjunction with analytics pipelines or as integration sources.•Data Governance & Quality: Monte Carlo, Alation, Collibra – for enforcing lineage, cataloging, and anomaly detection across platforms.•Security & Compliance: Azure Key Vault, AWS KMS, IAM, SSL/TLS, RBAC – securing data, credentials, and service-level access across regions.•BI & Visualization: Tableau, Power BI – delivering reports, operational dashboards, and embedded analytics.
EDUCATION
Eastern Illinois University
Master of Science - MS, Computer Technology/Computer Systems Technology
ABOUT NAVEEN REDDY S.
Senior Data Engineer with over 13 years of experience designing and building scalable, cloud-native data pipelines and analytics platforms. I specialize in real-time streaming architectures, large-scale data processing frameworks, and modern lakehouse implementations across industries like finance, healthcare, and retail. I bring cross-cloud expertise with hands-on delivery across Azure, AWS, and GCP environments, complemented by deep fluency in big data technologies and data engineering best practices. A Decade of Mastery:With over 13 years of hands-on experience, I\'ve had the privilege of witnessing the evolution of data engineering firsthand. From the early days of ETL pipelines to today\'s cutting-edge data ecosystems, I\'ve embraced every challenge as an opportunity to learn, adapt, and excel. Technical Expertise:• Azure Cloud: Skilled in developing data pipelines using Azure Data Factory, Azure Synapse, Azure Databricks, ADLS, and Cosmos DB. Experienced in CI/CD automation using Azure DevOps and infrastructure provisioning with Terraform and ARM templates.• AWS Cloud: Proficient in AWS services including EMR, S3, Lambda, Glue, Athena, Redshift, DynamoDB, and Kinesis. Built serverless data pipelines, implemented cataloging strategies, and enabled real-time data ingestion workflows.• GCP Cloud: Hands-on experience with Google BigQuery, DataFlow, and Pub/Sub. Migrated on-prem workloads to GCP using DBT, Apache Airflow, and Python automation frameworks.• Big Data Technologies: Deep expertise in the Hadoop ecosystem (HDFS, Hive, Impala, Sqoop, Oozie, Kafka, NiFi, HBase) and Spark (Core, SQL, Streaming, MLlib). Proven success in building batch and streaming pipelines at scale, implementing schema evolution, partitioning strategies, and performance tuning for distributed data systems.• Data APIs & Access: Designed and deployed RESTful and GraphQL APIs on top of Druid, Delta Lake, and Snowflake for time-series analytics and interactive reporting.• DevOps & Orchestration: Delivered automated infrastructure and deployment pipelines using Terraform, Kubernetes, Jenkins, and Airflow. Experienced in building resilient and observable data workflows with Autosys and Databricks Workflows.🤝 Let\'s Connect:I\'m excited to connect with fellow professionals who share a passion for data excellence. Whether you\'re exploring new opportunities, seeking insights, or simply interested in discussing data strategies, I\'m here to engage in meaningful conversations.Thank you for visiting my profile, and I look forward to connecting with you!
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.