Rahul Reddy Etikala

Senior Data Engineer @AgFirst Farm Credit Bank

Columbia, SC, US

As a Senior Data Engineer at AgFirst, I design and implement scalable ELT pipelines using AWS Glue, AWS Step Functions, and Apache Airflow, enabling efficient data processing and orchestration. I build robust OLTP and OLAP solutions on Amazon RDS, Redshift, and DynamoDB, optimizing query performance and ensuring seamless data retrieval. I develop feature engineering pipelines for machine learning applications using Apache Spark, Hudi, AWS EMR, and Databricks, supporting predictive analytics and model training. I also integrate AWS Kinesis for real-time data streaming, enhancing the agility of event-driven data architectures. My role involves maintaining metadata management and data lineage using AWS Glue Data Catalog and implementing governance with AWS Lake Formation. Additionally, I automate infrastructure provisioning and CI/CD workflows using AWS CloudFormation, CodePipeline, CodeBuild, Docker, and Kubernetes to streamline deployment and scalability. I also build interactive Tableau dashboards to visualize complex datasets and provide actionable insights for business stakeholders while collaborating with cross-functional Agile teams using JIRA for effective project coordination.