Ajay Varma

About Ajay Varma

I\'m a hands-on Data Engineer with solid experience working with data pipelines, ETL processes, and data infrastructure. I focus on using tools and languages like Python, R, Scala, Java, and SQL to solve real data problems and support analytics, reporting, and machine learning.My daily work includes writing clean, efficient code to process large volumes of data, building workflows that move and transform data across systems, and making sure the data is accurate, reliable, and ready for use by analysts and data scientists.What I DoBuild Data Pipelines: I use Python, Scala, and Java to build and manage ETL/ELT pipelines that handle data from various sources — APIs, databases, flat files, and streaming platforms like Kafka.Work with Big Data Tools: I use Apache Spark (with Scala or PySpark) to process large datasets in distributed environments. I’ve also worked with Hadoop, Hive, and other big data tools.Write SQL Every Day: I write complex SQL queries to extract, join, clean, and analyze data from relational databases like PostgreSQL, MySQL, SQL Server, and data warehouses like Snowflake or BigQuery.Data Cleaning and Analysis: I use R and Python (with Pandas, NumPy) to clean data, explore datasets, and support data science teams with ready-to-use data.Automate Workflows: I use tools like Apache Airflow and cron jobs to automate data workflows and schedule jobs that run daily, hourly, or in real-time.Cloud and DevOps: I’ve deployed pipelines on AWS, Azure, and GCP. I’m comfortable using Docker, Git, and setting up CI/CD pipelines for testing and deploying code.Tools & Tech I UseLanguages: Python, R, Scala, Java, SQLBig Data Tools: Spark, Kafka, Hadoop, HiveDatabases: PostgreSQL, MySQL, SQL Server, Snowflake, BigQueryWorkflow Orchestration: Apache Airflow, LuigiCloud: AzureDevOps Tools: Git, Docker, JenkinsOther Tools: Pandas, NumPy, PySpark, RStudio, Jupyter, VS CodeMy ApproachI’m practical and solution-focused. I don’t over-engineer—I look for the simplest, most effective way to solve a problem. I test my code, document my work, and make sure what I build can be reused and maintained easily.Recent Hands-On ProjectsBuilt a Spark-based pipeline using Scala to process and aggregate web traffic logs for analytics. Output was pushed to Redshift for business reporting.Created an ETL job in Python that pulled data from an API, transformed it using Pandas, and loaded it into PostgreSQL.Used R scripts to validate healthcare data and produce reports for data quality tracking.

Experience

1. Sr Data Engineer

   Apple

   Jan 2026 — Present · Hyderabad, IN

Education

• Kakatiya University, Warangal

  Bachelor's degree, Computer Science