Ravisankar Vemireddy
Senior Data Engineer @Paystream
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer @Paystream
London, GB
Azure Databricks Expertise: Proven experience designing and implementing solutions on Azure Databricks, including cluster configuration, workspace management, and optimization for cost and performance. Ability to leverage Databricks features such as Delta Lake, Unity Catalog, and MLflow for data engineering workflows.Lakehouse Architecture Design: Hands-on experience building and optimizing Lakehouse architectures using Databricks. Skilled in designing partitioning strategies, indexing, and compaction for performance at scale.Hybrid Data Integration: Practical experience in integrating on-premises data sources with Azure-based platforms. Familiarity with secure connectivity patterns, data movement strategies, and performance considerations in hybrid environments.Streaming Data: Knowledge of implementing real-time pipelines in Databricks using Structured Streaming and integrating with Kafka or Event Hubs.Data Transformation & Lineage: Advanced skills in creating transformation pipelines using Databricks notebooks and Spark SQL. Experience implementing data lineage and observability within Databricks, leveraging tools such as Unity Catalog or integrating with external lineage solutions.Distributed Data Processing: Deep understanding of Apache Spark within Databricks, including optimisation techniques for large-scale batch and streaming workloads.SQL & Delta Lake: Strong SQL skills for data modelling and querying within Databricks, including experience with Delta Lake features like ACID transactions, schema enforcement, and time travel.Version Control & CI/CD: Familiarity with Git-based workflows and implementing CI/CD for Databricks using tools like Azure DevOps or GitHub Actions.Cloud Storage & Security: Expertise in Azure Data Lake Storage (ADLS Gen2) and integration with Databricks. Strong understanding of identity management, access control (e.g, Azure RBAC, Unity Catalog), and compliance in cloud environments.
EDUCATION
JNTUH College of Engineering Hyderabad
Bachelor of Technology - BTech, Information Technology
Visvesvaraya Technological University
Master of Technology - MTech, Computer Engineering
ABOUT RAVISANKAR VEMIREDDY
Software IT professional with 17+ years of experience working as a Data Engineer, Solution Architect, Data Architect, and Analytics Engineer, specializing in Azure Databricks, Azure Cloud Services, Python, Big Data/Hadoop, Spark, SQL, DBT, Snowflake, GitHub, Airflow, Jenkins, Azure DevOps, Tableau, PL/SQL, Informatica (DEI/9x), and Linux within Agile and full SDLC environments.Currently working as a Senior Data Engineer in design and implement Medallion Architecture–based data platforms using Azure Databricks, Azure Data Factory, and Apache Spark. I focus on building scalable, high-performance ETL/ELT pipelines, integrating structured and unstructured data from multiple sources, and supporting advanced analytics and machine learning initiatives.I have deep expertise in Delta Lake optimization, including performance tuning and table design strategies that enable real-time analytics, improved query performance, and efficient data processing at scale. My experience spans data modeling, orchestration, CI/CD for data workflows, and cloud-based analytics engineering.I am driven by delivering robust, enterprise-grade data solutions that empower organizations to make data-driven decisions, unlock meaningful insights, and accelerate business value.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.