Ananthakrishnan K.

WORK HISTORY

EDUCATION

ABOUT ANANTHAKRISHNAN K.

Senior software/Data Engineer with over a decade of experience in Big Data, Apache Spark, and Core Java, specializing in designing and implementing data-intensive, high-performance, and scalable data processing systems for banking and capital markets. Experienced in building end-to-end data platforms that ingest, transform, and process large volumes of data from diverse sources using open-source frameworks, and efficiently store them in distributed environments. Proven ability to develop distributed data pipelines and processing solutions that deliver reliable results within strict SLA requirements. Strong background in distributed computing, cloud modernization, CI/CD automation, and secure enterprise-grade deployments.In my current role, I have modernized legacy Apache Spark Java workloads running on unmanaged clusters by migrating them to Apache PySpark on Azure Databricks, leveraging managed compute, autoscaling, and the latest Unity Catalog features for centralized governance, lineage, and secure data access. I have implemented GitHub Actions–based CI/CD pipelines using Azure Databricks Asset Bundles, enabling automated deployments and consistent environment promotion across Dev, Test, and Prod. I also integrated Service Principals for Test and Prod to ensure secure, identity‑based access aligned with enterprise standards.Previously at TD Securities, I improved performance and reliability by transforming complex Spring Batch workflows into optimized Spark‑based pipelines. I also worked extensively with Azure SQL, ADLS, and Apache Hive to support regulatory reporting, analytics, and large‑scale data processing needs.At RBC, I built Spark‑driven systems for time‑series reporting and market data analysis, enabling faster insights and supporting critical business decision‑making across trading and risk functions.Across all roles, I focus on designing systems that are scalable, maintainable, and aligned with business outcomes. I enjoy applying modern data technologies to solve real‑world problems and deliver measurable value for financial institutionsI focus on creating systems that are easy to scale and maintain. I enjoy using new technologies to solve real-world problems and deliver strong results for businesses.