Manikandan Ramkumar
Data Engineer @TD
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @TD
Toronto, ON, CA
GenAI Chatbot & Azure MigrationIngested 300+ multilingual web sources using BeautifulSoup, generated GPT-based embeddings, and indexed them into Azure AI SearchBuilt de-tokenization pipelines to convert LLM outputs into business-readable formatsAutomated data ingestion using TD’s Central Framework, reducing manual effort and improving consistencyDeveloped Pytest-based unit tests and implemented CI/CD using Jenkins, SonarQube, and NexusCoordinated ETL workflows using internal orchestration tools, enabling collaboration between Data Science and downstream teamsValidated data migration from EDPP to Azure using PySpark notebooks MyTD App Data Pipelines & Cloud Enablement (Hadoop → Azure)Built and optimized PySpark/Scala ETL pipelines powering MyTD app personalization featuresDelivered tokenized datasets from Hadoop to Azure to support Layer 6 model developmentPerformed data validation and RCA using Hive, Impala, and Spark SQLMigrated pipelines to Azure Data Factory, Databricks, and Spark-based architectureAutomated scheduling using AutoSys and Oozie; improved HDFS storage efficiency with custom Linux scriptsSupported multi-environment deployments (DEV/SIT/PAT/PROD) using ARM templatesCollaborated in Agile teams, contributed to JIRA stories, peer reviews, and cross-team planningWorked across structured/semi-structured formats (Parquet, Avro, JSON) Key Tools: Azure, Databricks, Spark, PySpark, Scala, ADF, Hive, CI/CD, BeautifulSoup, Azure AI Search, Jenkins, AutoSys, Oozie
EDUCATION
George Brown Polytechnic
PGDM, Network and System Security Analysis
Anna University Chennai
Bachelor of Engineering (B.E.), Electrical, Electronic and Communications Engineering Technology/Technician
Anna University Chennai
Bachelor's degree, Engineering
ABOUT MANIKANDAN RAMKUMAR
Manikandan is a ETL developer with experience working on Azure, SAP, Delta lakehouse,Databricks and Hadoop
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.