Arun Krishnan
Data Engineer @ Armada.ai | PySpark, Airflow, Postgres, Pipeline Architecture, Azure Databrick, Azure Synapse, Azure Fabric, AKS, ADLS Gen2
- Role
- Data Engineer at Armada
- Location
- Kollam, KL, IN
- LinkedIn followers
- 500 followers
About Arun Krishnan
As a Data Engineer at Turbolab Technologies, I leverage my expertise in PySpark, Dremio…
Experience
Data Engineer
Jun 2025 — Present · Trivandrum, IN
Designed and implemented a real-time data ingestion pipeline from PostgreSQL to Azure Synapse Analytics, leveraging Debezium for CDC log capture and Azure Event Hub for streaming data transport.Developed and deployed a Spark-based data processing application on Databricks to consume CDC data, transform it into Delta Lake format, and load it efficiently into Synapse Data Warehouse.Integrated and deployed an ML forecasting model on Azure Databricks, automating predictions and publishing results to a RESTful POST API for downstream consumption.Orchestrated complex data and ML pipelines using Apache Airflow, ensuring robust scheduling, monitoring, and error handling across end-to-end workflows.Deployed and managed on-premise tools like Debezium and Apache Airflow in Azure Kubernetes Service (AKS), enhancing scalability and maintainability of the data platform.Collaborated cross-functionally with Backend, AI/ML, Power BI, and Frontend teams to deliver integrated data solutions that drive business insights and product functionality.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.