Vishnu Viswanathan

Principal Data Engineer @Schwarz Digits

Berlin, DE
MOBILE NUMBERS
+91 *********19

Signup · Get unlimited contacts

WORK HISTORY

Oct 2022 — Present

Principal Data Engineer @Schwarz Digits

View department →

DE

Strategic Architecture & Financial Impact* Designed an open-source, vendor-agnostic data architecture (e.g, Apache Iceberg and Kafka) focusing on Digital Sovereignty and minimizing vendor lock-in risks.* Eliminated vendor lock-in dependencies for proprietary data solutions with quantifiable annual cost savings of €500K and a 40% cost reduction for the group.Group Platform Leadership & Migration* Guided data engineering to create a vendor-agnostic Lake House and architected pipelines/frameworks for seamless migration to our cloud platform (STACKIT).* Developed a generic, replicable data processing template, creating a model for large-scale adaptation across group entities.* Deployed a system that provides Data and Analytics as a Service.Real-Time & Advanced Data Engineering* Translated batch data ingestion to near real-time via Kafka technologies.* Designed and deployed a schema- and partition-aware lakehouse system that optimizes for performance with compaction, retention, and deletion of orphan files.* Leverage Iceberg for data engineering, data science, and computer vision workloads.Edge AI & Computer Vision Innovation:* Developed efficiency solutions to enhance the retail sector by making computer vision efficient and cost-saving for small, medium, and large enterprises.* Came up with new customer experiences using computer vision.* Implemented a product category system for quick customer searches and a computer vision system for packaging anomaly detection to reduce product loss.Organisational Influence:* Served as a Technical Ambassador, speaking on behalf of the team at industry conferences (e.g, Confluent, Snowflake, BMW Streaming, SITCON).* Provided rich architecture guidance to local teams, establishing data governance and scalable accountability frameworks.

EDUCATION

N/A

Cochin University of Science and Technology

B-TECH, Computer Science and Engineering.

SKILLS

HadoopPuttyMapreduceCore JavaSqliteVbscriptAsp.netJiraIisHiveOozieCom+HbaseJquerySoftware DevelopmentAspBig DataJsonAmazon Web Services (Aws)ScalaTfsYuiApache SparkSEOMysqlObject-Oriented Programming (Oop)PhpDatabase DesignSql 2008/2005/2000Android SdkSqoopAgile MethodologiesCouchbaseJavascriptGitC#Redmine

ABOUT VISHNU VISWANATHAN

I focus on building data-driven business strategies, simplifying data pipelines, and developing sovereign lakehouse systems. My goal is to optimize costs, drive innovation in data and analytics services, and avoid vendor lock-in.As a data advocate, I have deep experience in ensuring that data is used ethically, accessibly, and effectively across an organization.My mission is to leverage data to empower business decisions, maintain our competitive edge, and foster data innovation in line with business strategy.I have successfully reduced churn, improved efficiency, and generated significant annual revenue by optimizing data pipelines, reducing vendor lock-in, and building platform-agnostic lakehouses.

This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.

Vishnu Viswanathan — Principal Data Engineer at Schwarz Digits in Berlin, DE | Unifers