Ziyo I.
Sr Data Engineer @Infosys
Signup · Get unlimited contacts
WORK HISTORY
Sr Data Engineer @Infosys
Designed and implemented scalable data migration solutions from legacy systems to Snowflake Cloud, leveraging advanced features for efficiency and performance.• Proficient in Snowflake utilities, including SnowSQL, SnowPipe, and administering Snowflake platforms for cost optimization and resource management.• Hands-on experience with Snowflake features such as CTEs, Window Functions, Time Travel, Streams, and Tasks.• Designed and maintained Snowflake database objects like tables, views, stages, stored procedures, and tasks.Configured SnowPipe for continuous data ingestion from S3 and ADLS Gen2, enabling real-time processing.• Migrated on-premises data into Snowflake using Azure Data Lake Storage Gen2 and S3 buckets, ensuring seamless scalability.• Built and managed ETL pipelines in Azure Databricks, utilizing PySpark for data extraction, transformation, and loading from multiple sources into Snowflake or Delta Lake.• Developed and optimized Delta Lake solutions in Databricks for incremental data loads, ensuring consistency and efficient querying.• Created and managed Databricks notebooks with PySpark and Spark-SQL for advanced transformations and aggregations on datasets in formats like CSV, JSON, and Parquet.• Orchestrated end-to-end ETL pipelines in ADF with Triggers and self-hosted integration runtimes for seamless on-premises connectivity.• Implemented error handling, logging, and monitoring in both ADF and Databricks pipelines, ensuring robust and reliable workflows.• Performed advanced SQL performance tuning, optimizing indexes and rewriting complex queries to improve database performance.• Proficient in PySpark scripting and Spark-SQL for processing structured and semi-structured data formats like JSON, Parquet, and Avro across distributed systems.• Automated ETL workflows in Databricks with job scheduling, partitioning, and parallel processing, enhancing scalability and efficiency.
EDUCATION
Yale University
Certificate, Financial Markets
Université Toulouse 1 Capitole
Master's degree
Cornell University
Certificate, AI Strategy
ABOUT ZIYO I.
Certified Data Engineer with over 10 years of experience in cloud data platforms, data warehousing, data lakehouse architecture, data modeling, and ETL/ELT pipeline development. Proven ability to design, build, and optimize scalable, high-performance data solutions using Snowflake Cloud, Azure Data Factory, Databricks, and Matillion ETL, enabling actionable business intelligence and advanced analytics across enterprise environments.Core Competencies: Cloud Data Engineering & Big Data Analytics: Hands-on expertise in Snowflake, Azure Synapse Analytics, ADF, Azure Data Lake (ADLS), Databricks (Delta Lake, Delta Live Tables, Structured Streaming), and Azure Function Apps for building and managing large-scale distributed data workflows. ETL/ELT & Data Pipeline Development: Proficient in Matillion ETL, SSIS, ADF, Databricks, PySpark, and SparkSQL, with deep experience implementing Slowly Changing Dimensions (SCD Types 1 & 2) and managing data transformations across hybrid cloud architectures. Advanced SQL & Programming: Skilled in T-SQL, PL/SQL, Python (Pandas, PySpark), and complex SQL performance tuning to optimize query execution, support BI dashboards, and improve data accuracy and integrity. Automation & CI/CD Pipelines: Strong knowledge of Azure DevOps, GitHub, Git, CI/CD automation, and Infrastructure as Code (IaC) for repeatable, secure, and auditable deployment processes. Familiar with RPA tools for task automation. Multi-Cloud & AI Integration: Practical experience with multi-cloud platforms (Azure, AWS, Snowflake) and AI/ML integrations, including GenAI for intelligent data classification and automation.Certifications: Snowflake SnowPro Advanced: Data Engineer | SnowPro Core Databricks Certified Data Engineer – Professional & Associate | Apache Spark Developer Microsoft Certified: Azure Data Engineer, Fabric Analytics Engineer, AI Engineer Associate AWS Certified Data Engineer
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.