Sugyani Panigrahy

About Sugyani Panigrahy

Have over 10+ years of professionally Developed custom REST API connectors in Matillion to integrate proprietary healthcare data sources, enhancing data accessibility and automating manual data entry processes.• Used Matillion to extract, transform, and load data from various sources into target data warehouses or data lakes. Also, provided production support and resolved incident tickets for ETL processes built on Matillion, minimising downtime and ensuring data pipeline reliability Primary Skills Used: Cloud: AWS, GCP & Azure ‍ Databases: SQL Server, Redshift, BigQuery, Snowflake, RDS, PostgreSQL, MySQL, S3, DynamoDB, MongoDB, Cloud Data Store, Redshift Data Integration/ETL: Talend, Stitch, Informatica, SSIS, AWS Glue & EMR, Alteryx, GCP DataFlow & DataProc BI/Visualization: Tableau, PowerBI, Excel, Google Data Studio, AWS QuickSight,Looker, Azure Synapse Studio 🤖 Machine learning - Natural Language Processing, Jupyter Notebook, Python, TensorFlow, Pandas, Numpy, Pytorch, JS. Big Data Tools - PySpark,Hadoop, Hive,Databricks GCP Services: BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Cloud Composer, Cloud Functions, Cloud SQL, Cloud Spanner, GKE, Data Studio Microservices: Docker, Kubernetes, Infrastucture as code Scheduling Tools – Autosys, Airflow Version Control – Gitlab* 8+ years of experience in cloud native-data architectures, data integration, API-base data integration, ELT/ETL, batch, and real-time data processing.* Expertise in cloud design and architecture to deliver large-scale distributed solutions.* Proven leadership in cross-functional teams and fostering data-driven culture.* Extensive knowledge of data modeling, data governance, database design, data warehousing, ETL/ELT processes, and data technologies (e.g, Spark, relational and NoSQL databases, dbt).* Proficiency with data architecture tools and platforms (e.g, ERwin, Kafka, Redis) and familiarity with cloud data services.

Experience

1. Sr Azure Big Data Platform Engineer Matillion Database Developer

   Target Rwe

   Nov 2021 — Present · Phoenix, AZ, US

   Developed custom REST API connectors in Matillion to integrate proprietary healthcare data sources, enhancing data accessibility and automating manual data entry processes.• Used Matillion to extract, transform, and load data from various sources into target data warehouses or data lakes. Also, provided production support and resolved incident tickets for ETL processes built on Matillion, minimising downtime and ensuring data pipeline reliability• Automated the ETL Process using Matillion•Create and implement ETL workflows and pipelines based on business requirements, ensuring efficient extraction, transformation, and loading of data.•Orchestrated data workflows using Airflow DAGs, enabling automated daily, weekly, and monthly runs.•Ensure data accuracy, completeness, and integrity throughout the ETL process, including data validation and cleansing.• Designed and implemented end-to-end data pipelines on AWS, ingesting data from multiple sources into Amazon S3-based data lakes.• Developed scalable ETL/ELT workflows using AWS Glue and Python, transforming raw data into curated datasets for analytics and reporting.•Demonstrated strong hands-on coding ability in Python for data extraction, transformation, and automation tasks, including the integration of multiple data sources and APIs.•Applied advanced data warehousing concepts and data modelling techniques (e.g, star/snowflake schemas, normalization/denormalization) to support analytics and reporting requirements in a high-compliance, regulated environment.

Education

• GIET University Gunupur

  Bachelor's degree, Electronics and Communications Engineering

  2009 — 2013

• Grand Canyon University

  Master of Science - MS, Master of Science in Business Analytics