Siddharth Nautiyal

About Siddharth Nautiyal

Results-driven versatile software engineer with around 8 years of experience in data engineering and backend development across diverse domains, including Finance, Hospitality, Power & Energy, Sports, and Retail. Skilled in utilizing Python, Pandas, SQL, Spark, Scala, Apache Nifi, Informatica Cloud, Data Warehouse, SQOOP, AWS, Azure, Docker, and Kubernetes to deliver robust solutions.Key Competencies- Data Engineering: Proven expertise in designing and implementing scalable data pipelines and workflows. Proficient in Apache Nifi, Informatica Cloud, and other integration tools for efficient data extraction, transformation, and loading- Python and Data Manipulation: Adept in Python programming and leveraging Pandas library for effective data cleansing, transformation, and analysis- SQL and Database Management: Strong understanding of SQL and relational databases, with a focus on query optimization, data modeling, and performance tuning. Well-versed in data warehousing concepts and best practices- Big Data Technologies: Extensive knowledge of Spark and Scala for processing large-scale datasets, enabling efficient data analytics and machine learning- Cloud Platforms: Experienced in leveraging Amazon Web Services (AWS) and Microsoft Azure. Proficient in AWS services such as Redshift, Redshift Spectrum, Athena, S3, EMR, Lambda, Datapipeline, DMS, CloudWatch, Step Function, and EC2. Familiar with Azure services like Azure Data Factory, Azure DataBricks, and Azure Synapse- Containerization and Orchestration: Skilled in utilizing Docker for containerization and Kubernetes for managing containerized applications, ensuring seamless deployment and scalability- Version Control: Proficient in Git and Bitbucket for collaborative software development, ensuring code integrity and version management.Throughout my career, I have consistently delivered high-quality solutions, optimizing data workflows, and driving impactful insights. I thrive in dynamic environments and excel in collaborating with cross-functional teams to tackle complex challenges and deliver innovative solutions. With a demonstrated track record of successful project deliveries, I am eager to contribute my expertise to empower organizations in their data-driven decision-making processes.Industries: Having worked in Finance, Hospitality, Power & Energy, Sports, and Retail domains, I possess a deep understanding of industry-specific challenges and requirements, enabling me to deliver tailored solutions that meet business objectives.

Experience

1. Principal Consultant

   StatusNeo

   Mar 2025 — Present · Gurugram, IN

   DNA Platform (Hospitality):• Leading a team of Data, AI & Analytics Engineers to design and deliver scalable data solutions.• Driving the end-to-end implementation of the Medallion Architecture on Microsoft Fabric.• Integrated diverse data sources (Opera APIs, ReviewPro APIs, SFTP, and on-premise systems) using Fabric notebooks and pipelines.• Deployed Direct Lake for Power BI, reducing dashboard load times from 1+ minute to under 10 seconds, significantly improving stakeholder experience.• Implemented Microsoft Fabric Data Agent, enabling business users and CXOs to “talk to the data” and instantly derive insights.• Established RBAC and workspace-level access controls to ensure data security and compliance.• Automated data ingestion and transformation pipelines, improving reliability and reducing manual effort.• Enhanced decision-making for stakeholders through real-time, AI-assisted analytics and self-service reporting.Data Analytics Platform (Betting):• Developed a generic data source integration framework using PySpark/Python on Databricks to ingest data from multiple sources, including Salesforce and RDBMS.• Designed and implemented a scalable framework for generically processing Facts and Dimensions, deployed on Databricks.• Implemented SCD Type 1 & Type 2 handling for Dimensions to ensure accurate historical and real-time data tracking.P&L Automation (Telecom):• Led a team to automate the P&L model for the company using Alteryx and PowerBI.• Implemented workflows and complex transformations using Crew Macros.

Education

• Dr. A.P.J. Abdul Kalam Technical University

  Bachelor's degree, Computer Science

Skills

• Java Enterprise Edition
• Aws Redshift
• Microsoft Office
• Sql
• Cascading Style Sheets (Css)
• Informatica Cloud
• Android Development
• Html5
• Aws Data Pipeline
• Java
• Data Warehousing
• Aws S3
• Java Database Connectivity (Jdbc)
• Core Java
• Javaserver Pages (Jsp)