Niroj K

About Niroj K

Data Engineer and Software Development Engineer with experience building scalable data pipelines, backend systems, and analytics solutions. Bachelor’s degree in Computer Science with a minor in Business Administration from The City University of New York.Hands-on experience with Python, SQL, PySpark, Pandas, Spark, and ETL/ELT development across AWS and Azure environments. Worked with modern data platforms including Databricks, Snowflake, Airflow, Hadoop, and Hive to support data processing, analytics, and reporting.Strong software engineering background using Java, C++, JavaScript, REST APIs, and system design, with practical exposure to HTML, CSS, React, Git, Docker, and cloud-based workflows

Experience

1. Engineering Fellow

   Ace Agency

   Oct 2025 — Present · New York, NY, US

   Worked as a Data Engineering Fellow responsible for designing, building, and maintaining scalable data pipelines and cloud-based data workflows. Focused on processing structured and semi-structured data, implementing analytics-ready data architectures, and supporting downstream reporting and business use cases across AWS and Azure environments.Key Responsibilities• Designed and implemented end-to-end ETL/ELT pipelines using Python, SQL, and PySpark for structured and semi-structured datasets.• Built robust data ingestion frameworks from APIs and event-driven sources, integrating data into cloud storage and data lake environments.• Implemented Bronze–Silver–Gold data architecture to standardize raw data, apply transformations, and deliver analytics-ready datasets.• Developed and optimized SQL-based data models in Snowflake and relational databases to support reporting and analytics.• Performed data transformation, validation, and quality checks using Python libraries such as Pandas and PySpark.• Worked across AWS and Azure services including S3, Glue, Lambda, Azure Data Factory, and Azure Data Lake.• Supported event-driven and real-time data processing workflows using Apache Kafka and Spark-based processing.• Collaborated in an Agile environment, using Git and CI/CD pipelines through Azure DevOps for version control and deployment.

Education

• The City University of New York

  Bachelor of Science, Computer Science