Diku Sherpa

About Diku Sherpa

Experienced data professional with a proven track record in architecting and optimizing robust data ecosystems. Proficient in diverse programming languages, big data technologies, and cloud platforms. Skilled in ETL pipeline development, real-time analytics, and data modeling. Adept at driving data-driven insights through advanced analysis and visualization techniques. Collaborative team player with expertise in enhancing user experiences through dynamic web applications. Strong commitment to data security, compliance, and ethical data handling. Continuously exploring emerging technologies to innovate and elevate data workflows. Experienced data architect skilled in ETL pipelines, real-time analytics, and data modeling. Proficient in Python, Java, big data technologies, and cloud platforms. Committed to driving insights through analysis and visualization. Strong collaborator, dedicated to data security and compliance. Passionate about enhancing user experiences and exploring new technologies for innovation.

Experience

1. Data Engineer

   Citi

   Jan 2022 — Present · NY, US

   Crafted intricate data models for efficient storage and retrieval, leveraging SQL and NoSQL databases, enhancing analysis capabilities. • Employ Kafka and Spark Streaming for instant insights from data streams, using Python and Scala programming for effective processing.• Utilize AWS and Azure to manage and process data at scale, utilizing cloud services like S3 and Azure Data Factory.• Incorporate ML models into analytics workflows by Python and R, supporting predictive and prescriptive analysis.• Maintain data quality and compliance, implementing policies operating tools like Collibra and Alation for efficient data stewardship.• Safeguard ethical data handling, protecting privacy and trust through anonymization techniques and compliance with data regulations.• Establish and execute automated pipelines with Airflow, harnessing Python and SQL for seamless data extraction and transformation.• Developed impactful visuals using Power BI and Tableau, incorporating data storytelling to convey insights to diverse audiences. • Collaborate on data security, employing cryptography and network protocols for data protection and threat detection.• Utilize statistical tools and Python\'s scikit-learn for forecasting, contributing to informed decision making and strategy development. • Translate complex data into actionable insights, apply visualization tools and narrative techniques for effective communication.• Provide data catalogs like Alation and Collibra, enhancing data discovery and accessibility for self-service analytics.• Interact with various teams, applying technical proficiency and communication skills to drive interdisciplinary insights and informed decisions.

Education

• City Tech, CUNY

  Bachelor's degree