Nidhi Raj Patel
Senior Data Engineer @IBM
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer @IBM
Bengaluru, IN
Led cloud‑native batch & real‑time pipelines for analytics, BI, and data warehousing.Built a modular framework (Python + Spark / PySpark) ingesting structured & unstructured data, including APIs.Deployed ADF pipelines to convert Excel/CSV/API data into Parquet for efficient Databricks (and transferrable to BigQuery/Dataflow).Automated hourly/daily data refreshes with orchestration aligned to Airflow/Cloud Composer.Delivered interactive dashboards (Power BI), with readiness for Looker/Data Studio.Engineered secure ingestion from NAS & external sources into object storage ensuring traceability & version control.Managed cross‑team delivery (data, dev, cloud) using Agile & DevOps tools (Azure DevOps / Git + CI/CD).Ensured data quality, observability, SLAs, lineage & audit readiness.
EDUCATION
Rajiv Gandhi Proudyogiki Vishwavidyalaya (RGPV), Bhopal
Bachelor of Engineering - BE
ABOUT NIDHI RAJ PATEL
Data Engineer with 7.5 years of experience designing and developing scalable data…
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.