Ankur Chopra
Senior Data Engineer @Nearform
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer @Nearform
Toronto, ON, CA
EDUCATION
Chatrapati Sahuji Maharaj Kanpur University, Kanpur
Master of Business Administration - MBA, Information Technology
ABOUT ANKUR CHOPRA
I’m a with 8+ years of experience building, migrating, and designing data platforms that businesses can actually rely on.I’ve worked with global companies like, —helping teams turn complex pipelines into stable, observable, and automated data systems. My core expertise - using Python, PySpark, & DBT🧊 → migration, monitoring, and automated data quality for near real-time data from on-prem to cloud with performance and cost in mind🤖 - that fix issues without manual interventionIf a pipeline fails, I don’t just patch it —. & : Python, PySpark, Spark SQL : Databricks, Delta Lake, Apache Iceberg, Snowflake, Redshift :(S3, Glue, Lambda, DMS, Step Functions),(ADF, ADL, Azure Functions), & : Kafka, Spark Structured Streaming, Debezium : Airflow, Databricks Workflows & : Hive, Trino, Oracle, PostgreSQL & : Deequ, Databricks DQX, Lakehouse Monitoring, Datadog, CloudWatch : GitHub Actions, Terraform I’m deeply interested in autonomous data engineering using AI agents. Some ideas I’m actively exploring:1⃣ - that detect failures, find root causes, and auto-fix pipelines2⃣ that learn normal data behavior and flag anomalies before users notice3⃣ that assist in moving data from legacy systems to lakehouse platforms4⃣ agents that tune Spark jobs and SQL automatically5⃣ that generate and maintain data lineage, diagrams, and runbooks : https://github.com/dataengineerankur : https://ankur-chopra-pt66lvt.gamma.site/
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.