Surendra Kumar
Data Engineer | Python | PySpark | Kafka | Scala | SQL | NoSQL | Hive | HDFS | Airflow | Azure | Azure Databricks | Data Lake | Delta Lake | Azure Data Factory
- Role
- Data Engineer at GEP Worldwide
- Location
- New Delhi, DL, IN
- LinkedIn followers
- 500 followers
About Surendra Kumar
I have working experience in Python, PySpark, Airflow (Dag, BashOperator, PythonOperator, EmailOperator Sensors, SSHHook, and PostgresHook)- I have working experience with different databases and data storage systems like MYSQL, PostgreSQL, Hive, HDFS, Impala, Hue- I have implemented data pipelines for data migration, data upload, data visualization, and ETL purposes- I have worked closely with the team to dockerize the data pipeline using Docker, KubernetesPodOperator, and Airflow- I have experience with Big data migration and processing using PySpark- I have worked in translating business scenarios into design solutions- I have working experience with AzureBlobStorage, migrating the data from one container (dev) to another container (prod)- I have working experience in Distributed Version Control System Git- I have working experience with Jira, ServiceNow, Confluence, HPC, Harbor, Rancher, Putty, DBeaver, Jupyter notebook, Docker Desktop.
Experience
Data Engineer
Dec 2021 — Present · Navi Mumbai, IN
Education
GLA University
Bachelor of Technology - BTech
2014 — 2018
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.