Hruthik Reddy
Senior Data Engineer | Expert in SQL, AWS, Data Engineering, & Cloud Solutions | Driving Data-Driven Insights and Scalable Solutions
- Role
- Senior Data Engineer at SMBC Group
- Location
- Jersey City, NJ, US
- LinkedIn followers
- 500 followers
About Hruthik Reddy
Experienced Senior Data Engineer with over 9 years of expertise in big data technologies,…
Experience
Senior Data Engineer
Apr 2023 — Present · NJ, US
Implemented complex, highly scalable and reliable data pipelines using technologies like Data bricks, spark Kafka, Hive, Parquet, Avro• Implemented scalable data architecture on Snowflake, leveraging Azure cloud services for data storage and processing• Experienced in development using Cloudera distribution system.• As a Hadoop Developer my responsibility is managing the data pipelines and data lake.• Hands on coding - Write and test the code for the Ingest automation process - Full and Incremental Loads. Design the solution and develop the program for data ingestion using - Sqoop, map reduce, Shell script & python• Developed various automated scripts for DI (Data Ingestion) and DL (Data Loading) using pythonmap reduce.• Data Ingestion to one or more cloud Azure Services -(Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and cloud migration processing the data in in Azure Databricks• Imported documents into HDFS, HBase and creating HAR files.• Create and maintain optimal data pipeline architecture in cloud Microsoft Azure using Data Factory and Azure Databricks• Developed the application on Eclipse IDE• Experienced with pipeline orchestration tools to automate data flow like Azure Data Factory, Airflow• Experienced in Establishing and promoting high standards in DevOps, Security, CI/CD, Monitoring, data validation, and testing.• Implemented complex business logic through T-SQL stored procedures, Functions, Views, and advance query concepts.• Developed various T-SQL statements for retrieval of data and was involved in performance tuning of T-SQL queries and complex Procedures.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.