Venkatarao B

About Venkatarao B

worked as a Senior Data Engineer on a complex data project with billions of assets under…

Experience

1. Sr Analyst Data Engineer

   DXC Technology

   Apr 2024 — Present

   am working as a Sr Analyst and Data engineer as Azure Data engineer and Azure Data Bricks and Azure pyspark and Python and SQL Developer ( ADF,ABS, PYSPARK,PYTHON,SQL ) Hands on experience with ADF in • Created data transfer pipelines between Azure services and on-premises systems• Developed and maintained stored procedures, views, and functions in SQL server to optimize data extract, transform and load (ETL)• Build mount point to access S3 blob storage files• Using python build Machine Learning Models (Linear Regression, Logistic Regression, Random Forest, Decision Tree)• Build Azure Data Bricks Notebooks to extract the data from source to staging and staging to target• Applied performance optimization techniques Coalesce, repartition, Sort-Merge, BroadCast Join, Persist and Cache• Applied transformations like filter, sort, map, flatmap, reduceByKey, GroupByKey while data to target from source using PySpark• Used Dataware Schema like Snowflake, Star Schema’s• Involved in Data Science models to predict the transactions• Validated data from source to staging and staging to target• Used python libraries pandas, numpy, regular expression for Exploratory Data AnalysisSkills: Azure Data Factory(ADF), Azure Data Bricks(ABS), Pyspark, Python, SQL.

Education

• Jntu kakinada

  B.tech