Venkat Uppara
Data Engineer | AWS | Big Data | Cloud Technologies | Java | Python | Azure | Snowflake| Linux | Jenkins | Jira | Maven | Data Warehousing Expert
- Role
- Sr Lead Data Engineer at Tata Consultancy Services
- Location
- Seattle, WA, US
- LinkedIn followers
- 500 followers
About Venkat Uppara
Highly accomplished and results-driven Sr. Data Engineer with over 12+ years of expertise in Snowflake cloud data warehouse, Big Data Technologies, Multi-Cloud Technologies, and Data Engineering. Proficient in AWS services (EC2, S3, Lambda, RDS) and well-versed in other AWS services. Familiar with Azure Storage, Synapse, ADF, Fivetran, and dbt, with a strong understanding of Cloud Computing Strategies. Expert in Snowflake Data Warehouse, specializing in Architecture, migration, Snow pipes, snow tasks & Streams implementation. Strong understanding of the Spark ecosystem (Core, SQL, Streaming) and optimization techniques, with a focus on loading data into Snowflake using Spark SQL and Data Frames API. Experienced in utilizing Hadoop, Spark, Hive, Sqoop, Kafka, PySpark, and Zookeeper for Big Data projects, along with proficiency in Java, Scala, Python, Shell Scripting, and JavaScript. Skilled in working with various databases, including Oracle, MySQL, SQL, NoSQL, and Cassandra, as well as Tableau for data visualization. Proven abilities in cloud technologies, AWS (EC2, S3, Lambda, RDS, VPC, IAM, CloudFront, CloudWatch, SNS, SES, SQS), and Azure (Azure Storage, Azure Synapse, ADF, Azure Data Bricks). Certified in AWS Certified Solutions Architect Associate, Snowflake Pro Core & Advanced Data Engineer Certification, and Azure Data Engineer Certified Associate. Master of Computer Application (MCA) from BMS Institute of Technology, Bangalore, India. Looking to collaborate on challenging projects that leverage cutting-edge technologies in data engineering and cloud computing. Open to connecting with professionals in the field and exploring new opportunities. Let\'s connect and discuss how we can drive impactful data-driven solutions! Louisville, Kentucky USA |+14•••••••31 | r••••••••@gmail.com | GitHub: https://github.com/venkat-uppara #DataEngineer #CloudDataWarehouse #BigDataTechnologies #AWSExpert #SnowflakeSpecialist #AzureDataEngineering
Experience
Sr Lead Data Engineer
May 2023 — Present · US
Developing Spark code in Python for PySpark and Spark-SQL, accelerating data testing and processing while analyzing requirements and implementing data models using data warehouse concepts. Conceptualizing the in-memory computing capabilities of Snow SQLfor advanced text analytics and processing along with creating views and storing procedures to facilitate efficient dataloading into Snowflake. Inputted data from SQL Server into Snowflake using Fivetran, fixed a seamlessconnection, and built pipelines to ingest data from sources using Spark and ADF. Participating in daily Scrum meetings, contributing to development progressand enhancing meeting productivity. Identified obstacles and challenges faced by the team during the migration of the current system to Hadoop by providing insightful recommendations and suggested appropriate technologies and frameworks. Engineered a highly efficient CI/CD pipeline by creating Jenkins jobs and implementing Ansiblescripts, resulting in a 40% reduction in deployment time and ensuring seamless and error-free software releases. Enabled efficient and secure data storage and retrieval while leveraging Tableau toextract insights and visualize data from Snowflake. Enabled stakeholders to make informed decisions based on data-driven insights. Wrote Python code to implement AWS Lambda functions, leveraged serverlesscomputing for efficient and scalable execution of code in response to specific events, and improved overall systemperformance & resource utilization. Authored crawlers to seamlessly move data from S3 to Glue catalog tables,constructed an efficient data integration and organization. Streamlined AWS Glue jobs for the extraction, transformation, and loading (ETL) of on-premises data into the target system and maintained data accuracy, reliability, and consistency throughout the ETLprocess. Managed a team of more than 5 members, provided guidance and mentorship ensuring theteam\'s productivity and success.
Education
BMS Institute Of Technology Management
Master of Computer Applications (MCA), Computer Science, A
2006 — 2009
BMSIT
MCA
2006 — 2009
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.