Padmaja Nandanuru
Looking for New Opportunties as Sr. #DataEngineer #AWS #GCP #Azure
- Role
- Sr Data Engineer at Cambia Health Solutions
- Location
- Sanford, FL, US
- LinkedIn followers
- 500 followers
About Padmaja Nandanuru
9 years of IT industry knowledge with hands-on working experience in Data Engineering & …
Experience
Sr Data Engineer
Jul 2022 — Present · NY, US
Used Aws extensively for ingesting data from disparate source systems. Used Aws as an orchestration tool for integrating data from upstream to downstream systems. Automated jobs using different triggers (Event, Scheduled and Tumbling) in ADF. Used Cosmos DB for storing catalog data and for event sourcing in order processing pipelines. Designed and developed user defined functions, stored procedures, triggers for Cosmos DB. Analyzed the dataflow from different sources to target to provide the corresponding design Architecture in Aws environment. Take initiative and ownership to provide business solutions on time. Created High level technical design documents and Application design document as per the requirements and delivered clear, well-communicated and complete design documents. Created DA specs and Mapping Dataflow and provided the details to developer along with HLDs. Creating pipelines, dataflows and complex data transformations and manipulations using ADF and PySpark with Databricks. Performed ETL using Aws Data Bricks. Migrated on-premise Oracle ETL process to Aws Synapse Analytics. Ingested data in mini-batches and performs RDD transformations on those mini-batches of data by using Spark Streaming to perform streaming analytics in Data bricks. Created, provisioned different Databricks clusters needed for batch and continuous streaming data processing and installed the required libraries for the clusters. Integrated Aws Active Directory authentication to every Cosmos DB request sent and demoed feature to Stakeholders. Worked on writing the data to snowflake from Pyspark applications. Performs data analysis and design, and creates and maintains large, complex logical and physical data models, and metadata repositories using ERWIN and MB MDR. Implement ad-hoc analysis solutions using Aws Data Lake Analytics/Store, HDInsight.
Education
Jawaharlal Nehru Technological University
Bachelor's degree, Information Technology
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.