Sai Kiran N
Senior Data Engineer | Data Engineer | ETL Developer | AWS | Azure | GCP | Snowflake | Databricks | Hadoop | PySpark | Python | Scala | SQL | Airflow | Kafka | Tableau | Power BI | Project Management |
- Role
- Senior Data Engineer at Procter & Gamble
- Location
- Boston, MA, US
- LinkedIn followers
- 500 followers
About Sai Kiran N
With over 9 years of extensive experience in the field of Data Engineering, I have…
Experience
Senior Data Engineer
Jun 2023 — Present
Good understanding of the Software Development Life Cycle (SDLC), including testing methodologies, disciplines, tasks, resources, and scheduling. Responsible for building highly Reliable and Scalable ETL Pipelines using highly specialized knowledge of Data Collection, Data integration, and Data Loading that facilitate deeper analysis and reporting by the Data and Analytics Department. Developed Spark applications using Pyspark and Spark-SQL for data extraction, transformation, and aggregation from multiple file formats for analyzing and transforming the data to uncover insights into the customer usage patterns. Collaborate with Machine learning and business units to develop strategy for long term data platform architecture using CI/CD process and azure platform. Executed and Verified migration strategy in all environments from Centralized Teradata database to Azure ADLS and Azure Snowflake owned by our team. Extensive Working knowledge of partitioned table, UDFs, performance tuning, compression-related properties, thrift server in Hive. Involved in Transforming the data using Azure Databricks (Pyspark) and loading the data into Snowflake internal and external stages using snowSQL for downstream analytics. Developed Kafka Streaming producer and Spark Streaming consumer to read the stream of events as per business rules. Loaded various formats of structured and unstructured data from Linux file system to HDFS. Managed resources and scheduling across the cluster using Azure Kubernetes Service. AKScan be used to create, configure, and manage a cluster of Virtual machines and used Kubernetes which is possible to handle all the online and batch workloads required to feed, analytics and machine learning applications. Designed the interactive Power BI dashboards and reporting with high level securityfeatures such as row level based on business requirements.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.