Pranshu Tripathi

Swe Intern @Nielsen

Streamlined infrastructure management by automating the creation and destruction of clusters, updating the database with cluster status, and integrating email notifications for DAG completion, reducing manual effort and enhancing operational efficiency. • Enhanced system reliability by setting up robust monitoring and alerting for Kubernetes clusters, enabling proactive issue resolution. • Improved debugging and compliance by enabling YARN log aggregation for Spark jobs in a Hadoop cluster and automating archival to Amazon S3. • Secured sensitive configurations and credentials by leveraging AWS Parameter Store for streamlined and secure access. • Skills: Airflow, Python, psycopg2, Boto3, Grafana, Loki, Prometheus,Hadoop, YARN, AWS