Shiva P
Sr Python Developer @Progressive Insurance
Signup · Get unlimited contacts
WORK HISTORY
Sr Python Developer @Progressive Insurance
Developed Data Privacy Solution Implementation projects using Python, Flask, and OpenShift, ensuring compliance with PII regulations.•Designed and implemented the DATA MART module, transferring scan results across Production, QA, and DEV environments to BISSDIG Data Privacy for data analytics teams.• Created regular expressions (Regex) for PII classification, integrating them into PrivacyHub for enhanced metadata scanning.• Built a Job Scheduler from scratch in OpenShift, automating the execution and synchronization of scheduled database scans.•Developed database scanners for multiple platforms (SQL, DB2, Oracle,SnowFlake), optimizing metadata collection and scan efficiency.•Automated testing pipelines in ADO, improving deployment efficiency across environments.•Integrated Splunk logging (CIF Format) for better monitoring of application events, errors, and alerts.•Designed and implemented the Metadata-Only Scanning feature, reducing processing overhead and improving scan accuracy.•Created automated scripts to generate API tests using Docker containers, streamlining the testing process.•Developed GraphQL APIs to improve data retrieval and system performance.•Designed Target Data Discovery (OneTrust Integration) project to process OneTrust data requests and retrieve PII-related data from Progressive’s database systems.•Implemented REST APIs to fetch and process sensitive data (name, email, policy number, employee ID) and generate structured Word reports for requesters.•Created a query execution framework that dynamically selects database connectors (SQL, Oracle, DB2) based on request parameters.•Developed a utility to grant automated admin access to database SMEs in PrivacyHub UI, reducing manual workload.•Integrated automated email notifications for scan failures using email wrapper technology, improving error tracking.•Assisted in setting up and configuring AWS OpenSearch for improved search capabilities and performance optimization.
EDUCATION
Teegala Krishna Reddy Engineering College
Bachelor's degree, Mechanical Engineering
Silicon Valley University
Master's degree, Computer Science
ABOUT SHIVA P
10 years of professional experience in involving designing, development, testing, implementation and supportof applications using Python Scripting, Perl scripting, Unix Shell scripting and Oracle SQL,PL/SQL.• Skilled experience in Python with proven expertise in using new tools and technical developments (libraries used: libraries- Beautiful Soup, Jasy, numpy, Scipy, matplotlib, Pickle, PySide, Python-twitter, Pandas dataframe, networks, urllib2, MySQL dB for database connectivity) to drive.com• Good experience in developing web applications implementing Model View Control architecture using Django, Flask, Pyramid and Zope Python web application frameworks.• Experienced in working with various Python Integrated Development Environments like Net Beans, PyCharm, PyScripter, Spyder, PyStudio, PyDev and Sublime Text.• Basic understanding of protocols/technologies like HTTP, LDAP, JDBC, SSL, Servlet/JSP, SQL, HTML, XML.• Good knowledge on front end frame works like CSS Bootstrap.• Experience with Design, code, and debug operations, reporting, data analysis and web applications utilizing Python.• Worked DevOps methodologies and cloud infrastructure automation tools like AWS, Chef by using Terraform.• Used Spark API over Cloudera Hadoop YARN to perform analytics on data.• Exploring with the Spark improving the performance and optimization of the existing algorithms in Hadoop using Spark Context, Spark-SQL, Data Frame, Pair RDD\'s, Spark YARN.• Used all major ETL transformations to load the tables through Informatica mappings.• Good Experience with Django, a high-level Python Web framework.• Sound experience in Object Oriented Programming using concepts like Multi-Threading, Exception Handling and Collections.• Knowledge about setting up Python REST API Frame work using Django.• Extended Testing framework by adding some helper classes and methods• Good at writing SQL Queries, Stored procedures, functions, packages, tables, views, triggers using relational databases like Oracle, MySQL, DB2.• Having good knowledge in using NoSQL databases like Apache Cassandra (1.2, 2.0 and 2.1), Kubernetes and Mongo DB (2.6, 2.4), Orient DBF net.• Having experienced in Agile Methodologies, PCI, Scrum stories and sprints experience in a Python based environment, Data analytics, data wrangling and Excel data extracts.• Worked on various operating systems like Windows, UNIX and LINUX.• Experienced in Shell Scripting and UNIX commands.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.