Usman Abbas

Data Analyst @Infodat

Houston, TX, US

Developed ETL pipelines for time-series data migration, improving processing efficiency.• Automated oil well sensor data mapping and insert statement generation, reducing manual efforts.• Utilized bash scripts for efficient file extraction and loading through SnowSQL.• Set up Snow pipes for automated data ingestion from Amazon S3.• Created complex stored procedures for mathematical operations on rig sensor data, enhancing analysis.• Implemented stored procedure for filling missing timeseries data points through linear interpolation.• Provided expert Snowflake advice, aiding client\'s data architecture development.• Designed and deployed interactive data applications using Streamlit for enhanced exploration and visualization.• Achieved significant reduction in client\'s data ingestion timings and costs.• Mentored and trained team in Snowflake development and Streamlit for data visualization.• Developed Python application to fetch JSON data from API and push to BigQuery using Docker and Airflow.• Automated reporting and diagnostics process for claims and remittance files, improving data reliability.• Created Looker dashboards for business growth monitoring and visualization.• Built application to track data loss between processing layers using Python, BigQuery, and Looker.• Troubleshot and reloaded failed EDI files, ensuring data integrity.• Utilized SQL Server and PowerBI for detailed metrics reports for eblast marketing campaigns.• Fulfilled custom data requests using SQL Server for marketing team report generation.• Authored BigQuery stored procedures for data transformation.• Presented findings on low remittance amounts, aiding data gap identification.• Compiled weekly analysis reports to monitor ETL pipeline efficacy.• Developed a Python application to migrate big data from Apache Hive using PySpark to BigQuery. • Deployed and maintained applications on Linux VM instances on GCP Compute Engine and automated tasks using Airflow.

University of the Cumberlands

Master of Science - MS

University of Central Florida

Bachelor's degree

University of Central Florida

Bachelor of Science - BS

Beaconhouse

High School Diploma