Abhinav P.

Data Engineer @BT Group

Birmingham, GB

Key Responsibilities: Designed, built, and managed data pipelines, handling both batch and streaming jobs. Developed and optimized microservices applications for scalable data processing. Scheduled and managed DAGs using Cloud Composer & Apache Airflow. Created Dataflow templates using Apache Beam & Python. Provisioned cloud infrastructure with Terraform. Implemented unit and integration tests for robust Dataflow pipelines. Modeled data and wrote stored procedures in Google BigQuery. Improved Dataflow performance using Docker. Streamlined CI/CD workflows, resolving bottlenecks with CI branch tagging. Developed advanced pipelines for Kafka and tokenization. Managed BigQuery Data Warehouse, applied access controls, and enforced best practices. Key Achievements: Consistently delivered projects ahead of schedule, including one that will save the company millions. Led code refactoring, pair programming, and code reviews, improving code quality and maintainability. Provided guidance on CI/CD and GCP best practices to help team members. Tech Stack & Tools: Languages & Frameworks: Python3, Apache Beam Data & Cloud Tools: Apache Kafka, BigQuery, Google Cloud Storage, Cloud Functions, Terraform Orchestration & Workflow: Apache Airflow, Cloud Composer, Dataflow DevOps & CI/CD: GitLab, Docker, Git, VS Code, Unit Testing