Usman Kayani
Senior Data Engineer @Quantexa
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer @Quantexa
London, GB
Building on my experience within Quantexa’s Data Engineering Accelerators and Demos (DEAD) team in R&D, I have now stepped into the role of Senior Data Engineer. In this role, I continue to leverage my expertise in big data technologies, advanced programming, and cloud architecture to lead key initiatives and drive innovation within the company.• Lead complex data engineering projects: Overseeing the design, development, and optimization of scalable data pipelines to support large-scale data integration and analytics.• Mentorship and team leadership: Providing guidance to junior data engineers and contributing to their professional development through knowledge sharing and code reviews.• Stakeholder collaboration: Engaging with cross-functional teams, clients, and partners to deliver high-quality data solutions that meet diverse technical and business needs.• Advanced problem-solving: Utilizing Scala, Python, Spark, and cloud platforms (GCP) to tackle complex challenges and optimize Quantexa’s data solutions.• Continuous improvement: Implementing best practices for data architecture and processing, ensuring the efficient handling of large datasets across both on-premise and cloud environments.• Innovation and development: Contributing to the development of new tools and frameworks that enhance Quantexa’s capabilities in data classification, entity extraction, and contextual decision-making.• Strategic input: Collaborating with the R&D team to align data engineering efforts with Quantexa’s vision of delivering cutting-edge, context-driven data solutions. • Technical leadership in infrastructure and data pipeline optimization: Spearheaded the implementation of dynamic DAGs and autoscaling in Airflow, optimizing performance and scalability. Applied expertise in Google Cloud and Spark clusters to streamline workflows and drive best practices in infrastructure management and troubleshooting through clear documentation & mentorship.
EDUCATION
King's College London
Doctor of Philosophy (PhD), Applied Mathematics and Theoretical Physics
King's College London
MSci, Mathematics
Sir George Monoux College
A-Levels
Sir George Monoux College
Advanced Extension Award, Mathematics
SKILLS
ABOUT USMAN KAYANI
About MeI am Dr. Usman Kayani, a Senior Data Engineer at Quantexa, leveraging over a decade of expertise in data engineering, data science, and big data technologies to design and optimize cutting-edge solutions that enable organizations to make smarter, data-driven decisions. With a PhD in Applied Mathematics and Theoretical Physics and a strong foundation in mathematics, I thrive at the intersection of advanced analytics, scalable infrastructure, and technical innovation. Professional ImpactAt Quantexa, I lead complex data engineering projects as part of the Data Engineering Accelerators and Demos (DEAD) team within Research and Development. My focus is on architecting dynamic ETL pipelines, optimizing big data workflows, and automating scalable solutions to handle high-volume data integration and advanced analytics. Proficient in tools such as Apache Spark, Airflow, and BigQuery, and programming languages like Python, Scala, and Java, I ensure high performance and efficiency in every project I tackle.Key achievements include:• Developed a dynamic DAG generator for ETL pipelines, reducing setup time and enhancing scalability.• Achieved 97% in the Quantexa Data Engineer Certification, demonstrating technical mastery in entity resolution and big data processing.• Spearheaded efforts to deploy cloud-based solutions with GCP and Azure expertise, optimizing infrastructure for robust performance. Mentorship & AdvocacyBeyond technical expertise, I am committed to fostering talent and creating an inclusive workplace. I actively mentor junior engineers and academy participants, sharing knowledge to elevate their careers. As an individual with ADHD and dyslexia, I bring a unique problem-solving perspective and champion neurodiversity in tech, ensuring accessibility and collaboration are at the heart of every project. Academic & Teaching ExperienceWith over 12 years of experience teaching Mathematics and Physics at GCSE, A-Level, and university levels, I am passionate about education and knowledge-sharing. My academic contributions include publishing papers on quantum gravity and black hole symmetries, as well as developing innovative methodologies for solving advanced mathematical problems. Future VisionDriven by curiosity and a desire to make a positive impact, I am keen to explore opportunities in quantum computing, mathematical modeling, or advanced data science applications. My goal is to continue harnessing the transformative power of data to tackle real-world challenges with creativity, precision, and innovation.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.