<!--HTML--> Abstract In this talk, we explore the critical role that software engineering craftsmanship plays in the success of data science projects and scientific research. We cover practices for ensuring reproducibility, starting with basic concepts such as packaging, version control, testing, and automation. By sharing stories from both academic and industry settings, the talk illustrates how these practices drive reproducibility and project success, benefiting researchers and professionals alike. Bio Francesco is a PhD student at CERN and University of the Basque Country. He studied at KTH and Politecnico di Torino and focuses on the simulation of Quantum Matter with Tensor Network Methods and other techniques related to Quantum Computation. Roman is a Data Scientist at Ergon Informatik, specializing in software engineering for data science and research. He holds a Master’s degree in Physics from ETH Zurich. During his studies, he conducted research at CERN, TU Munich, and the University of Tokyo, focusing on quantum computing and particle physics.
<!--HTML--> Abstract In this talk, we explore the critical role that software engineering craftsmanship plays in the success of data science projects and scientific research. We cover practices for ensuring reproducibility, starting with basic concepts such as packaging, version control, testing, and automation. By sharing stories from both academic and industry settings, the talk illustrates how these practices drive reproducibility and project success, benefiting researchers and professionals alike. Bio Francesco is a PhD student at CERN and University of the Basque Country. He studied at KTH and Politecnico di Torino and focuses on the simulation of Quantum Matter with Tensor Network Methods and other techniques related to Quantum Computation. Roman is a Data Scientist at Ergon Informatik, specializing in software engineering for data science and research. He holds a Master’s degree in Physics from ETH Zurich. During his studies, he conducted research at CERN, TU Munich, and the University of Tokyo, focusing on quantum computing and particle physics.
Various fields of science face a reproducibility crisis. For quantum software engineering as an emerging field, it is therefore imminent to focus on proper reproducibility engineering from the start. Yet the provision of reproduction packages is almost universally lacking. Actionable advice on how to build such packages is rare, particularly unfortunate in a field with many contributions from researchers with backgrounds outside computer science. In this article, we argue how to rectify this deficiency by proposing a 1-2-3 approach to reproducibility engineering for quantum software experiments: Using a meta-generation mechanism, we generate DOI-safe, long-term functioning and dependency-free reproduction packages. They are designed to satisfy the requirements of professional and learned societies solely on the basis of project-specific research artefacts (source code, measurement and configuration data), and require little temporal investment by researchers. Our scheme ascertains long-term traceability even when the quantum processor itself is no longer accessible. By drastically lowering the technical bar, we foster the proliferation of reproduction packages in quantum software experiments and ease the inclusion of non-CS researchers entering the field.
Quantum computing research increasingly depends on complex software stacks, yet the reproducibility of published results does not receive the priority and longevity mandated by recommendations of large international scientific bodies and best practices in software-centric systems research. In this paper, we present a combined manual and automated large-scale analysis of the reproducibility landscape in quantum computing research, quantify shortcomings, and derive actionable steps forward.
We manually evaluate a curated sample of 127 papers using a five-question framework that covers code availability, environment specification, documentation, hardware description, and executability. To place these findings in a broader context, we conduct an automated large-scale screening of nearly 5000 quantum computing papers for the same reproducibility indicators. Our manual analysis reveals that only 24.4% of the sampled papers provide code artefacts, and among those, 64.5% fail to execute successfully in a clean environment. This assessment is corroborated by a large-scale automated analysis that yields a consistent code availability rate of 26.8%. Further, it shows that approximately one-third of the papers with accessible code lack machine-readable environment specifications.
The results in this paper indicate that reproducibility is not yet consistently achieved in quantum computing research. In response, we outline a set of practical recommendations that address the observed failure modes and illustrate how reproducibility can be improved in practice.
As quantum computing transitions from a theoretical domain to a practical technology, many aspects of established practice in software engineering are being faced with new challenges. Quantum Software Engineering has been developed to address the peculiar needs that arise with quantum systems’ dependable, scalable, and fault-tolerant software development. The present paper critically reviews how traditional software engineering methodologies can be reshaped to fit into the quantum field. This also entails providing some critical contributions: frameworks to integrate classical and quantum systems, new error mitigation techniques, and the development of quantum-specific testing and debugging tools. In this respect, best practices have been recommended to ensure that future quantum software can harness the evolving capabilities of quantum hardware with continued performance, reliability, and scalability. The work is supposed to act as a foundational guide for the researcher and developer as quantum computing approaches widespread scientific and industrial adoption.
The quantum computing (QC) field is rapidly moving beyond the realm of pure science to become a commercially viable technology that may be able to overcome the drawbacks of traditional computing. Major technology tycoons have spent in building coding frameworks and hardware to create applications specifically designed for quantum computing over the last few years. The development of QC hardware is accelerating, however, the requirement for software-intensive methodology, approaches, procedures, instruments, roles and responsibilities for creating industrial-focused quantum software applications arises from operationalizing the QC. This paper outlines the concept of quantum software engineering (QSE) life cycle, which entails the engineering of quantum requirements, design, implementation, testing and maintenance of quantum software. This paper notably advocates for collaborative efforts between the industrial community and software engineering research to propose practical solutions to support the complete activities for the development of quantum software. The proposed vision makes it easier for researchers and practitioners to suggest new procedures, reference designs, cutting-edge equipment, and methods for utilizing quantum computers and creating the newest and most advanced quantum software.
Quantum technology works with and relies on sub-atomic particles or physics that operates on the quantum level. Quantum computing has become a mature field, having diversified applications in supply chain and logistics, chemistry, economics and financial services, energy and agriculture, medicine and health, etc. In the recent years, companies have started to incorporate quantum software to benefit the research and the practitioner communities. Software engineering and programming practices need to be brought into the domain of quantum computing. Quantum algorithms provide the ability to analyze the data and offer simulations based on the data. A few of the quantum computing programming languages include QISKit, Q#, Cirq, and forest are used to write and run quantum programs. In this chapter, the authors provide an overall picture of the problems and challenges of developing quantum software and up-to-date software engineering processes, methods, techniques, practices, and principles for the development of quantum software to both researchers and practitioners.