Attention Is All You Need
Ashish Vaswani, Noam Shazeer et al.
938
Citations
78
Influential Citations
Algorithms
Venue
2019
Year
The next few years will be exciting as prototype universal quantum processors emerge, enabling the implementation of a wider variety of algorithms. Of particular interest are quantum heuristics, which require experimentation on quantum hardware for their evaluation and which have the potential to significantly expand the breadth of applications for which quantum computers have an established advantage. A leading candidate is Farhi et al.’s quantum approximate optimization algorithm, which alternates between applying a cost function based Hamiltonian and a mixing Hamiltonian. Here, we extend this framework to allow alternation between more general families of operators. The essence of this extension, the quantum alternating operator ansatz, is the consideration of general parameterized families of unitaries rather than only those corresponding to the time evolution under a fixed local Hamiltonian for a time specified by the parameter. This ansatz supports the representation of a larger, and potentially more useful, set of states than the original formulation, with potential long-term impact on a broad array of application areas. For cases that call for mixing only within a desired subspace, refocusing on unitaries rather than Hamiltonians enables more efficiently implementable mixers than was possible in the original framework. Such mixers are particularly useful for optimization problems with hard constraints that must always be satisfied, defining a feasible subspace, and soft constraints whose violation we wish to minimize. More efficient implementation enables earlier experimental exploration of an alternating operator approach, in the spirit of the quantum approximate optimization algorithm, to a wide variety of approximate optimization, exact optimization, and sampling problems. In addition to introducing the quantum alternating operator ansatz, we lay out design criteria for mixing operators, detail mappings for eight problems, and provide a compendium with brief descriptions of mappings for a diverse array of problems.
This paper is a foundational contribution to the field of quantum optimization, extending the influential quantum approximate optimization algorithm (QAOA) introduced by Farhi et al. into a more flexible and powerful framework: the quantum alternating operator ansatz (QAOA). As prototype universal quantum processors emerge, the ability to design and test quantum heuristics becomes critical. The original QAOA was limited to alternating between two fixed Hamiltonians—a cost Hamiltonian and a mixing Hamiltonian—which restricted the set of reachable states and the efficiency of implementation for problems with constraints. By generalizing to arbitrary parameterized families of unitaries, this work opens the door to more expressive quantum circuits that can be tailored to specific problem structures, particularly those with hard constraints that define a feasible subspace.
The significance lies in its practical orientation: the authors provide concrete design criteria for mixing operators and detailed mappings for eight distinct optimization problems, along with a compendium for many more. This makes the framework immediately useful for researchers and practitioners looking to implement quantum heuristics on near-term devices. The emphasis on efficient implementation within feasible subspaces addresses a key bottleneck in applying quantum algorithms to real-world optimization problems, where constraints are ubiquitous.
The paper does not present experimental results or numerical benchmarks. Instead, its contributions are theoretical and methodological: it demonstrates that the quantum alternating operator ansatz can represent a larger and potentially more useful set of states than the original QAOA. The key result is the framework itself, which enables earlier experimental exploration of alternating operator approaches for approximate optimization, exact optimization, and sampling problems. The authors show that for problems with hard constraints, the new mixers can be implemented more efficiently than those derived from the original Hamiltonian-based approach.
This paper has had substantial impact, evidenced by its 938 citations. It has become a standard reference for variational quantum algorithms for optimization, influencing both theoretical research and experimental implementations on quantum hardware. By providing a flexible ansatz and practical design guidelines, it has accelerated the exploration of quantum heuristics for a wide range of applications, from logistics to machine learning. The work bridges the gap between abstract quantum algorithm design and practical implementation on near-term devices, making it a cornerstone of the quantum optimization literature.
Ashish Vaswani, Noam Shazeer et al.
Jakubův, Jan, Chvalovský, Karel et al.
Pauli Virtanen, Ralf Gommers et al.
Tom B. Brown, Benjamin Mann et al.