ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
3.1k
Citations
0
Influential Citations
ACS Central Science
Venue
2018
Year
We report a method to convert discrete representations of molecules to and from a multidimensional continuous representation. This model allows us to generate new molecules for efficient exploration and optimization through open-ended spaces of chemical compounds. A deep neural network was trained on hundreds of thousands of existing chemical structures to construct three coupled functions: an encoder, a decoder, and a predictor. The encoder converts the discrete representation of a molecule into a real-valued continuous vector, and the decoder converts these continuous vectors back to discrete molecular representations. The predictor estimates chemical properties from the latent continuous vector representation of the molecule. Continuous representations of molecules allow us to automatically generate novel chemical structures by performing simple operations in the latent space, such as decoding random vectors, perturbing known chemical structures, or interpolating between molecules. Continuous representations also allow the use of powerful gradient-based optimization to efficiently guide the search for optimized functional compounds. We demonstrate our method in the domain of drug-like molecules and also in a set of molecules with fewer that nine heavy atoms.
Automatic chemical design is a grand challenge at the intersection of machine learning and the physical sciences. Traditional approaches to molecular discovery rely on discrete representations—such as SMILES strings or molecular graphs—that are difficult to optimize directly with gradient-based methods. This paper by Gómez-Bombarelli et al. introduced a compelling solution: learn a continuous, data-driven latent space in which molecules can be represented as real-valued vectors, enabling smooth interpolation, perturbation, and gradient-based optimization.
The significance of this work lies in its timing and framing. Published in 2018 in ACS Central Science, it arrived as deep generative models were beginning to transform drug discovery and materials science. By explicitly coupling an encoder, decoder, and property predictor, the authors provided a blueprint for how to bridge discrete chemical structures with the continuous optimization machinery that powers modern deep learning. The paper has since accumulated over 3,000 citations, reflecting its role as a foundational reference for generative molecular design.
Moreover, the work demonstrated that simple operations in latent space—decoding random vectors, perturbing known structures, or interpolating between molecules—can yield novel and chemically plausible compounds. This opened the door to a new paradigm: instead of searching discrete chemical space with combinatorial methods, one can navigate a learned continuous manifold and use gradients to efficiently guide the search toward desired properties.
The abstract reports that the model was trained on hundreds of thousands of existing chemical structures and successfully constructs the three coupled functions. The continuous representation allows automatic generation of novel chemical structures through simple latent-space operations and enables gradient-based optimization to guide the search for optimized functional compounds. The authors demonstrate the approach in the domain of drug-like molecules and in a set of molecules with fewer than nine heavy atoms. However, the abstract does not provide quantitative metrics such as reconstruction accuracy, validity of generated molecules, or property optimization performance, so concrete numerical comparisons are not available from the summary alone.
This paper is a landmark contribution to AI-driven scientific discovery. It popularized the idea of using continuous latent spaces for molecular design, influencing a generation of generative models for chemistry, including variational autoencoders, generative adversarial networks, and reinforcement learning approaches. The encoder–decoder–predictor framework has become a standard template for property-targeted molecule generation. By demonstrating that gradient-based optimization can be performed in a learned chemical latent space, the work bridged deep learning and computational chemistry, accelerating research in drug discovery, materials design, and beyond. Its high citation count underscores its enduring impact on both machine learning and the chemical sciences.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba