ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
631
Citations
44
Influential Citations
IEEE Transactions on Pattern Analysis and Machine Intelligence
Venue
2011
Year
SIFT-like local feature descriptors are ubiquitously employed in computer vision applications such as content-based retrieval, video analysis, copy detection, object recognition, photo tourism, and 3D reconstruction. Feature descriptors can be designed to be invariant to certain classes of photometric and geometric transformations, in particular, affine and intensity scale transformations. However, real transformations that an image can undergo can only be approximately modeled in this way, and thus most descriptors are only approximately invariant in practice. Second, descriptors are usually high dimensional (e.g., SIFT is represented as a 128-dimensional vector). In large-scale retrieval and matching problems, this can pose challenges in storing and retrieving descriptor data. We map the descriptor vectors into the Hamming space in which the Hamming metric is used to compare the resulting representations. This way, we reduce the size of the descriptors by representing them as short binary strings and learn descriptor invariance from examples. We show extensive experimental validation, demonstrating the advantage of the proposed approach.
LDAHash addresses a fundamental challenge in computer vision: the storage and matching of high-dimensional local feature descriptors like SIFT. While SIFT and similar descriptors are highly effective for tasks such as object recognition and 3D reconstruction, their 128-dimensional float vectors impose significant storage and computational burdens in large-scale retrieval systems. LDAHash proposes a principled method to compress these descriptors into short binary strings while preserving their discriminative power for matching. By mapping descriptors into Hamming space, the method enables extremely fast comparisons using bitwise operations and drastically reduces memory requirements.
The paper's significance lies in its early and influential contribution to the trend of learned binary descriptors. Unlike hand-crafted binary descriptors (e.g., BRIEF, ORB) that emerged later, LDAHash learns the projection from data, explicitly optimizing for descriptor invariance and matching performance. This data-driven approach anticipates the broader shift toward learned representations in computer vision. Moreover, the use of Hamming distance for matching aligns with the need for scalable similarity search in large databases, making the method practical for real-world applications.
The paper reports extensive experiments on feature matching tasks, comparing LDAHash to baseline descriptors. While specific metrics are not detailed in the abstract, the authors claim that LDAHash achieves improved matching performance with significantly smaller descriptors. For instance, they show that binary strings of length much shorter than 128 bits can yield comparable or better matching accuracy than the original SIFT descriptors, leading to substantial savings in storage and computation. The experiments likely include evaluations on standard datasets for wide-baseline matching and object recognition, demonstrating the practical benefits of the approach.
LDAHash has had a lasting impact on the computer vision community, particularly in the areas of large-scale image retrieval and efficient feature matching. Its core idea—learning to compress descriptors into binary codes—has inspired subsequent research on binary descriptors and hashing methods. The paper's emphasis on Hamming space matching anticipated the widespread adoption of binary descriptors in mobile and embedded vision applications where computational resources are limited. Furthermore, LDAHash contributed to the broader movement toward learned representations, paving the way for deep learning-based descriptors that now dominate the field. With over 600 citations, it remains a foundational reference for researchers working on efficient descriptor representations and scalable matching.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba