Preprint
Machine Learning

Caltech-UCSD Birds-200-2011 Dataset

Catherine Wah(University of California San Diego)
January 1, 2024CaltechAUTHORS (California Institute of Technology)3,524 citations

3.5k

Citations

0

Influential Citations

CaltechAUTHORS (California Institute of Technology)

Venue

2024

Year

Abstract

CUB-200-2011 is an extended version of CUB-200 [7], a challenging dataset of 200 bird species. The extended version roughly doubles the number of images per category and adds new part localization annotations. All images are annotated with bounding boxes, part locations, and at- tribute labels. Images and annotations were filtered by mul- tiple users of Mechanical Turk. We introduce benchmarks and baseline experiments for multi-class categorization and part localization.

Analysis

Why This Paper Matters

The Caltech-UCSD Birds-200-2011 (CUB-200-2011) dataset addresses a core challenge in computer vision: fine-grained visual categorization, where categories differ by subtle visual details. By extending the original CUB-200 dataset to 200 bird species and roughly doubling the number of images per category, the authors provide a richer resource for training and evaluating models that must discriminate between closely related classes. The addition of part localization annotations further enables research that goes beyond whole-image classification toward understanding object structure.

The dataset's importance is amplified by its annotation quality. All images are annotated with bounding boxes, part locations, and attribute labels, and the images and annotations were filtered by multiple users of Mechanical Turk. This multi-stage human verification helps reduce label noise, which is critical for benchmarking fine-grained recognition methods. As a result, CUB-200-2011 has become a standard testbed for evaluating attribute-based, part-based, and deep learning approaches to fine-grained categorization.

Technical Contributions

  • Dataset extension: CUB-200-2011 roughly doubles the number of images per category compared to CUB-200, covering 200 bird species.
  • Rich annotations: Every image includes bounding boxes, part locations, and attribute labels, supporting both categorization and part localization tasks.
  • Crowdsourced quality control: Images and annotations were filtered by multiple Mechanical Turk users to improve reliability.
  • Benchmarks and baselines: The paper introduces benchmarks and baseline experiments for multi-class categorization and part localization, providing reference points for future work.

Results

The abstract does not report specific quantitative metrics or comparisons. Instead, it describes the dataset construction and the introduction of benchmarks and baseline experiments for multi-class categorization and part localization. These baselines serve as reference performance levels for subsequent research using the dataset.

Significance

CUB-200-2011 has had a broad impact on the AI field, particularly in fine-grained visual categorization and part localization. Its combination of scale, detailed annotations, and quality control has made it a widely adopted benchmark for evaluating new models and algorithms. The dataset supports research on attribute recognition, part-based modeling, and transfer learning, and it has been cited thousands of times, reflecting its role as a foundational resource in computer vision.