Uncertainty Calibrated Visual Complexity from Pairwise Judgments

Margrit Betke1
1Boston University, Boston, MA, 02215, United States
DOI: https://doi.org/10.71448/bcds2121-4
Published: 30/12/2021
Cite this article as: Margrit Betke. Uncertainty Calibrated Visual Complexity from Pairwise Judgments. Bulletin of Computer and Data Sciences, Volume 2 Issue 1. Page: 28-43.

Abstract

Visual complexity influences human attention, memorability, and task difficulty, yet most computational estimators produce a single point value without reporting confidence. We introduce an uncertainty-aware framework that estimates both a central tendency and a calibrated interval for image complexity using only pairwise human judgments. Our approach couples a heteroskedastic pairwise aggregation model with a compact predictor that produces mean and variance from intermediate visual features. To provide distribution-free coverage guarantees, we further wrap predictions with normalized conformal intervals. We propose an evaluation protocol that measures rank correlation to human scores alongside probabilistic calibration (coverage and sharpness) and show that uncertainty improves downstream decisions in complexity-aware compression and layout scheduling. Experiments across multiple categories demonstrate state-of-the-art correlations to human judgments while delivering well-calibrated prediction intervals. We release code, annotation interface, and splits to facilitate reproducible research.

Keywords: visual complexity, pairwise comparisons, uncertainty calibration, conformal prediction, Bradley–Terry, heteroskedastic modeling, human perception

Abstract

Visual complexity influences human attention, memorability, and task difficulty, yet most computational estimators produce a single point value without reporting confidence. We introduce an uncertainty-aware framework that estimates both a central tendency and a calibrated interval for image complexity using only pairwise human judgments. Our approach couples a heteroskedastic pairwise aggregation model with a compact predictor that produces mean and variance from intermediate visual features. To provide distribution-free coverage guarantees, we further wrap predictions with normalized conformal intervals. We propose an evaluation protocol that measures rank correlation to human scores alongside probabilistic calibration (coverage and sharpness) and show that uncertainty improves downstream decisions in complexity-aware compression and layout scheduling. Experiments across multiple categories demonstrate state-of-the-art correlations to human judgments while delivering well-calibrated prediction intervals. We release code, annotation interface, and splits to facilitate reproducible research.

Keywords: visual complexity, pairwise comparisons, uncertainty calibration, conformal prediction, Bradley–Terry, heteroskedastic modeling, human perception
Margrit Betke
Boston University, Boston, MA, 02215, United States

DOI

Cite this article as:

Margrit Betke. Uncertainty Calibrated Visual Complexity from Pairwise Judgments. Bulletin of Computer and Data Sciences, Volume 2 Issue 1. Page: 28-43.

Publication history

Copyright © 2021 Margrit Betke. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Browse Advance Search