mvESS-Z: A Robust Multivariate Effective Sample Size for Degenerate and Quantized Markov Chains

Sayan Mukherjee1
1Chennai Mathematical Institute, Chennai, India
DOI: https://doi.org/10.71448/bcds2121-2
Published: 30/12/2021
Cite this article as: Sayan Mukherjee. mvESS-Z: A Robust Multivariate Effective Sample Size for Degenerate and Quantized Markov Chains. Bulletin of Computer and Data Sciences, Volume 2 Issue 1. Page: 3-16.

Abstract

Effective Sample Size (ESS) is central to diagnosing Markov chain Monte Carlo (MCMC) efficiency, yet standard multivariate ESS definitions either collapse in high dimensions when some coordinates are (near-)deterministic or become numerically unstable under hardware approximations (e.g., fixed-point quantization and probability truncation). We introduce mvESS-Z, a multivariate ESS that (i) is invariant to zero-variance coordinates, (ii) admits finite-sample concentration guarantees, and (iii) is stable under quantization/truncation commonly used in probabilistic accelerators. mvESS-Z is defined on the signal subspace determined by the posterior covariance and uses pseudo-determinant or spectral aggregation to avoid degeneracy. We prove basic properties, give a practical estimator with automatic rank selection, and show on synthetic and vision-style workloads that mvESS-Z correlates with downstream task error more reliably than per-coordinate ESS and split-\(\hat{R}\), enabling quality-constrained tuning of precision and random number generators.

Keywords: multivariate effective sample size (mvESS-Z), MCMC diagnostics, signal subspace, pseudo-determinant, spectral variance, long-run covariance, rank deficiency, degeneracy, quantization, probability truncation, random number generators (RNG), probabilistic accelerators

Abstract

Effective Sample Size (ESS) is central to diagnosing Markov chain Monte Carlo (MCMC) efficiency, yet standard multivariate ESS definitions either collapse in high dimensions when some coordinates are (near-)deterministic or become numerically unstable under hardware approximations (e.g., fixed-point quantization and probability truncation). We introduce mvESS-Z, a multivariate ESS that (i) is invariant to zero-variance coordinates, (ii) admits finite-sample concentration guarantees, and (iii) is stable under quantization/truncation commonly used in probabilistic accelerators. mvESS-Z is defined on the signal subspace determined by the posterior covariance and uses pseudo-determinant or spectral aggregation to avoid degeneracy. We prove basic properties, give a practical estimator with automatic rank selection, and show on synthetic and vision-style workloads that mvESS-Z correlates with downstream task error more reliably than per-coordinate ESS and split-\(\hat{R}\), enabling quality-constrained tuning of precision and random number generators.

Keywords: multivariate effective sample size (mvESS-Z), MCMC diagnostics, signal subspace, pseudo-determinant, spectral variance, long-run covariance, rank deficiency, degeneracy, quantization, probability truncation, random number generators (RNG), probabilistic accelerators
Sayan Mukherjee
Chennai Mathematical Institute, Chennai, India

DOI

Cite this article as:

Sayan Mukherjee. mvESS-Z: A Robust Multivariate Effective Sample Size for Degenerate and Quantized Markov Chains. Bulletin of Computer and Data Sciences, Volume 2 Issue 1. Page: 3-16.

Publication history

Copyright © 2021 Sayan Mukherjee. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Browse Advance Search