Site avatar

Luca Resti (PhD Researcher)

Researcher in Acoustic Signal Processing

Banner image placeholder
Banner image

MAV-C: A Framework for the Joint Objective Estimation of Audio-Visual Complexity in Immersive Virtual Environments


Journal article


Luca Resti, A. Gully, Michael McLoughlin, Gavin Kearney, Alena Denisova
AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games · Paper 494, 2026

AES E-Library Semantic Scholar ArXiv
Cite

Cite

APA   Click to copy
Resti, L., Gully, A., McLoughlin, M., Kearney, G., & Denisova, A. (2026). MAV-C: A Framework for the Joint Objective Estimation of Audio-Visual Complexity in Immersive Virtual Environments. AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games · Paper 494.


Chicago/Turabian   Click to copy
Resti, Luca, A. Gully, Michael McLoughlin, Gavin Kearney, and Alena Denisova. “MAV-C: A Framework for the Joint Objective Estimation of Audio-Visual Complexity in Immersive Virtual Environments.” AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games · Paper 494 (2026).


MLA   Click to copy
Resti, Luca, et al. “MAV-C: A Framework for the Joint Objective Estimation of Audio-Visual Complexity in Immersive Virtual Environments.” AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games · Paper 494, 2026.


BibTeX   Click to copy

@article{luca2026a,
  title = {MAV-C: A Framework for the Joint Objective Estimation of Audio-Visual Complexity in Immersive Virtual Environments},
  year = {2026},
  journal = {AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games · Paper 494},
  author = {Resti, Luca and Gully, A. and McLoughlin, Michael and Kearney, Gavin and Denisova, Alena}
}

Abstract

We present the Motion-Aware Audio-Visual Complexity Metric (MAV-C), a reference-free framework for the joint objective estimation of audio-visual complexity. The metric combines entropy-based audio features (temporal, spectral, and spatial) with visual features (Sobel gradient magnitude, chromatic uniqueness, and optical flow) via a parametric fusion stage, producing a continuous joint complexity score CAV (t) [0,1]. We validate MAV-C on two datasets: a controlled synthetic corpus (SYN) of stimuli with known signal characteristics and a naturalistic gameplay corpus (GAM) of 60 clips drawn from the SAFEPLAY-X dataset. On SYN, the metric exhibits strong validity: the audio score CA and visual score CV are each insensitive to changes in the opposite modality (CoV<0.003), the joint score CAV spans [0.00,0.90] across all parameter combinations, and single-axis feature sweeps produce monotone trajectories (Spearman up to 0.995). On GAM, CV differs significantly across content categories (Kruskal-Wallis p = 0.021) while CA does not, and the two sub-scores are uncorrelated (r = 0.03), confirming they operate on independent signal dimensions. OFAT sensitivity analysis identifies a two-tier parameter hierarchy, with modality balance (wa) and visual regularization (v) as most significant tunable parameters. Full subjective calibration is planned as future work.




Text Only Owlstown
QR Code
Translate to