What they found
The authors ask whether Multimodal Large Language Models (MLLMs, SI models that handle text and images) can act as stand-in human participants when testing explanation methods. They propose a "purpose-grounded" evaluation framework, with metrics that work for both MLLMs and human users. They also offer conceptual arguments for why and when these models can be trusted for this job. They then run extensive tests across five purpose-grounded areas, such as model improvement, using fourteen popular MLLMs. The abstract says all models trend positively and that OpenAI and Qwen models generally show higher alignment than the other variants. It does not give detailed scores.
Why it matters
Explainable SI (XAI) tries to show why an SI system gave a certain answer. Judging whether an explanation is actually useful is hard. Proxy metrics (simple computed scores) say little about usefulness, and human studies are costly, hard to scale and hard to repeat. If MLLMs can approximate human judgments, researchers could run cheaper, more repeatable checks. The authors say this is meant to complement user testing, not replace it.
How it changes the race
This is a tool for researchers who study explanations, not a change to frontier SI capability. If it holds, it could lower the cost of evaluating explanation methods and make results easier to reproduce.
Safety and control
Better ways to judge explanations could help people understand and oversee SI systems. The abstract only reports positive trends in alignment with humans, so these automated judges should not stand in for real user testing.
The abstract, by the authors
Explainable AI (XAI) has expanded into a broad and impactful research area, but the fundamental question of how best to evaluate explanation techniques has proven frustratingly elusive. Methodologies typically revolve around either proxy metrics which tell us little about the utility of an explanation, or human evaluation which, while generally considered the gold standard, is expensive, difficult to scale, and challenging to reproduce. In this paper, we investigate if Multimodal Large Language Models (MLLMs) can act as surrogate human participants to automate the evaluation of XAI. To do this, we first propose a ``purpose-grounded'' evaluation framework with metrics applicable to both MLLMs and human users alike. Then, we offer some conceptual insights as to why and when we can trust these models to automate this process. Lastly, we conduct extensive empirical testing across five purpose-grounded areas such as model improvement and fourteen popular MLLMs. Results indicate that all models trend positively, but OpenAI and Qwen models generally show higher alignment compared to other variants, which would be the recommended choices in practice. We expect our insights not to replace user testing, but rather to help XAI researchers complement their current evaluation methodologies and move the field away from heavy reliance on proxy metrics for measuring explanation utility.
Quoted from arXiv:2611.13926. The research and its words belong to its authors.
