After intervention, incorrect tokens became correct tokens, and the saliency score increased significantly.
python demo_step1.py,python demo_step2.py
python Qwen_step1.py,python Qwen_step2.py
@inproceedings{
zhang-saliency,
title={Hallucination Begins Where Saliency Drops},
author={Xiaofeng Zhang, Yuanchao Zhu, Chaochen Gu, Xiaosong Yuan, Qiyan Zhao, Jiawei Cao, Feilong Tang, Sinan Fan, Yaomin Shen, Chen Shen, Hao Tang },
booktitle={The Fourteenth International Conference on Learning Representations},
year={2026},
url={https://openreview.net/forum?id=sjnErRHXf3}
}This repo is built on LLaVA (models), Qwen2.5-VL (CHAIR evaluation) and Label words. Many thanks for their efforts. The use of our code should also follow the original licenses.