The Visual Iconicity Challenge: Evaluating Vision–Language Models on Sign Language Form–Meaning Mapping
Published in Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026, Main), 2026
We introduce the Visual Iconicity Challenge, a benchmark for evaluating whether vision–language models can map iconic form–meaning relationships in sign languages. Our experiments reveal significant limitations in current VLMs in understanding visual iconicity.
Recommended citation: Keleş, O., Özyürek, A., Ortega, G., Gökgöz, K., & Ghaleb, E. (2026). The Visual Iconicity Challenge: Evaluating Vision–Language Models on Sign Language Form–Meaning Mapping. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026, Main).
