The Visual Iconicity Challenge: Evaluating Vision–Language Models on Sign Language Form–Meaning Mapping

Published in Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026, Main), 2026

We introduce the Visual Iconicity Challenge, a benchmark for evaluating whether vision–language models can map iconic form–meaning relationships in sign languages. Our experiments reveal significant limitations in current VLMs in understanding visual iconicity.

Paper (ACL Anthology) · arXiv

Recommended citation: Keleş, O., Özyürek, A., Ortega, G., Gökgöz, K., & Ghaleb, E. (2026). The Visual Iconicity Challenge: Evaluating Vision–Language Models on Sign Language Form–Meaning Mapping. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026, Main).