Automatic Usability Assessment of Multimodal User Interfaces Based on Ergonomic Rules

In the context of Open Interface project, the UsiXML language is currently evolving in order to encompass full multimodal user interfaces so that they are compliant with the tools produced by the OpenInterface platform and to go beyond multimodal web user interfaces which have been addressed so far. Therefore, the goal of this paper consists in extending the UsiXML language (www.usixml.org) with new functionalities that explicitly address the behavioral features required by the dynamic aspects of multimodal user interfaces, whether they are web oriented or not. For this purpose, a real-world large-scale case study is investigated so as to test the specification of multimodal user interfaces corresponding to the same tasks, but with different modalities, single or combined.