HCI - Engineering Multimodal interaction - UHasselt

We investigate how conceptual modeling and code frameworks can improve the realization process of multi-modal interaction and virtual environments. In this way, the realization process also becomes more accessible for designers and developers. Low-level technical details are hidden by high-level and possibly domain-related concepts, and notations on a higher level than software code are introduced. Specific results that can be mentioned in this regards are NiMMiT, a modeling notation for 3D interaction, and CoGenIVE, the associated tool.  The notation and tools are used to quickly prototype different interactive systems, and case studies have demonstrated their effectiveness in several domains (e.g. simulation, virtual environment for cultural heritage, teleconferencing).
ADAPTiVE is a framework for adaptation and personalization of interaction in virtual environments, which has been applied in several experimental designs and case studies (e.g. in the context of personalized rehabilitation for MS and stroke patients).

Key projects:

• IWT SBO: VR-DEMO
• tUL project
• Interreg: Rehabilitation robotics II

Key publications:

• CoGenIVE: Building 3D Virtual Environments Using a Model Based User Interface Design Approach, DE BOECK, Joan, RAYMAEKERS, Chris, CONINX, Karin, COMPUTER VISION AND COMPUTER GRAPHICS: THEORY AND APPLICATIONS,  p. 83-96, Springer, ISBN:  978-3-642-10225-7, ISSN: 18650929, 2009
• High-Level Modeling of Multimodal Interaction Techniques Using NiMMiT, Joan De Boeck, Davy Vanacken, Chris Raymaekers, Karin Coninx, Journal of Virtual Reality and Broadcasting, 4 : 2, ISSN 1860-2037, Sep. 2007.
• A Model-Based Design Process for Interactive Virtual Environments, Erwin Cuppens, Chris Raymaekers, Karin Coninx, Proc. of DSVIS'05, pp. 225 - 236, ISSN 0302-9743, Lecture Notes in Computer Science LNCS series, 3941, pp. 225 - 236, Springer, ISSN 0302-9743, May 2006.
• Adaptation in virtual environments: conceptual framework and user models , Johanna Octavia, Chris Raymaekers, Karin Coninx, Multimedia Tools and Applications, 54 : 1, pp. 121 - 142, Springer, ISSN 1573-7721, Aug. 2011.