Intelligible Interactive Systems

Smartwatches, smart homes, smart robotics… Today, computer technology is incredibly smart. But how do we ensure that we - as users - understand at all times what exactly these super-intelligent systems do, why they do it that way and how they work. And how can we ensure that we remain in control? In addition to intelligence, we also need intelligibility.

News

Our Nerdland Festival booth where you could weld, grope and cycle in VR Science Communication

Over 900 Nerdlanders participated in our VR user studies (nl)

Impression of the Nu Weet Je Het article "Research Unit in de kijker: Intelligible Interactive Systems" Nu Weet Je Het

Research unit in the spotlight: Intelligible Interactive Systems (nl)

Impressie van het Kanaal Z artikel en bijbehorende video "Hoe kan werk meer 'werkbaar' worden?" Science Communication

Jeroen Ceyssens improves quality of working life (nl)

Video thumbnail "Science Pub nov 2022: Living in Real Life or Virtuality?" Science Communication

"Living in Real Life or Virtuality?" Science Pub with Kris Luyten and Jeroen Ceyssens (nl)

Logo AVI Event

We co-organized the workshop "HCI and worker well-being in manufacturing industry" at AVI

Logo EICS Conference

Kris Luyten co-chairs the papers track of the ACM SIGCHI conferences series EICS

Video thumbnail "Immersive technologie voor de voedingsindustrie" AR4Industry

AR for Industry 4.0 in Z-Food episode about Immersive Technology (nl)

Press takes pictures and films Jeroen during an AR demo in the XR-huis XR-huis

Press visits XR-huis (nl)

Video thumbnail "HapticPanel: An Open System to Render Haptic Interfaces in VR for Manufacturing Industry" Award

Bram van Deurzen receives Beste Demo Award at VRST

Video thumbnail "XR@Work" XR@Work

VLAIO shares short introduction to the XR@Work-project (nl)

Projects

MAXVR-INFRA MAXVR-INFRA

MAXVR-INFRA

Resizer (8) Voka DigiHub

Voka DigiHub

XR-Huis XR-huis

XR-huis

XR@work XR@Work

XR@Work

AR for Industry 4.0 AR4Industry

AR for Industry 4.0

Publications

Impression of the publication "Tool-based Interaction for Precise Manipulation in VR: an Exploratory Studyy" ECCE

Tool-based Interaction for Precise Manipulation in VR: an Exploratory Study

Impression of the publication "Context-Aware Support of Dexterity Skills in Cross-Reality Environments" ISMAR

Context-Aware Support of Dexterity Skills in Cross-Reality Environments

Impression of the publication "Choreobot: A Reference Framework and Online Visual Dashboard for Supporting the Design of Intelligible Robotic Systems" EICS

Choreobot: A Reference Framework and Online Visual Dashboard for Supporting the Design of Intelligible Robotic Systems

Impression of the publication "FortClash: Predicting and Mediating Unintended Behavior in Home Automation" EICS

FortClash: Predicting and Mediating Unintended Behavior in Home Automation

Impression of the publication "Work-a-Pose: Ergonomic Feedback and Posture Improvement Interfaces for Long-Term Sustainable Work" AVI

Work-a-Pose: Ergonomic Feedback and Posture Improvement Interfaces for Long-Term Sustainable Work

Impression of the publication "Intelligent overhead crane improves operator ergonomics and productivity" CIRP

Intelligent overhead crane improves operator ergonomics and productivity

Impression of the publication "Authoring Tool for Automatic Generation of Augmented Reality Instruction Sequence for Manual Operations" CIRP

Authoring Tool for Automatic Generation of Augmented Reality Instruction Sequence for Manual Operations

Impression of the publication "MyLYL: Towards Flexible Interaction Design for Operator Assistance Systems" LNCS

MyLYL: Towards Flexible Interaction Design for Operator Assistance Systems

Kris has a subtle smile

From intelligence to intelligibility

Many problems in Human-Computer Interaction have arisen with the shift from conventional desktop PCs - which do not perform any action without us commanding them via the keyboard or mouse - to smart environments that initiate actions autonomously. Home automation, smartphones and Fitbit bracelets are examples of this. These days we often don’t even spontaneously recognise the carefully hidden computers that surround us as computers. They continuously collect data via sensors and make independent decisions based on that data. They often make our lives easier with what they do, but at the same time, these systems are also becoming a lot more difficult to read and control.

Smarter but less visible

Exactly what data do these hidden computers collect? What do they do with that data? On what basis do they make a decision? And how can we ourselves maintain control and adjust the system if necessary? That is essentially what intelligibility is all about. To make this generation of intelligent, complex, networked computing systems more usable, it’s no longer enough to simply improve the visible user interface. In addition, we must also make the hidden processes visible and ensure that these systems explain themselves better. Only when we succeed in this will we have created systems that are not only intelligent but also intelligible.

Opt-out

Sometimes intelligibility impacts privacy. An example of this is the bluetooth weighing scale. Many people who bought these scales did not realise that the device was connected to the Internet via their computer or smartphone, and that the scale was sending data to a cloud service that could then sell it to marketers. When consumers suddenly received advertisements in their mailbox for weight-loss products, they felt they had been duped. And rightly so. The system should have made it clear from the start that it would collect data and share it with vendors of weight-loss products. In addition, the system should also have given consumers the choice not to share their data. Opt-out should become a basic right.

More usable

In addition to privacy, intelligibility is also about providing systems that are more usable. There is still a lot to be achieved in this area. At the moment, technology companies usually opt to keep the user interface as simple as possible, preferring to keep the underlying processes and complex algorithms neatly concealed behind it. The rationale is that the average user would find them bewildering. There is some truth in this, of course: if, for example, Google Translate were to show you every underlying algorithm, as a non-computer scientist you would be completely swamped with all that information. And yet the system would work even better if it made a number of aspects visible to the user. Why has it chosen to translate a word exactly that way at a certain point? In what other contextualised sentences has it searched? If you make that information search partially visible, users can often find an even better translation themselves.

Manufacturing industry

The application possibilities for intelligibility are virtually unlimited. It can even make a difference in the manufacturing industry. Robots are increasingly being used in the workplace. Man and machine literally work side by side on the same production line. In such circumstances it is of course very important for these employees to know what their robot colleagues are going to do, so that they can anticipate their behaviour. Intelligible systems can have a major impact in this kind of production environment in terms of safety and efficiency. A lot of attention is already being paid to safety. For example, most robot arms slow down when people come too close, but it is disappointing that the specific zones that the robot moves to are not shown to the production workers in advance. If you make these zones visible, employees will be much more careful there, which can only be a positive thing for efficiency and safety.

Internet of Things

Internet of Things applications are quickly becoming commonplace, allowing users to automate all kinds of tasks themselves. It is relatively easy to connect your doorbell to your intelligent lamp so that it changes colour when someone rings the bell. But in a world where computer systems are increasingly interconnected behind the scenes and data is constantly being exchanged, intelligibility is becoming more and more important. How do we ensure that users can maintain an overview and stay in control at all times? How can we also add intelligibility to all these intelligent systems - even if they were not originally designed for it? We will continue to research this in the years to come.

~ Prof. dr. Kris Luyten