CHI Nederland

8 februari 2000

Paul de Greef (TUE/IPO, Center for User-System Interaction)

Video cameras and LCD projectors enable a novel kind of human-computer interaction. The image that is shown on a PC's monitor can be projected to an ordinary tabletop. Users can sit around the table and a video camera can watch their behaviour and partly replace mice and keyboards. IPO owns such a Video-based Interaction Platform (VIP) that uses an infrared camera and infrared reflecting blocks (bricks) for two-handed user input (Rauterberg, 1997, Fjeld et al. 1999).

Video-based interaction is promising as it allows for a novel interaction style that is very easy to learn and use (perception space and action space coincide, as with a touchscreen), as confirmed in two projects at IPO. It is also very well suited to computer-supported co-operative work (CSCW) in a same place situation as it allows persons to sit around a normal table, not hindered by monitors, allowing normal social interaction and eye-contact. This is sufficient motivation to further explore and develop video-based interaction. The development process can be steered by user-centred design, with application-development projects as empirical basis, and 'multiplied' across applications by development and improvement of common user-interface software architecture.

Although it is to be expected that other modalities such as speech input need to be added, the proposed approach for development is to stay close to the original interaction concept, and to add interaction operations or other modalities on an if-needed basis only. Development in real applications and having real users as participants in empirical evaluations is essential to avoid developing 'solutions' without knowing the 'problems'.

At the SIGCHI.NL meeting Paul de Greef presented the interaction platform and two recently completed studies. The first is a medical image viewing application intended for doctors sitting around the same table. The second is a tele-application, "PhotoShare" for which the VIP platform was extended to TeleVIP, comprising two VIP platforms communicating over a network and supplemented with audio and video communication, leading to a set-up with local and remote participants sitting at the same virtual table.


  • Rauterberg, M., Bichsel, M., Leonhardt, U. and Meier, M. (1997) BUILD-IT: a computer vision-based interaction technique of a planning tool for construction and design. In Howard, S., Hammond,J. and Lundgaard, G. (Eds) Human-Computer Interaction, proceedings of INTERACT'97. Chapman & Hall, London 1997.
  • Fjeld, M. Bichsel,M. & Rauterberg, M. (1999): BUILD-IT: a brick-based tool for direct interaction. In D. Harris (ed.) Engineering Psychology and Cognitive Ergonomics (EPCE), Vol. 4. Hampshire: Ashgate, pp. 205-212.

Over de presentator

Paul de Greef is als universitair docent verbonden aan IPO, Center for User-System Interaction, waar hij requirements engineering doceert en onderzoek doet naar respectievelijk methoden voor user-centered design en interactie platforms.

Hij is per email te bereiken als: