IMMEDIATE -- Intelligent MultiMEDIA Transactions Environment

www.cs.vu.nl/~eliens/research/immediate.html


online

IMMEDIATE, which stands for Intelligent MultiMEDIA Transactions Environment, concerns the development of a collection of transaction primitives for embodied conversational agents in (3D) virtual environments. Such transaction primitives must include facilities for the interpretation of questions and commands from a (human) user, learning functionality (so that the agent can acquire, in the process of interaction, knowledge about the virtual world and the user), as well as a repertoire of actions (that is movements and gestures) with which the agent can respond in an adequate way.

In the IMMEDIATE project, we aim at developing two pilots and two target applications. The first pilot (1) is a a domestic servant, that inhabits a virtual house and is able to move objects around the house and perform simple duties, such as cleaning the house. The second pilot (2) is a virtual sales person, that is able to demonstrate products for sale on demand and may negotiate about particular attributes of the product, such as price and color. As target applications we plan to develop: (1) a cultural heritage application, in particular a virtual environment for material about contemporary art, in which a presentation agent selects material and creates a presentation based on the interests of a user; and (2) a social role playing application, where the user may interact with an agent that may take a particular role. For the social role playing application, we plan to develop a system with which public transport attendants can gain experience with passengers with a variety of attitudes. For example, passengers might be compliant and hand over their ticket, or aggressive and start vandalizing the transport vehicle.

The IMMEDIATE project must result in a collection of reusable primitives to build applications that require complex interactions with embodied conversational agents.

The software platform used for the realization of the target applications of the IMMEDIATE project is the DLP+X3D platform developed by the Intelligent Multimedia Group The Intelligent Multimedia Group is an informal subgroup of the IM&SE section of the Informatics department of the Faculty of Sciences of the Vrije Universiteit. of the Vrije Universiteit. The DLP+X3D platform combines distributed logic programming (DLP) with 3D virtual environments (X3D/VRML) and allows for the development of multiuser virtual environments with autonomous (conversational) agents. See  [DLP],  [Platform],  [Community] and  [STEP].

NOAG-i 2001-2005

nameexpertiseaffiliationhours/week
Dr. A. EliensmultimediaVU/IMSE8 (coordination)
Dr. Z. HuangagentsVU/AI8 (WASP/RIF)
Drs. C. Visser *)DLPVU 18 (programmer)
M. Hildebrand **)AI/CSVU32-36 (OIO)
... ***)......2 (promotor)

research

DLP+X3D


related work

Over the past six years, our research efforts have focussed on developing models and software architectures for multimedia and hypermedia applications. (A full version of this description, including publications, is available online in the SIKS report (2001)).

This research has resulted in two Ph.D. theses:

intelligent multimedia

The intelligent multimedia research theme may be regarded as continuing the hypermedia and visualisation projects described before. Our efforts are directed towards realizing the technology needed for developing intelligent multimedia applications. In particular, we aim for developing demonstrators in the area of embodied conversational agents. See  [Platform]. This work is being done in cooperation with dr. Z. Ruttkay from CWI. The work on the cultural heritage application will be done in cooperation with drs. T. Scholte from the ICN (Dutch Institute for Cultural Heritage).

Apart from publications in international conference proceedings, we have demonstrated our work on the ICT Kenniscongres 2002 in the theme intelligent multimedia.