RIF

Retrieval of Information in Virtual Worlds Using Feature Detectors

NWO Project: 612-61-607 ( proposal)
Contact: A. Eliëns

the project will be transferred to the VU at 1/1/2001.

abstract

AVID/MM

Based on the observation that multi-user virtual worlds are becoming an increasingly important phenomenon in the Internet-based Cyberspace (see for example www.blaxxun.com and www.colonycity.com), we propose to investigate the indexing and retrieval problem for multi-user virtual worlds.
Our research is meant to extend the ACOI framework for the indexing and retrieval of multimedia objects by providing special purpose feature detectors for virtual worlds, that fit within the ACOI architecture. The ACOI architecture is built around a Monet database that stores information concerning the structure and contents of multimedia objects available on the World Wide Web. The assumption underlying the indexing and retrieval model underlying the ACOI framework is that the structure and contents of multimedia objects may be expressed by a grammar that is augmented with media-specific detectors for analysing the object. These detectors act as token generators, providing the information to be stored in the Monet database.
For the construction of feature detectors for multi-user virtual worlds, we need to develop the technology to analyse world description files and VRML encodings of the geometric structure and objects contained in a world, and an ontology or knowledge representation to store and reason about the contents of the world and its relation to other worlds. Further we need to investigate how we can assist the end user in formulating and refining queries with respect to locations within a world, informational resources contained within a world, and navigational preferences, that is the wish to migrate to different worlds.
The initial approach will be to extend the musical feature detector, see MIDI, which is based on a combination of feature grammars and descriptive logic, to the contents of virtual world. In a later stage, we will combine our virtual world feature detector with the other multimedia feature detectors developed within the ACOI framework. To validate our approach, we intend to create a small virtual world ourselves, in order to establish the effectiveness of our indexing and retrieval method.
Our research will result in actual feature detectors running within the ACOI framework, a knowledge representation or ontology for collecting information about virtual worlds, and appropriate applets to formulate queries and deliver a report of the outcome of consulting the ACOI index database.

people

mailing list

Alex van Ballegooij alexb@cwi.nl www.cwi.nl/~alexb (onderzoeker)
Zhisheng Huang huang@cs.vu.nl (postdoc WASP)
Anton Eliëns eliens@cs.vu.nl (projectleader)

RIF publications

NBQ: A. van Ballegooij and A. Eliëns, Navigation by Query in Virtual Worlds, Web3D 2001 Conference, Paderborn, Germany, 19-22 Feb 2001
VirtualContext2: Lloyd Rutledge, Alex van Ballegooij and Anton Eliëns, Virtual Context - relating paintings to their subject, CWI Report INS-R0022
VirtualContext: Lloyd Rutledge, Alex van Ballegooij and Anton Eliëns, Virtual Context - relating paintings to their subject, Culture Track of WWW9 in Amsterdam, The Netherlands, Tuesday, May 16th, 2000
Avatars: Alex van Ballegooij and Anton Eliëns, Avatars in RIF, FASE2FASE 2000 Symposium, Delft, the Netherlands
Gadgets: S.P.C. Schönhage, A. van Ballegooij, A. Eliëns, 3D Gadgets for Business Process Visualization: a case study, VRML/Web 3D - 2000, Monterey CA, Febr 2000

[_]

CV media links resources _

# @