<s5>Æliens</s5> -- slide(s)

...

video annotation

what are the interesting aspects?
how do we represent this information?

video content


  video v, frame f 
  f has associated objects and activities 
  objects and activities have properties

property


  property: name = value

object schema


   (fd,fi) -- frame-dependent and frame-independent properties

object instance: (oid,os,ip)

object-id -- oid
object-schema -- os = (fd,fi)
set of statements -- ip: name = v and name = v IN f

example

frame	objects	frame-dependent properties
1	Jane	has(briefcase), at(path)
-	house	door(closed)
-	briefcase
2	Jane	has(briefcase), at(door)
-	Dennis	at(door)
-	house	door(open)
-	briefcase

frame-independent properties

object	frame-independent properties	value
Jane	age	35
	height	170cm
house	address	...
	color	brown
briefcase	color	black
	size	40 x 31

activity

activity name -- id
statements -- role = v

example


   { giver : Person, receiver : Person, item : Object } 
   giver = Jane, receiver = Dennis, object = briefcase

...

video libraries


  which videos are in the library 
  what constitutes the content of each video
  what is the location of a particular video

query language for video libraries

segment retrievals -- exchange of briefcase
object retrievals -- all people in v:[s,e]
activity retrieval -- all activities in v:[s,e]
property-based -- find all videos with object oid

VideoSQL


  SELECT -- v:[s,e] 
  FROM -- video:<source><V> 
  WHERE -- term IN funcall

example


  SELECT  vid:[s,e]
  FROM video:VidLib
  WHERE (vid,s,e) IN VideoWithObject(Dennis) AND
  	object IN ObjectsInVideo(vid,s,e) AND
  	object != Dennis AND
  	typeof(object) = Person

To improve library access, the Informedia Digital Video Library uses automatic processing to derive descriptors for video. A new extension to the video processing extracts geographic references from these descriptors.

The operational library interface shows the geographic entities addressed in a story, highlighting the regions discussed in the video through a map display synchronized with the video display.

The map can also serve as a query mechanism, allowing users to search the terabyte library for stories taking place in a selected area of interest.

questions

what -- content-related
when -- position on time-continuum
where -- geographic location

More recently, it has been recognized that the process of spatialization -- where a spatial map-like structure is applied to data where no inherent or obvious one does exist -- can provide an interpretable structure to other types of data.

atlas of cyberspace

We present a wide range of spatializations that have employed a variety of graphical techniques and visual metaphors so as to provide striking and powerful images that extend from two dimension 'maps' to three-dimensional immersive landscapes.

Æliens

2009

...

...

...

...

document.write(' <a href=');if (!slidemode) { document.write('@slide-'); } else { document.write('@tmp-6-2.html#slide-'); } document.write('r-5-2-quest'); if (!slidemode) document.write('.html');document.write('>');