[4eyes] Alex Potamianos talk on Friday, 2pm

[Matthew Turk]

Alex Potamianos, from the Technical University of Crete, and currently
visiting USC on sabbatical, will give a talk on Friday at 2pm. Note the
location: Webb 1100 (a short walk from Frank Hall). 

 

Movie Skimming and Summarization Using Audio, Visual and Text Saliency

Alex Potamianos - Technical University of Crete / USC

http://www.telecom.tuc.gr/~potam/index.html

Location: Webb 1100

Time: 2:00pm, Friday January 16

 

Detection of perceptually important video events is formulated here on the
basis of saliency models for the audio, visual and textual information
conveyed in a video stream. Audio saliency is assessed by cues that quantify
multifrequency waveform modulations, extracted through nonlinear operators
and energy tracking. Visual saliency is measured through a spatiotemporal
attention model driven by intensity, color and motion. Text saliency is
extracted from part-of-speech tagging on the subtitles information available
with most movie distributions. The various modality curves are integrated in
a single attention curve, where the presence of an event may be signified in
one or more domains.  The presence of salient events is signified on this
audiovisual curve by geometrical features such as local extrema, sharp
transition points and level sets. This multimodal saliency curve (MSC) and
its geometric characteristics (extrema, level sets) is the basis of a
bottom-up video summarization algorithm, that refines results from unimodal
or audiovisual-based skimming. The algorithm performs favorably for video
summarization in terms of informativeness and enjoyability.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.cs.ucsb.edu/pipermail/ilab-users/attachments/20090114/7f30edfa/attachment.html>