Recent Advances in ViPER David Mihalcik Jonathan Shneier David Doermann
Jan 05, 2016
Recent Advances in ViPER
David Mihalcik
Jonathan Shneier
David Doermann
Work in Progress
Improved SE processes. (Web site, SourceForge, etc.). Rewriting the GT modules using the API.
– Allows for more freedom in individual modules.– Undo/redo support.– API has interface for editing viper data schema.– Already have non-editable timeline and canvas views.
Enhancing PE to support:– ROC curve drawing.– Enhancing “don’t care” functionality to support “really care”
rules. Perhaps generalize to a computed “care” factor.
Current Hazy Plans
Enhancing API to support:– Plain text search.– Relations.– Generated attributes.– Inheritance? Possibly ontology integration:
OWL or RDFS – see paper on using description logics to enhance multimedia libraries.
Multi-level evaluation of activities. Would like to integrate:– Object-level evaluation.– Action-level evaluation.– Higher-level evaluation.
Process Improvement
SourceForge web site:– http://viper-toolkit.sf.net/
Actively maintaining list of requirements and goals.
Timeline View
Based on Jon Heggland’s OntoLog. Other existing tools include timeline editors in
video/sound/multimedia editing tools, Plaisant’s LifeLines, etc.
OntoLog
Current Timeline
Lvalues
+ Cityscape
+ Indoors
+ Outdoors
- Background
Objects
+ People
+ Faces
+ Text
- Objects
Need for Ontology Integration
Support for relations.– This event is composed of these activities.– These people participated in these activities.– More generally, this object is related to these other
objects.
Support for inheritance.– This object type represents a subset of all objects in
this type, e.g. ‘arrive’ is a subclass of ‘move’.
Ontology Integration
Using simple description logics, probably getting a third generation, non-compatible ViPER data format in the process.
OWL – the W3C’s web ontology language, is a layer on top of RDF (what OntoLog uses) to support DL reasoning.
– Using n3, would look somewhat similar to old format, if a little more difficult to understand the header or parse without an n3 parser.
– Using XML, would be even more verbose than new format.– Grew from DAML, so there are already a variety of tools
developed at UMCP.
Example of Possible Data Format
owl:Ontology rdf:about <> ; owl:imports <owl> ; owl:imports <viper> . :FileInformation rdfs:subClassOf viper:FileDescriptor . :named a owl:ObjectProperty ; rdfs:subPropertyOf viper:hasAttribute ;
rdfs:label "has file name of" ; rdfs:range :FileInformation ; rdfs:domain.
<a.mpg> a viper:Sourcefile ; viper:hasFileDescriptor [
a :FileInformation ;:named [ a :svalue ;
:hasValue “a.mpg” ] ] .
Activity and Event Evaluation
At the most simple, do signal detection type evaluation, allowing ROC analysis.– For near misses, can do some sort of windowed
approach.– Using partial order of activities, can evaluate at
different levels of meaning. Important event -> people event -> steal book.
However, activities can be complex, and may want to evaluate them at multiple levels.
Activity Decomposition
Regard each event as an aggregation of smaller activities.
Check how well it segmented the activities:– For each event, compare all related
objects/activities.– Get back a score for each event.