Upper Ontology Design for Application-Based Spatial
Ontologies
Eric Little, PhDD’Youville College
National Center for Ontology Research (NCOR)National Center for Multisource Information Fusion (NCMIF)
Buffalo, NY USA
[email protected]@eng.buffalo.edu
The Structure of an Ontology
• Upper-Level (Formal):Upper-Level (Formal):– Most general categories of existence (e.g.,
existent item, spatial region, dependent part).– This Level of the ontology is rationally driven,
meaning it is the product of philosophical reasoning.
– Relies on a sound metaphysical description of the world (e.g., realism).
The Structure of an Ontology
• Domain-Specific LevelDomain-Specific Level– Contains categories that are specific to a
particular domain of interest (disaster, military/defense, medicine).
– This level of the ontology is empirically driven, meaning it is produced by gathering expert knowledge about a given domain of interest.
– The expert knowledge is used to create a consistent and comprehensive lexicon of terms.
Synthesized Ontology Model
FormalFormalOntologyOntology(Rational)(Rational)
Application-BasedApplication-BasedFormal OntologyFormal Ontology
Collection of Non-Formal Collection of Non-Formal Information NeedsInformation Needs
(Empirical)(Empirical)
Ontologies vs. Taxonomies
Urban Environment Taxonomy
IED TaxonomyDirty BombTaxonomy
Taxonomy A Taxonomy B Taxonomy C
ONTOLOGY
ETC…
Using Knowledge Representation & Reasoning (KRR) to Conjoin Taxonomies
SPAN Taxonomy (Temporal Items)
SNAP Taxonomy (Spatial Items)
Transcategorical RelationsRepresented in KRR
Example:An Intentional Act is a Psychological Actthat depends on an agent to instantiate it. It stands in a relation of dependence toother items such as neuro-biologicalstates.
Relating Ontology to Other Engineering Practices
• Ontologies inform the design of other engineering systems (e.g., agent-based sys, decision support sys, predictive analytics, etc.) by providing a structured comprehensive picture of their domains.– Many engineering practices require a more principled basis
for their design.
• Engineering systems constrain the ontology by providing inputs such as:– User needs– Domain specificity– Computational tractability
• If you give philosophers carte blanche, remember … fools and their $ are easily parted.
Higher Level FusionThe purpose of higher level fusion is to develop probable explanations of a situation based on prior knowledge and incoming transient information to produce a coherent composite picture of the current situation along with a prediction of consequences.
A dynamic situational picture is the result of reasoning about objects, attributes, aggregates, relationships and their behavior over time within a specific context.
The process of building the dynamic situational picture requires formally structured and computationally tractable domain representation.
The purpose of higher level fusion is to develop probable explanations of a situation based on prior knowledge and incoming transient information to produce a coherent composite picture of the current situation along with a prediction of consequences.
A dynamic situational picture is the result of reasoning about objects, attributes, aggregates, relationships and their behavior over time within a specific context.
The process of building the dynamic situational picture requires formally structured and computationally tractable domain representation.
What kinds of ontologies are needed for High-level fusion & STA?
• Low – level fusion can be done (to a large degree) using existing tools such as OWL, Protégé, DAML - Oil, etc.
• However, higher-level fusion processing is concerned with providing comprehensive and consistent descriptions of highly complex world states.
• Hence we need a more “industrial strength” (cf. Musen) approach than is provided by current fusion ontologies.
InterclassIntraclass
TemporalSpatial
InterclassIntraclass
TemporalSpatial
Relations Between Situational Objects at Different Levels of Granularity
Events-Events(event aggregation)
Events-Events(event aggregation)
PO- Aggregates of POPO- Aggregates of POElementary Situation-Elementary situation(ES-ES)
Elementary Situation-Elementary situation(ES-ES)
Physical objects –Physical objects (PO-PO)
Physical objects –Physical objects (PO-PO)
Aggregates- Aggregates
Aggregates- Aggregates
CES-ESCES-ES
Combinations of ES (CES) –Combinations of ES
Combinations of ES (CES) –Combinations of ES
Processes-Processes (process aggregation)
Processes-Processes (process aggregation)
Relations
• Inter - Relationships: 1) Relationships between situational items of different types. 2) Relationships between items and aggregates of items of a different type. 3) relationships between aggregates of objects of different types
• Intra - Relationships: 1) Relationships between different physical objects or their respective attributes/properties. 2) Relationships between different clusters/aggregates of objects in the same group.
• Inter - Relationships: 1) Relationships between situational items of different types. 2) Relationships between items and aggregates of items of a different type. 3) relationships between aggregates of objects of different types
• Intra - Relationships: 1) Relationships between different physical objects or their respective attributes/properties. 2) Relationships between different clusters/aggregates of objects in the same group.
Ontologize this…Ontologize this…
J O CJ IC
U U V
G P S
S A T C O M
D S PN A T IO N A L
S E N S O R
C S G
E S GS O F
C o n t r o l
E n g a g e
T r a c k ( p r e c is e p o s i t io n a n d t im e )
E n r o u t e G u id a n c e
G P S G u id a n c e
T e r m in a l G u id a n c e
F O R C E n e t2 5 A p r i l 2 0 0 3
D R A F T
L in k 4 /1 1 /1 6 /2 2C E C /V o ic e /D a t a
L in k 4 /1 1 /1 6 /2 2V o ic e /D a t a
C O M M U N IC A T IN G
S E N S I N G
CN
D
C N DM A G T F
M P F ( F )
In t r a - T h e a t e r N e t w o r k s
L o c a l P la t f o r mN e t w o r k s
J o in t S e n s o r s
S p a c e S e g m e n tN e t w o r k s
B r o a d c a s t
T a c t ic a l S e n s o r s
C o m m a n d & C o n t r o l
C A S
T a r g e t in g
M in e R e c o n n a i s s a n c e
O u t b o a r dS e n s o r
L in k 1 6 /E P L R SV o ic e /D a t a
T h e a t e r S e n s o r s
D IS N
J F A C C
J F M C C
M in eH u n t in g -
U n d e r W a t e rR e c o n n a i s s a n c e
M C M
A c o u s t icS e a r c h
2 5 A p r i l 2 0 0 3
D R A F T
C O M M U N IC A T IN G
S E N S IN G
A T T A C K IN G
B R O A D C A S T
N O C
T e le p o r t in g
Frank White (Workshop II on Ontologies and Higher-lvl Fusion – Beaver Hollow
Existing fusion ontology models often confuse Existing fusion ontology models often confuse various kinds of relationsvarious kinds of relations
Situation Awareness (SAW) Ontology Model for Battlefield Relations (C. J. Matheus, M. M. Kokar, and K. Baclawski. (2003)
Spatial Relations
Temporal Relations
It gets worse…It gets worse…
Complex Relation
Type
Examples of Important Examples of Important RelationshipsRelationships
Topology/mereology
Direction Distance Size
DisjointJointOverlapCoverReachableUnreachableContainA part of
AlongTowardsEastWestSouthNorthSimilarOpposite
FarVery farNearVery near
Small (er)Large(r)Same
SNAP relations
Relationships between time points
Before, At the same time, Start, Finish, Soon, Very soon, Resulting in, Initiating
Relationships between time intervals
Disjoint, Joint, Overlap, Inside, Equal
SPAN relations
“Close to a hospital”
“Cluster A is larger than before”
“Along the wind direction”
“Distance between Clusters A and B is smaller than before”
“Casualty cluster A overlaps with building cluster C”
Disaster Examples:
Building Reasoning Processes with Ontologies
SNAPOntology
-Spatial ItemsOf Interest
TranscategoricalOntology
(Objects + Processes)
SPANOntology
-Temporal ItemsOf Interest
Reasoning aboutrelations represented
in Ontology
FUSION
Segment of SNAP Kharkiv Nuclear Facility Ontology
Nuclear Facility
Spatial Region
Camara
Independent Substance
ImmobileSite
Home
Concertina Wire
Mine
Facility
Building
Security System
ComputerSystem
Is located at
Site
Room
Lot
Urban Region
Neighborhood
Has State
Is located at
Is controlled by
Enduring Spatial Item
contains
Mobile Item
Soldier
Combatant
Person
Hacker
Civilian
Govt. Official
Non-combatant
Mobile Site
Has role
Has role
ALpha
Alert LevelCharlie
Bravo
Delta
Law EnforcementOfficer
Fissile StorageSection
Perimeter Back Door
Aggregates of Substances
Vehicles
Groups of People
Overlaps
TNT
Segment of SPAN ontology for Kharkiv Nuclear Facility
Setting Process
Action
Attack
Physical
Nonphysical
Cyber Attack
DecideIdentify
Freindly
Hostile
Time Period
Footprinting Sniffing
Scanning Enumerating
Recon
Intruding
Root
Other
User
EscalatingPrivaledge
Service OS
Other
Rationalize
Consolidate Reassign
Standardize Specialize
Cooperate &Interoperate
PsychologicalAttack
Sabotage
InterfereObstruct
InjureDestroy
Air AttackGround Attack
Seize
Recover Capture
Destroy
Destroy Damage
Engage
Pursue
ConventionalUnconventional
Forming ofAttitudes
Ideologies
Motives
Manifested In
Enduring Item
Spatial RegionDependent Item
Independent Item
Free Portion of Space(FIAT)
Physically BoundPortion of Space(BONA FIDE)
Stationary
Affected Area
Mobile
Quality
Quasi-Quality
Substance
Structure
Aggregate ofSubstances
Resources
Active
Inactive
Affected
UnaffectedArea
Affected
Unaffected
Agent
Civilian
Military
AlternateLocation(FEMA)
Alternate Site(Business)
Alternate WorkArea
Ambulance
Available
Incident Base(Logistics)
Base SupportInstallation(Military)
Camp(Incident Personnel)
Damage
Physical
Psychological Severe-Minor
Catchment Area
Census Tract
CensusTract
Staging Area
Check-inLocations
(Resources)
HelicopterAccomodations
Capacity
Military Items
Non-MilitaryItems
Hospital
TransportationServices
Equipment
Facilities
Systems
Roads/Highways
Bridges/TunnelsAirportsSubways
Buses
Ambulances
911 Centers
HAZUS
Construction/Removal
Response/ReliefArea (Mil/Civ)
Recovery Area(Business)
Response/ReliefAreas (Mil/Civ)
Recovery(Business)
CommandCenter
(Temporary)
IncidentCommand
Post/Center
Contents
Structural
Food
Clothing
Furniture
MajorAppliances
ContingencyPlanning Zone Severe
Crew Transport
EmergencyResponse Vehicle
Police Car
DisasterVolunteer
Moderate
Light
Designated Area(President)
Quasi-Area??
Crew Leader
DisasterCoordinating Officer
Disaster FieldOffice (DFO)
(FEMA)
Disaster Prone
BusinessRecovery
Coordinator
CoordinatingAuthority
DisasterVulnerability
Dispatch Center(Gen. Resources)
DisplacedPersons
Emergency(State of)
Foreign
Domestic
Enemy AttackInsurrection
Civil Disturbance
Earthquake
Fire
FloodMudslide
Donor
Donor
FacilitiesServices
materials
Funds
FacilitiesServices
materials
Funds
Dwelling
Home/HouseMobile Home
ApartmentHouse Boat
Non-Dwelling
Business/Commercial
PropertyBarn
Retaining WallWind Mill
Fault Line
Instrument SeismographSeisometer
Seismogram
Medical
Emergency Doctor
Emergency Nurse
Emergency MedicalTechnician (EMT)
Police
Fire
Emergency MedicalTechnician-Paramedic(EMT-P)
Govt. Official
State
Local
Federal
EmergencyOperations
Center (EOC)(Civil Govt.)
IncidentCommand System
(Facilities)
Emergency Shelter
Hypocenter Epicenter
Evacuation Area
Evacuees
Unaffected
Affected (Victim)
Displaced PersonRefugee
Evacuee
Casualty
Client (RedCross)
EmergencyPatient
Family
Injury
Level 1
Level 2
Level 3Level 4Bodily Death
Federal ResponseCenter (FEMA)
Class A (combustible solids)
Class B (gasses/liquids)
Class C (electrical equip)
Class D (combustible metals)
Focal Zone
Focus
Earthquake Area
General Pain/Suffering
Health Facility
Health Facility
Helibase
Helipad
Alternate Site
High Hazard Area(planning purposes)
Impact Area
Hot Site
Computing Facilities
TelecommunicationsFacilities
EnvironmentalInfrastructure
Individual (solemember of household)
Malnourished
RadiationExposureChemicalExposure
Trauma
TransportationMedical
Inpatient Beds
PersonnelHospital
Public
Military Personnel
Internal
External
Recovery Site
Interim Site(Temporary)
New Home Site
Response/ReliefAreas (Mil/Civ)
Recovery(Business)
Original HomeSite
Items ofAssistance
(Red Cross)
Goods
Services
JointInformationCenter (JIC)(News media)
Message Center
MobilizationCenter
(Temporary)
Oil
Off-site Storage
Duplicate VitalRecords
DuplicateDocumentation
On-Scene Coordinator(Hazardous Substance
Removal)DoD
USCGEPA
DoE
Operating Site StructuralCollapse
OperationalFacilities
PackagedDisaster Hospital
200-Bed Hospital
ShelterShort-Term
Long-Term
Receiving Area
Receiving Area
Reception CenterEvacuee
RegistrationNeeds
Assessment
RegionalOperations
Center (ROC)
ROC(post DFO)
Rescue Company(Specified Equip.)
Rescue Medical(Gen. Vehicle)
Risk Area(PlanningPurposes)
RiskHazard/Disaster
Type
Hazard/DisasterIntensity
Risk Map(Representation)
Rumor ControlCenter
Federal CoordinatingOfficer
State CoordinatingOfficer
Scientific SupportCoordinator
(SSC)
National Oceanic andAtmospheric
Administration (NOAA)
EnvironmentalProtection Agency (EPA)
Seismic Zone
SeismographStation
Red Cross Crew Leader
Scientist Seismologist
Shelteree
Shelter Manager
Situation Room
Situation Room
Spontaneous
Local
FoundationFloors
Load-bearingWalls
Ceiling
Roof
Fixed Utilities
GasElectricWaterSewage
Heating/CoolingSystems
SevereModerate
Light
Supply EmergencyResponse Vehicle
(SERV/SRV)
Logistics InitialResponse Vehicle
(LIRV)
Basic Supplies
Forms
Office Equipment
TargetPopulation
TemporaryHousing
HotelMotel
Rental Housing
Red CrossFacility
TransportAccident(State of)
Air
Road
Boat
Rail
Vulnerability(State of)
Event
Hazard
Demographics
Age ofEnvironmentResilience ofEnvironmentTechnology
Social DiversityRegional
EconomicsGlobal
Economics
Politics
Warm Site
Cold Site
Loss(State of)
Materials
Contents
Power OutageComputer Sys.
(Network)
Terminals
Workstations
Processors
Quality Scale(Metric)
State
Scope(of Disaster)
Total Affected
AffectedJurisdictions
Resources Neededfor Effective
Response
InjuredAffectedHomeless
Power
Force ofEarthquake
Cost/Price
Business Interruption
GovernmentalLevel of DisasterRelief Operation
(Red Cross)
Level 1 <$10,000
Level 2 <$50,000
Level 3 <$250,000
Level 4 <$2.5 Mill.
Level 5 $2.5 Mill. +Simluation
System Model
Mathematical
Animal
Other
Simluation
Simluation
State of Water,Gas, Electricity
Systems
State ofTransportationInfrastructure(passability,
traffic)State of
GeographicalFeatures/
Earth,Vegetation
Location, State ofPopulation(Casualties,Evacuees)
Question toEric: Is this civilinfrastructure?
Are youshowing civilinfrastructureelsewhere? Ifnot, it might be
useful torepresent it.
Question for Eric:What does this
mean?
LandAtmosphere
Hospital
Location,State,
Capacityv.Load ofFixed and
MobileResources
Location, State ofPopulation(Casualties,Evacuees)
Location,State,
Capacityv.Load ofFixed and
mobileResources
State of Water,Gas, Electricity
Systems
I am not sure about this one
CivilInfrastructure
CivilianResponders
Location,State,
Capacityv.Load ofFixed and
MobileResources
Planning andIntelligenceProcesses
Location, State ofPopulation(Casualties,Evacuees)
AmbulanceDispatchCenter/System Fire Stations
PoliceStations
Pre-IncidentDatabases
MedicalPersonnel
FirePersonnel Rescue
Personnel
PoliceOfficers
Fire Rescue/EMT
TransportationInfrastructure
CommunicationsInfrastructure
Location, State ofBuildings, Type of
Construction
Also, need torepresent state
and type ofconstruction
Eric: what about physical “damage” toparts of communications system ?
Economicbalance???
Risk v. benefitbalance ???
Small Representative Sample of the SNAP Dis-ReO Ontology w/ CWA
Bisantz, A., Rogova, G., Little, E. (2004) “On the Integration of Cognitive Work Analysis within a Multisource Information Fusion Development Methodology,” Proceedings of the Human Factors and Ergonomics Society Annual Meeting, New Orleans