Semantic Web for the Military User C2 Applications Breakout Report 11/14/01.

Semantic Web for the Military User

C2 Applications Breakout

Report

11/14/01

C2 Apps Participants

Mike Dean BBNRob Rasch BCBL-L (Army)Mike Rimmer NWDCMark Gorniak AFRLKen Whitebread LMSC/ATLFrank White SSCMartha Kahn Global InfotekHal Hultgren NWDCPaul Neves BBNLee Lacy DRCTom Martin RME

Objectives

• Explore Command and Control Applications for DAML developments, both long and short term– What are ways in which we can best explore

the value of DAML for C2 functions

Framework: Expeditionary Sensor Grid

C2 Applications Outbrief Framework - ESG

• Control of systems/sensors/and networks– With auto registration, knowledge of capabilities, can more

intelligently control for optimal or appropriate coverage for the mission at hand for planning, and adaptation to changing conditions.

• Infrastructure Applications– Semantic interoperability of systems, dynamic reconfiguration

with “understanding” at the machine level of the implications

• Sensor Applications– Smart Sensors communicating with one-another

• E.g., unattended acoustic/IR… aerial, ground, or underwater sensor (one of potentially thousands)

– Fusion, aggregation and reporting

Expeditionary Sensor Grid

• Objective: – Many cheap sensors, netted, fused, aggregated and

managed• Air, Ground, Maritime, not uniquely Naval, but essential

for assuring access to the litoral

– Requirements at sensor, network, and system control levels

– Sensor Fusion, Sensor Management, Communications Management, all issues requiring automotion

DAML in Expeditionary Sensor Grid(ESG) for Data and Information Fusion

ESG - A sensor grid architecture that integrates sensors, networks, decision aids, warriors and supporting systems into a highly adaptive comprehensive system that operates from the surface to space and from sea to land.

Widely varying heterogeneity, thousands of sensors and sources - coalition, legacy and emerging systems and sensors

Fusion will require many more operators than practical and automation of fusion will depend on software agents

DAML Contribution Referenced metadata regarding sensor

characteristics, performance and reliability (pedigree), and decision-needs context for multiple heterogeneous sensors/sources/systems enabling high level automated (agent-based) fusion.

FY 02 ESG Enabling Experiments Assess DAML markup utility for enhancement of fusion Explore bandwidth overhead and scalability issues.

Sensor Processing Stream using fixed structure, XML, and DAML

Sensor d specification

Algorithm description…

Sb` Sc Szz

Sa`

Sa`

Sa`

Sa`

TimeSeries

Sensor FusionProcessor

Event Time/Freq, Intensity, Shape Features, Sensor Data

C2 Fusion

ClassificationConfidenceLocalizationTracks+ Event Data

Sd Se……...

Heterogeneous Sensors

Sensor c specification

Algorithm description…

Sensor b specification

Algorithm description…

Semantic Resources

Fixed DataStructure XML DAML

DAML in Sensor Fusion

DAML in Sensor Fusion

Sensor Processing Stream using fixed structure, XML, and DAML

Sb`

S

c

S

zzTimeSeries

Event Time/Freq, Intensity, Shape Features, Sensor Data

Existence of objectClassificationConfidenceLocalizationTracks+ Event Data

S

d

S

e

…...

Heterogeneous Sensors and Sources

Sensor c specification

Pedigree

Algorithm description

“Unit definition”

Decision Context

…

Semantic Resources

Fixed DataStructure, XML

DAML

DATA AND INFORMATION FUSION (Client and Services?)

Level 0 Signal Data Refinement

Level 1

Object Refinement

Objects

Le

ve

l 4

R

es

ou

rce

Re

fin

em

en

t

Object Base

Situation

Visualization, Management

Level 2Situation Refinement

Level 3Impact Situations

ImpactsHigh

Low

INF

ER

EN

CE

LE

VE

LSensor b specification

Pedigree

Algorithm description

“Unit definition”

Decision Context

…

Sensor a specification

Pedigree

Algorithm description

“Unit definition”

Decision Context

…

HUMINTOpen Source…

?

?

By the way

• XML = 10x hard code

• DAML = 2x XML

• Jini/Java breakpoint

Recommendations/Actions

Communications

• For ESG, smart agent needed for dynamic communications management to do reasoning about the network – to support the smart agent operation, need:– Comms ontology from Operational Level to

Tactical Level (see next slide)– Identify boundaries of sensor nets, etc.

Ontology Development

• Ontology from Operational Level (CJTF) to tactical level (weapons on target) for supporting modeling of sensor/ communications/ information management needs– Benefits to ESG

• Experiment design• System Concept Testing• Once refined, system design, and construction

– Ties to many many other needs• Leverage of Doctrine/TTP/Lessons Learned/Training

Experimentation (General)

• Experimentation (EEE)– For both Communications and Fusion

applications, refine the CoABS Grid DAML interfaces for Utility for• Dynamic Communications

• Sensor Management

• Sensor Fusion

DAML For Fusion

• EEE Experimentation– Explore the Depth of where DAML markup makes the

most sense

– Explore Jini/Java (I.e., Grid) object translation to DAML

• Research – Assess DAML tools for the multiple layers from the

physical to the information management• Bandwidth tradeoffs, etc.

– Modeling DAML/assessing utility in the mobile environment

Homeland Security

• Will you provide a wish-list of ontologies?

• Can you help with exporting data in DAML– Ultimate goal – can assess introducing DAML

at lower level in process for ultimate use in agent applications

– Nearer term• Researchers could work with data

• Will help with developing other (ESG) sensor related data