Develop new methods to fuse hard sensor data Develop understanding of hybrid human cognition and automated processing for improved situational awareness Establish test and evaluation approach and associated data sets Create an integration environment for team collaboration, T&E, and transition Establish a framework for human-centric fusion Develop a T&E approach progressing from synthetic data to human in the loop experiments Create an architecture and infrastructure for algorithm integration and transition Design and implement algorithms for fusion of physical sensor data including new sensor types Evolved SYNCOIN: new meta-data/sensor data Generated TML for 4 th year demonstrations Performed new hard sensor data processing Developed data visualization toolkit Conducted concept/cognitive analysis Developed automated inference tools including Complex Event Processing & Intelligent Agents Demonstrated utilization of SYNCOIN data in AXISPro ta
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1
Objectives Develop new methods to fuse hard sensor data
Develop understanding of hybrid human
cognition and automated processing for
improved situational awareness
Establish test and evaluation approach and
associated data sets
Create an integration environment for team
collaboration, T&E, and transition
Scientific/Technical Approach Establish a framework for human-centric fusion
Develop a T&E approach progressing from
synthetic data to human in the loop experiments
Create an architecture and infrastructure for
algorithm integration and transition
Design and implement algorithms for fusion of
physical sensor data including new sensor types
Accomplishments Evolved SYNCOIN: new meta-data/sensor data
Generated TML for 4th year demonstrations
Performed new hard sensor data processing
Developed data visualization toolkit
Conducted concept/cognitive analysis
Developed automated inference tools including
Complex Event Processing & Intelligent Agents
Demonstrated utilization of SYNCOIN data in
AXISPro
ta
PSU Overview & SYNCOIN David Hall, Jake Graham, Jeff Rimland, Rick Tutwiler
and Guoray Cai
PSU/UB Sensemaking Architecture
Hard sensor fusion
Visual Analytics Workbench
Cognitive Task Analysis
Complex Event Integration
3
Text Entities
Activities
Locations
Attributes
Human
Observers
Physical
Sensors
Computer
Aided Human
Encoding (HE)
Defined fuzzy
relational operations
Fused Hard
Data (Entities)
Co
mp
ute
r a
ssis
ted
Hu
ma
n m
eta
-da
ta g
en
era
tio
n
RDF-like
triples
Auto Correlation
(ID/loc)
Me
ta-D
ata
Ba
se
Visual Analytics Workbench Hard Sensor Fusion
Analyst input
PIRs
RFIs
I&W
Working
Hypotheses
etc
1. 1.
2.
3.
4.
PSU Processing Flow and
Functions
Overview of PSU 4rd Year
Accomplishments
1. Synthetic hard/soft data set Continued evolution of the SYNCOIN data set
New physical sensor data
New soft and hard sensor data links and meta-data
Conducted human in the loop cognitive task analyses
2. Hard sensor data fusion New algorithms for fusion of hard sensor data
Range imaging tracking, (Interacting Multiple Mode (IMM) Kalman Filters) Tracking
VNIR Color Particle Filter Tracking
VNIR Image fusion and Multi-Model Object characterization
Range/Depth Automated Segmentation Algorithm
3. New automated inference tools Intelligent agents for improved focus of analyst attention