Personal Content Management on PDA for Health Care Applications

Personal Content Management onPersonal Content Management on PDA for Health Care ApplicationsPDA for Health Care Applications

http://mobmed.axmedis.org

Pierfrancesco Bellini Ivan Bruno DanielePierfrancesco Bellini, Ivan Bruno, Daniele Cenni, Paolo Nesi, Michela PaolucciDISIT Lab: Sistemi Distribuiti e Tecnologie Internet

Dipartimento di Sistemi e InformaticaUniversità degli Studi di FirenzeUniversità degli Studi di Firenze

[email protected], http://www.disit.dsi.unifi.it

1SCMS, Berkeley, CA, USA, Sept. 2009

OutlineOutlineScenariosScenariosMobile Medicine Content Examples Content Access and technical requirementsIntelligent contentIntelligent contentAXMEDIS format and modelThe architecture of Mobile MedicinePDA Organizer for contentPDA Organizer for contentMobile Medicine: Content productionConclusions

2SCMS, Berkeley, CA, USA, Sept. 2009

Scenarios of Mobile MedicineScenarios of Mobile Medicine intelligent solution in the hands of doctors and assistants for:

Continuous Medical Educations, CME, during the doctor life and continuous update;Calculation of dosages, status/conditions, risks,..g , , ,Education: medical University/School level;Emergency help medical personnel to take g y p pdecisions and remind procedures/protocols, etc.;Collect data from patients that cannot be easily collected p yor that are too expensive to be collected with mobile instruments; ;EPR: Electronic Patient Record report, excerpts

Simple, usable and accessible OFF-LINEp ,3SCMS, Berkeley, CA, USA, Sept. 2009

Mobile Medicine: Content examplesMobile Medicine: Content examplesContent Examples:

Educational:Sliding Shows, video, document, audio, images…

Procedures/protocols: (mini applications)Emergency routinesEmergency, routines, …

Dosages for intensive therapy: (mini applications)Formulas ranges different application casesFormulas, ranges, different application cases

Calculators for several aspects: (mini applications)Risk analysis, …e.g.: pulmonary emboli…. Classification of conditions/damages, …

Needs of customizing:user interface, behavior, accessibility rights, etc.user interface, behavior, accessibility rights, etc.

4SCMS, Berkeley, CA, USA, Sept. 2009

Mobile Medicine Content

5 5

Mobile Medicine Content AccessMobile Medicine Content AccessCollect content on their mobile device, PDAAccess to personal collection in any conditionsN i t i t th ll ti i l iNavigate into the collection via several views:

medical, taxonomy, classif., description, etc.Use data based: less used, most, recent, etc.

Querying into the collectionQuerying into the collectionKeep updated the content collection automatically Keep the same content accessible on PC/PDALicensing and rights controls to access and useLicensing and rights controls to access and use (patience info and/or record)

6SCMS, Berkeley, CA, USA, Sept. 2009

Technical Content RequirementsTechnical Content Requirementshave to be indexed with all its metadata and semantic information i t th l l d t binto the local database

may arrive into the device via any channel and solutionhas to be automatically updated into the device without the userhas to be automatically updated into the device without the user interventionmay present links with other content elements

may change behavior on the basis of user preferences/profile, device capabilities, network capabilities, general context description device statuscontext description, device status

may request to user to provide info; e.g.: collection of patient data perform actions on a checklists doe.g.: collection of patient data, perform actions on a checklists, do annotations, to create a multimedia scrapbooks, to provide user generated content, etc

i t ith t lmay communicate with some central server some messages; for example: to mark that a content segment has been completed, report obtained data, decision taken, or possibilities browsed, ..obtained data, decision taken, or possibilities browsed, ..

7SCMS, Berkeley, CA, USA, Sept. 2009

Intelligent Content gA number of cross media content formats: SCORM, MXF, NewsML, MPEG-21, Flash, HTML, etc.Major Issues for cross media content (DMS 2008):Major Issues for cross media content (DMS 2008):

Packaging: Metadata and descriptors + essencesDi ib i d l d i i P2PDistribution: download, streaming, progressive, P2P,..Hierarchical nesting levels: IPR, Metadata, etc.gIntelligence: profiling, decision, scripting Tools: Players and Authoring toolsTools: Players and Authoring toolsAutomated production, repurposing, delivering Protection: CAS vs DRM…

. 8

SCMS, Berkeley, CA, USA, Sept. 2009

Interactive and intelligent contentFinal usersFinal users

Browse, searchNew content formatsNew TV formats User generated

proactiveintegrated media infoproactive with the Multichannel

p

pusersattractive experience

User generatedpersonalized multichannel interoperabledevice interoperable

Saving experience

9

p

AXMEDIS Object/Package Modelmandatorymandatory special B2B metadataspecial B2B metadata

unique unique identificationidentification

content descriptioncontent description

AxOIDAxOID + ….+ …. AxInfoAxInfo

A D bli CA D bli C

AxObjectAxObjectAxMetadataAxMetadataAxMetadataAxMetadataAxMetadataAxMetadata

AxDublinCoreAxDublinCore

AxObjectAxObjectAxMetadataAxMetadataAxMetadataAxMetadataAxContentAxContentAxContentAxContent AxResourceAxResource

AxObjectAxObjectMPEG21Di it l It

AxMetadataAxMetadataAxMetadataAxMetadataAxMethodsAxMethods AxObjectAxObjectresource embeddingresource embedding AxReferredAxReferred

Digital Item AxMetadataAxMetadataAxMethodsAxMethods

jjAxReferredAxReferredObjectObjecthierarchical compositionhierarchical composition

external content referencingexternal content referencing

A M th dA M th dI t lli t l i &I t lli t l i & b h ib h i

10

AxMethodsAxMethodsIntelligent, logic & Intelligent, logic & behaviorbehavior

Examples: Intelligent ContentSingle Files:

audio, video, documenti, immages, etc..

Interactive Content:HTML or SMIL as technology ofHTML or SMIL as technology of User interactionGuides, games, etc.Valoriz. of Cultural HeritageValoriz. of Cultural Heritage content Educational Content

Proactive Wizard:Proactive Wizard:Video messg. Recording, UGCAssisted upload Production of licensesProduction of licenses User profile processingTaking decisionLocal indexing/searchingLocal assistant….

11

AXMEDIS/MPEG-21AXMEDIS/MPEG 21 Structure: hierarchical, links, etc.Distribution: download, p2p, progressive, streamClassification: DC, taxonomy, any MD, descriptorsy y pIdentification: any IDs, for DRM AXOIDBehavior: change on the basis of context descriptorsBehavior: change on the basis of context, descriptors, axmethod codeProcessing: axmethod as in the AXCP pluginsProcessing: axmethod as in the AXCP, plugins,..Presentational/interaction: SMIL, MPEG-4, HTML, …

Activation of methods formsActivation of methods, forms, File format: direct play without unpack of video, ….DRM/ t i MPEG 21 d l d AXMEDIS i l t tiDRM/prot via MPEG-21 models and AXMEDIS implementationAnnotations: possible

12SCMS, Berkeley, CA, USA, Sept. 2009

Mobile MedicineAutomated Back officeBack office

-PC, MACos, linux, …-iPhone, iPod,

Complex content

Windows Mobile, Android(*), ….

Complex content

13SCMS, Berkeley, CA, USA, Sept. 2009

Mobile MedicineMobile MedicineMonitoring &

AXCP Quick Start, Yo r tools commands

AXMEDIS DRM Server

gReporting Your tools commands,

Workflow systems,…

AXCP Scheduler Mobile Medicine

AXCP GRID Internet, WEB, VOD, POD..

AXCP NodeAXCP Node

WEB Server for PC and Mobile,

Content UploadFTP, WS, etc.

databases

Content UploadAXCP Node Mobiles, PDA, etc.

AXMEDIS AXCP GRID backoffice server: semantic computingp gAXMEDIS DRM: for Rights control and security Mobile Medicine portal for the multichannel distribution: p

PC, PDA, iPhone, iPod, mobile, etc.Production tools and players, for PC and PDA

14SCMS, Berkeley, CA, USA, Sept. 2009

Personal Mobile Social IntelligenceAxObjectFinder

HTML & CSS Based Presentation Engine AxPDAPlayer

En

gin

e

my /u

pd

ate

M

hav

ior

n ua

lio

n

Media Player

PDF player

ore

r

ow

ser

Se

arc

h E

Taxo

no

mB

row

ser

Do

wn

loa

d/

an

ag

er

Use

r B

eh

co

llec

tio

Co

nte

xtu

info

rmat

i

….. player

File

Exp

lo

Lo

ca

l Bro

Content Indexer, semantic ingestion/processing

SQLite DBLocal PDA files

SCMS, Berkeley, CA, USA, Sept. 200915

Semantic flows

•User Profile•User behavior

•Local User Profile•Local User behavior•User behavior

•Use data•Content

DC ID

•Local User behavior•Local Use data•Content

DC ID

+ Content action data

•DC+IDs•AXInfo: ver, prod., rights,..

•DC+IDs•AXInfo: ver, prod, rights, ....

•Descriptors•Taxonomy•Groups

•Descriptors•Taxonomy•GroupsG p

•Recommendation •Suggestions on the basis of user behavior

G p•Local Recommendation •Local Suggestions on the basis of user behavior and

16

basis of user behavior basis of user behavior and local content

SCMS, Berkeley, CA, USA, Sept. 2009

ConclusionsAccessible since June 2009 Several objects and mini-applications,

calculators for dosages verification etccalculators for dosages, verification, etc. Intelligent Content Organizer for PDA WM5/6

Medical taxonomy allows to make navigation into contentlocal recommendationsOffline/onlineOffline/online

iPhone supported viaregular portal, only for online

17SCMS, Berkeley, CA, USA, Sept. 2009

Content Production User: Automated

backoffice:User: upload/propose

Single file content directly

backoffice:Transcode, adapt,

..

directly

ADMIN, validate, send in

publication

User: study andUser: study and design complex

content, then upload

Produce the

upload

complex content with authoring tool

18SCMS, Berkeley, CA, USA, Sept. 2009

Mobile Medicine AxObjectFinder

Suggestions on the basis of user behavior

19

Some referencesMobile Medicine: http://mobmed.axmedis.orgp g

Manuale: http://mobmed.axmedis.org/Mobile-Medicine-Manual.pdfDevelopment and production tools

AXMEDIS: http://www.axmedis.orgReport and documentation, development tools and demos

DISIT L b U i Fi DSI htt // di it d i ifi it/DISIT Lab, Univ. Firenze, DSI: http://www.disit.dsi.unifi.it/P. Bellini, I. Bruno, A. Fuzier, P. Nesi, M. Paolucci, “Semantic Processing and Management for MultiChannel Cross Media Social Networking”, NEM g g ,conference, Saint Malo, France, September 2009. ----this paper----: P. Bellini, I. Bruno, D. Cenni, P. Nesi, M. Paolucci, "Personal Content Management on PDA for Health Care Applications" 2009"Personal Content Management on PDA for Health Care Applications", 2009 IEEE International Workshop on Semantic Computing and Multimedia Systems (IEEE-SCMS 2009), Berkeley, CA, USA - September 14-16, 2009

20Congresso SIAARTI, Firenze, Agosto 2009

Personal Content Management onPersonal Content Management on PDA for Health Care ApplicationsPDA for Health Care Applications

http://mobmed.axmedis.org

Pierfrancesco Bellini Ivan Bruno DanielePierfrancesco Bellini, Ivan Bruno, Daniele Cenni, Paolo Nesi, Michela PaolucciDISIT Lab: Sistemi Distribuiti e Tecnologie Internet

Dipartimento di Sistemi e InformaticaUniversità degli Studi di FirenzeUniversità degli Studi di Firenze

[email protected], http://www.disit.dsi.unifi.it

21SCMS, Berkeley, CA, USA, Sept. 2009