Page 1
1 © Simon Buckingham Shum
Hypermedia Discourse & Human-Agent Knowledge
Cartography
Simon Buckingham Shum
Knowledge Media Institute & Computing Research Centre
The Open University, Milton Keynes, UK
www.kmi.open.ac.uk/people/[email protected]
NASA-Ontolog-KMWG OKMDS mini-series Session-06 - Thu 17-April-2008 http://ontolog.cim3.net/cgi-bin/wiki.pl?ConferenceCall_2008_04_17
Page 2
2 © Simon Buckingham Shum
Hypermedia
Discourse
Page 3
3 © Simon Buckingham Shum
HypermediaModelling discourse relationsExpressing different perspectives on a conceptual spaceSupporting the incremental formalization of ideas Rendering structural visualizationsConnecting heterogeneous content
Page 4
4 © Simon Buckingham Shum
DiscourseVerbal and written workplace communicationDiscourse communities: “making and taking perspectives”DialogueArgumentation Claim makingAnalytical narrativeMeetings
Page 5
5 © Simon Buckingham Shum
Notation(s)
IntuitiveUser Interface
ComputationalServices
Literacy/Fluency
DiscourseOntology
Hypermedia Discourse research
Page 6
6 © Simon Buckingham Shum
CompendiumCompendium
• personal or group personal or group concept mappingconcept mapping
• real time meeting real time meeting capture capture
• participatory participatory modelling modelling
• discourse as discourse as semantic hypertextsemantic hypertext
Page 7
7 © Simon Buckingham Shum
Discourse grounded in Horst Rittel’s IBIS:Issue-Based Information System
Page 8
8 © Simon Buckingham Shum
Compendium: hypertext discourse mapping/conceptual modelling
Page 9
9 © Simon Buckingham Shum
Compendium: hypertext discourse mapping/conceptual modelling
Page 10
10 © Simon Buckingham Shum
Compendium: Descendent of gIBIS
Page 11
11 © Simon Buckingham Shum
Modelling using Issue-templates
Page 12
12 © Simon Buckingham Shum
Modelling organisational processes in Compendium using a Template
Page 13
13 © Simon Buckingham Shum
Completing a Compendium template
Page 14
14 © Simon Buckingham Shum
Generating Custom Documents and Diagrams from Compendium Templates
BuildAssignableInventory
AssignableInventory
Deviations/Changes
(Engr Sched)Approvals
Integrated/Revised
Requirements
FieldSpecific
Assignments/Assignment
List
InstallationDetails/
Specs/NDO
AssignableInventory
Notice (E1)
Page 15
15 © Simon Buckingham Shum
Structure management in Compendium
Associative linkingnodes in a shared context connected by graphical Map links
Categorical membership nodes in different contexts connected by common attributes via metadata Tags
Hypertextual Transclusion reuse of the same node in different views
Templates reuse of the same structure in different views
HTML, XML and RDF data exports for interoperability
Java and SQL interfaces to add services
Page 16
16 © Simon Buckingham Shum
Using Compendium for personnel recovery planning
Example of Conversational Modelling:real time dialogue mapping combined with model
driven templates (AI+IA)
Co-OPR Project (with Austin Tate): http://www.aiai.ed.ac.uk/project/co-opr
Page 17
17 © Simon Buckingham Shum
Mission Briefing: Intent template
Answers to template issues provided in the JTFC Briefing. Answers may be constrained
by predefined options, as specified in the XML schema
Page 18
18 © Simon Buckingham Shum
Capturing political deliberation/rationale
Dialogue Map capturing the
planners’ discussion of this
option
Page 19
19 © Simon Buckingham Shum
Planning Engine input to Compendium
Issues on which the I-X planning engine provided candidate Options
Page 20
20 © Simon Buckingham Shum
Modelling a document corpus:The Iraq Debate
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
http://kmi.open.ac.uk/projects/compendium/iraq
Page 21
21 © Simon Buckingham Shum
Annotating a document corpus:Chomsky’s article in the Iraq Debate
http://kmi.open.ac.uk/projects/compendium/iraq
Page 22
22 © Simon Buckingham Shum
Large scale NASA e-science field trials:
Interoperability with other databases, software agents and collaboration tools
www.kmi.open.ac.uk/projects/coakting/nasa
Clancey, W.J., Sierhuis, M., Alena, R., Berrios, D., Dowding, J., Graham, J.S., Tyree, K.S., Hirsh, R.L., Garry, W.B., Semple, A., Buckingham Shum, S.J., Shadbolt, N. and Rupert, S. (2005). “Automating CapCom Using Mobile Agents and Robotic Assistants.” 1st Space Exploration Conference, American Institute of Aeronautics and Astronautics, 31 Jan-1 Feb, 2005, Orlando, FL. Available from: AIAA Meeting Papers on Disc [CD-ROM]: Reston, VA, and as Advanced Knowledge Technologies ePrint 375: http://eprints.aktors.org/375
Page 23
23 © Simon Buckingham Shum Image Credits--- Mars: NASA/JPL/MSSS; Earth: NASA/JSC; Composite: MSSS
Page 24
24 © Simon Buckingham Shum
NASA e-science field trials (2004 and 2005)
Distributed Mars-Earth planning and data analysis toolsfor Mars Habitat field trial in Utah desert, supported from US+UK
www.kmi.open.ac.uk/projects/coakting/nasa
Page 25
25 © Simon Buckingham Shum
NASA Mobile Agents Architecture
Page 26
26 © Simon Buckingham Shum
Collaboration Configuration
Scientist (Mars)
Scientist (Earth)
Scientist (Earth)
Scientist (Mars)
Scientist (Earth)
Software Agent
Architecture (Mars)
Compendium used as a collaboration medium at all intersections: humans+agents, reading+writing maps
RST-telecon-2005-04-11.i.avi
00:49:08
Page 27
27 © Simon Buckingham Shum
NASA testbed:Compendium activity plans for surface exploration, constructed by scientists on ‘Earth’, interpreted by software agents on ‘Mars’
The Compendium nodes and relationships in this plan were interpreted by Brahms software agents for monitoring and coordinating astronaut and robot activity during surface explorations.
Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission
RST-telecon-2005-04-11.i.avi1:11:57
Page 28
28 © Simon Buckingham Shum
CoAKTinG NASA testbed:Compendium science data map, generated by software agents, for interpretation by Mars+Earth scientists
The Compendium maps were autonomously created and populated with science data by Brahms software agents that use models of the mission plan, work process, data flow and science data relationships to create the maps.
Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission
Page 29
29 © Simon Buckingham Shum
CoAKTinG NASA testbed:Compendium-based photo analysis by geologists on ‘Mars’
Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission
Page 30
30 © Simon Buckingham Shum
NASA testbed:Compendium scientific feedback map from Earth scientists to Mars colleagues
Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission
Page 31
31 © Simon Buckingham Shum
Collaborative sensemaking in e-Science:Meeting Replay tool for Earth scientists, synchronising video of Mars crew’s discussion as they annotate their mission plans
Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission
NASA MR Clip: 00:50
Page 32
32 © Simon Buckingham Shum
Memetic Meeting ReplayThe CoAKTinG project’s results are now mainstreamed in the Access Grid by the JISC Memetic VRE project
Page 33
33 © Simon Buckingham Shum
Memetic Meeting ReplayThe CoAKTinG project’s results are now mainstreamed in the Access Grid by the JISC Memetic VRE project
Page 34
34 © Simon Buckingham Shum
In Gutenberg’s shadow (or standing on his shoulders)
Philosophical Transactions of the Royal Society of LondonMarch 1665
Le Journal des SçavansJanuary 1665
Newspapers + Invisible Colleges = Scholarly Journals[Information Technology] + [Social Networks] = Knowledge Medium
Page 35
35 © Simon Buckingham Shum
Jumping forward 343 years…
Buckingham Shum, S. (2007). Digital Research Discourse? Computational Thinking Seminar Series, School of Informatics, University of Edinburgh, 25 Apr. 2007. http://kmi.open.ac.uk/projects/hyperdiscourse/docs/Simon-Edin-CompThink.pdf
Page 36
36 © Simon Buckingham Shum
…digital paper!
2008… Ideas and arguments (=knowledge claims) are now digital…
Page 37
37 © Simon Buckingham Shum
Paper: “The Scent of a Site: A System for Analyzing and Predicting Information
Scent, Usage, and Usability of a Web Site”
“Web User Flow by Information Scent (WUFIS)”
Paper: “Information foraging”
“Information foraging theory”
“Information scent models”
“People try to maximise their rate of gaining information”
?
applies
Beyond document citations…These annotations are freeform
summaries of an idea, as one would find in researchers’ journals,
fieldnotes, lit. review notes or blog entries
These annotations are freeform summaries of an idea, as one would
find in researchers’ journals, fieldnotes, lit. review notes or blog
entries
Addressable triple which can be contested
e.g. supported/challenged
Addressable triple which can be contested
e.g. supported/challenged
Method
Theory
Claim
Making formal connections between
ideas creates a semantic citation network —> novel
literature navigation, querying and visualization
Making formal connections between
ideas creates a semantic citation network —> novel
literature navigation, querying and visualization
Page 38
38 © Simon Buckingham Shum
Combining formal relations with the expressive freedom of ‘folksonomies’Relational classes and dialects (KMi Scholarly Ontologies project)
Page 39
39 © Simon Buckingham Shum
If we model concepts in a literature as concept maps… (KMi’s ClaiMapper, built on Compendium)
Page 40
40 © Simon Buckingham Shum
“Semantic del.icio.us”: KMi’s ClaimSpotter assigning and linking freeform tags
Sereno, B., Buckingham Shum, S. and Motta, E. (2007). Formalization, User Strategy and Interaction Design: Users’ Behaviour with Discourse Tagging Semantics. Workshop on Social and Collaborative Construction of Structured Knowledge, 16th Int. World Wide Web Conference (WWW 2007), Banff, 8-12 May 2007. http://www2007.org/workshops/paper_30.pdf
Page 41
41 © Simon Buckingham Shum
Visualising claims and arguments
claimfinder.open.ac.uk
When multiple analysts annotate web documents via a server, they can generate a shared view of how they see the field, and where they agree/disagree
Page 42
42 © Simon Buckingham Shum
“Semantic Google Scholar” KMi’s ClaimFinder
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
Page 43
43 © Simon Buckingham Shum
Lineage tree (the roots of a concept)
Page 44
44 © Simon Buckingham Shum
Adding Web 2.0 functionality to an open platform for mapping concepts and arguments
Cohere: http://cohereweb.net
<demo>
Page 45
45 © Simon Buckingham Shum
Cohere: creating a new Idea for Google’s “Knol”, linked to a website
Page 46
46 © Simon Buckingham Shum
Cohere: embedding an Idea in a blog
Page 47
47 © Simon Buckingham Shum
Cohere: raising issues about Google’s “Knol” Idea
Page 48
48 © Simon Buckingham Shum
Cohere: from tag clouds to idea webs
Page 49
49 © Simon Buckingham Shum
Cohere: all incoming and outgoing links from a focal Idea
Page 50
50 © Simon Buckingham Shum
Cohere: extensible connection language doesn’t lock users into one ontology
Page 51
51 © Simon Buckingham Shum
Cohere: Argument from Expert Opinion with Critical Questions
Page 52
52 © Simon Buckingham Shum
Cohere: semantically filtering a focal Idea by “contrasting” connections
Page 53
53 © Simon Buckingham Shum
Cohere: a mashup visualization merging different connections around a common Idea
Page 54
54 © Simon Buckingham Shum
Cohere: homepage integrates People, Ideas and Connections
Page 55
55 © Simon Buckingham Shum
Social Software vs Argumentation?
Social Software Argumentation Tools
social work
v. rapid highly reflective
v. low learning required
purpose
pace
entrythreshold
v. low semiformal / formalstructure
multimedia textualfocalartifact
Page 56
56 © Simon Buckingham Shum
Acknowledgements
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
Funding Funding gratefully gratefully
acknowledged:acknowledged:
Scholarly Ontologies Project:Scholarly Ontologies Project:
Victoria UrenVictoria UrenGangmin LiGangmin LiClara ManciniClara ManciniNeil BennNeil BennBertrand SerenoBertrand SerenoJohn DomingueJohn DomingueEnrico MottaEnrico Motta
Compendium Project:Compendium Project:
Al Selvin (Verizon/Open U.)Al Selvin (Verizon/Open U.)Maarten Sierhuis (NASA)Maarten Sierhuis (NASA)Jeff Conklin (CogNexus Inst.)Jeff Conklin (CogNexus Inst.)Michelle Bachler (Open U.)Michelle Bachler (Open U.)
Page 57
57 © Simon Buckingham Shum
Hypermedia Discourse project:community / theory / software / screencasts / case studies /
user studies
www.kmi.open.ac.uk/projects/hyperdiscourse
Compendium Institutewww.CompendiumInstitute.o
rg
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
Dialogue Mappingwww.cognexus.or
g
Visualizing Argumentationwww.VisualizingArgumentation.in
fo
Knowledge Cartography