1 © Simon Buckingham Shum
Hypermedia Discourse & Human-Agent Knowledge
Cartography
Simon Buckingham Shum
Knowledge Media Institute & Computing Research Centre
The Open University, Milton Keynes, UK
www.kmi.open.ac.uk/people/[email protected]
NASA-Ontolog-KMWG OKMDS mini-series Session-06 - Thu 17-April-2008 http://ontolog.cim3.net/cgi-bin/wiki.pl?ConferenceCall_2008_04_17
2 © Simon Buckingham Shum
Hypermedia
Discourse
3 © Simon Buckingham Shum
HypermediaModelling discourse relationsExpressing different perspectives on a conceptual spaceSupporting the incremental formalization of ideas Rendering structural visualizationsConnecting heterogeneous content
4 © Simon Buckingham Shum
DiscourseVerbal and written workplace communicationDiscourse communities: “making and taking perspectives”DialogueArgumentation Claim makingAnalytical narrativeMeetings
5 © Simon Buckingham Shum
Notation(s)
IntuitiveUser Interface
ComputationalServices
Literacy/Fluency
DiscourseOntology
Hypermedia Discourse research
6 © Simon Buckingham Shum
CompendiumCompendium
• personal or group personal or group concept mappingconcept mapping
• real time meeting real time meeting capture capture
• participatory participatory modelling modelling
• discourse as discourse as semantic hypertextsemantic hypertext
7 © Simon Buckingham Shum
Discourse grounded in Horst Rittel’s IBIS:Issue-Based Information System
8 © Simon Buckingham Shum
Compendium: hypertext discourse mapping/conceptual modelling
9 © Simon Buckingham Shum
Compendium: hypertext discourse mapping/conceptual modelling
10 © Simon Buckingham Shum
Compendium: Descendent of gIBIS
11 © Simon Buckingham Shum
Modelling using Issue-templates
12 © Simon Buckingham Shum
Modelling organisational processes in Compendium using a Template
13 © Simon Buckingham Shum
Completing a Compendium template
14 © Simon Buckingham Shum
Generating Custom Documents and Diagrams from Compendium Templates
BuildAssignableInventory
AssignableInventory
Deviations/Changes
(Engr Sched)Approvals
Integrated/Revised
Requirements
FieldSpecific
Assignments/Assignment
List
InstallationDetails/
Specs/NDO
AssignableInventory
Notice (E1)
15 © Simon Buckingham Shum
Structure management in Compendium
Associative linkingnodes in a shared context connected by graphical Map links
Categorical membership nodes in different contexts connected by common attributes via metadata Tags
Hypertextual Transclusion reuse of the same node in different views
Templates reuse of the same structure in different views
HTML, XML and RDF data exports for interoperability
Java and SQL interfaces to add services
16 © Simon Buckingham Shum
Using Compendium for personnel recovery planning
Example of Conversational Modelling:real time dialogue mapping combined with model
driven templates (AI+IA)
Co-OPR Project (with Austin Tate): http://www.aiai.ed.ac.uk/project/co-opr
17 © Simon Buckingham Shum
Mission Briefing: Intent template
Answers to template issues provided in the JTFC Briefing. Answers may be constrained
by predefined options, as specified in the XML schema
18 © Simon Buckingham Shum
Capturing political deliberation/rationale
Dialogue Map capturing the
planners’ discussion of this
option
19 © Simon Buckingham Shum
Planning Engine input to Compendium
Issues on which the I-X planning engine provided candidate Options
20 © Simon Buckingham Shum
Modelling a document corpus:The Iraq Debate
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
http://kmi.open.ac.uk/projects/compendium/iraq
21 © Simon Buckingham Shum
Annotating a document corpus:Chomsky’s article in the Iraq Debate
http://kmi.open.ac.uk/projects/compendium/iraq
22 © Simon Buckingham Shum
Large scale NASA e-science field trials:
Interoperability with other databases, software agents and collaboration tools
www.kmi.open.ac.uk/projects/coakting/nasa
Clancey, W.J., Sierhuis, M., Alena, R., Berrios, D., Dowding, J., Graham, J.S., Tyree, K.S., Hirsh, R.L., Garry, W.B., Semple, A., Buckingham Shum, S.J., Shadbolt, N. and Rupert, S. (2005). “Automating CapCom Using Mobile Agents and Robotic Assistants.” 1st Space Exploration Conference, American Institute of Aeronautics and Astronautics, 31 Jan-1 Feb, 2005, Orlando, FL. Available from: AIAA Meeting Papers on Disc [CD-ROM]: Reston, VA, and as Advanced Knowledge Technologies ePrint 375: http://eprints.aktors.org/375
23 © Simon Buckingham Shum Image Credits--- Mars: NASA/JPL/MSSS; Earth: NASA/JSC; Composite: MSSS
24 © Simon Buckingham Shum
NASA e-science field trials (2004 and 2005)
Distributed Mars-Earth planning and data analysis toolsfor Mars Habitat field trial in Utah desert, supported from US+UK
www.kmi.open.ac.uk/projects/coakting/nasa
25 © Simon Buckingham Shum
NASA Mobile Agents Architecture
26 © Simon Buckingham Shum
Collaboration Configuration
Scientist (Mars)
Scientist (Earth)
Scientist (Earth)
Scientist (Mars)
Scientist (Earth)
Software Agent
Architecture (Mars)
Compendium used as a collaboration medium at all intersections: humans+agents, reading+writing maps
RST-telecon-2005-04-11.i.avi
00:49:08
27 © Simon Buckingham Shum
NASA testbed:Compendium activity plans for surface exploration, constructed by scientists on ‘Earth’, interpreted by software agents on ‘Mars’
The Compendium nodes and relationships in this plan were interpreted by Brahms software agents for monitoring and coordinating astronaut and robot activity during surface explorations.
Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission
RST-telecon-2005-04-11.i.avi1:11:57
28 © Simon Buckingham Shum
CoAKTinG NASA testbed:Compendium science data map, generated by software agents, for interpretation by Mars+Earth scientists
The Compendium maps were autonomously created and populated with science data by Brahms software agents that use models of the mission plan, work process, data flow and science data relationships to create the maps.
Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission
29 © Simon Buckingham Shum
CoAKTinG NASA testbed:Compendium-based photo analysis by geologists on ‘Mars’
Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission
30 © Simon Buckingham Shum
NASA testbed:Compendium scientific feedback map from Earth scientists to Mars colleagues
Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission
31 © Simon Buckingham Shum
Collaborative sensemaking in e-Science:Meeting Replay tool for Earth scientists, synchronising video of Mars crew’s discussion as they annotate their mission plans
Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission
NASA MR Clip: 00:50
32 © Simon Buckingham Shum
Memetic Meeting ReplayThe CoAKTinG project’s results are now mainstreamed in the Access Grid by the JISC Memetic VRE project
33 © Simon Buckingham Shum
Memetic Meeting ReplayThe CoAKTinG project’s results are now mainstreamed in the Access Grid by the JISC Memetic VRE project
34 © Simon Buckingham Shum
In Gutenberg’s shadow (or standing on his shoulders)
Philosophical Transactions of the Royal Society of LondonMarch 1665
Le Journal des SçavansJanuary 1665
Newspapers + Invisible Colleges = Scholarly Journals[Information Technology] + [Social Networks] = Knowledge Medium
35 © Simon Buckingham Shum
Jumping forward 343 years…
Buckingham Shum, S. (2007). Digital Research Discourse? Computational Thinking Seminar Series, School of Informatics, University of Edinburgh, 25 Apr. 2007. http://kmi.open.ac.uk/projects/hyperdiscourse/docs/Simon-Edin-CompThink.pdf
36 © Simon Buckingham Shum
…digital paper!
2008… Ideas and arguments (=knowledge claims) are now digital…
37 © Simon Buckingham Shum
Paper: “The Scent of a Site: A System for Analyzing and Predicting Information
Scent, Usage, and Usability of a Web Site”
“Web User Flow by Information Scent (WUFIS)”
Paper: “Information foraging”
“Information foraging theory”
“Information scent models”
“People try to maximise their rate of gaining information”
?
applies
Beyond document citations…These annotations are freeform
summaries of an idea, as one would find in researchers’ journals,
fieldnotes, lit. review notes or blog entries
These annotations are freeform summaries of an idea, as one would
find in researchers’ journals, fieldnotes, lit. review notes or blog
entries
Addressable triple which can be contested
e.g. supported/challenged
Addressable triple which can be contested
e.g. supported/challenged
Method
Theory
Claim
Making formal connections between
ideas creates a semantic citation network —> novel
literature navigation, querying and visualization
Making formal connections between
ideas creates a semantic citation network —> novel
literature navigation, querying and visualization
38 © Simon Buckingham Shum
Combining formal relations with the expressive freedom of ‘folksonomies’Relational classes and dialects (KMi Scholarly Ontologies project)
39 © Simon Buckingham Shum
If we model concepts in a literature as concept maps… (KMi’s ClaiMapper, built on Compendium)
40 © Simon Buckingham Shum
“Semantic del.icio.us”: KMi’s ClaimSpotter assigning and linking freeform tags
Sereno, B., Buckingham Shum, S. and Motta, E. (2007). Formalization, User Strategy and Interaction Design: Users’ Behaviour with Discourse Tagging Semantics. Workshop on Social and Collaborative Construction of Structured Knowledge, 16th Int. World Wide Web Conference (WWW 2007), Banff, 8-12 May 2007. http://www2007.org/workshops/paper_30.pdf
41 © Simon Buckingham Shum
Visualising claims and arguments
claimfinder.open.ac.uk
When multiple analysts annotate web documents via a server, they can generate a shared view of how they see the field, and where they agree/disagree
42 © Simon Buckingham Shum
“Semantic Google Scholar” KMi’s ClaimFinder
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
43 © Simon Buckingham Shum
Lineage tree (the roots of a concept)
44 © Simon Buckingham Shum
Adding Web 2.0 functionality to an open platform for mapping concepts and arguments
Cohere: http://cohereweb.net
<demo>
45 © Simon Buckingham Shum
Cohere: creating a new Idea for Google’s “Knol”, linked to a website
46 © Simon Buckingham Shum
Cohere: embedding an Idea in a blog
47 © Simon Buckingham Shum
Cohere: raising issues about Google’s “Knol” Idea
48 © Simon Buckingham Shum
Cohere: from tag clouds to idea webs
49 © Simon Buckingham Shum
Cohere: all incoming and outgoing links from a focal Idea
50 © Simon Buckingham Shum
Cohere: extensible connection language doesn’t lock users into one ontology
51 © Simon Buckingham Shum
Cohere: Argument from Expert Opinion with Critical Questions
52 © Simon Buckingham Shum
Cohere: semantically filtering a focal Idea by “contrasting” connections
53 © Simon Buckingham Shum
Cohere: a mashup visualization merging different connections around a common Idea
54 © Simon Buckingham Shum
Cohere: homepage integrates People, Ideas and Connections
55 © Simon Buckingham Shum
Social Software vs Argumentation?
Social Software Argumentation Tools
social work
v. rapid highly reflective
v. low learning required
purpose
pace
entrythreshold
v. low semiformal / formalstructure
multimedia textualfocalartifact
56 © Simon Buckingham Shum
Acknowledgements
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
Funding Funding gratefully gratefully
acknowledged:acknowledged:
Scholarly Ontologies Project:Scholarly Ontologies Project:
Victoria UrenVictoria UrenGangmin LiGangmin LiClara ManciniClara ManciniNeil BennNeil BennBertrand SerenoBertrand SerenoJohn DomingueJohn DomingueEnrico MottaEnrico Motta
Compendium Project:Compendium Project:
Al Selvin (Verizon/Open U.)Al Selvin (Verizon/Open U.)Maarten Sierhuis (NASA)Maarten Sierhuis (NASA)Jeff Conklin (CogNexus Inst.)Jeff Conklin (CogNexus Inst.)Michelle Bachler (Open U.)Michelle Bachler (Open U.)
57 © Simon Buckingham Shum
Hypermedia Discourse project:community / theory / software / screencasts / case studies /
user studies
www.kmi.open.ac.uk/projects/hyperdiscourse
Compendium Institutewww.CompendiumInstitute.o
rg
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
Dialogue Mappingwww.cognexus.or
g
Visualizing Argumentationwww.VisualizingArgumentation.in
fo
Knowledge Cartography
Top Related