© Simon Buckingham Shum 1 Hypermedia Discourse & Human- Agent Knowledge Cartography Simon...

Post on 27-Mar-2015

225 views 3 download

Tags:

Transcript of © Simon Buckingham Shum 1 Hypermedia Discourse & Human- Agent Knowledge Cartography Simon...

1 © Simon Buckingham Shum

Hypermedia Discourse & Human-Agent Knowledge

Cartography

Simon Buckingham Shum

Knowledge Media Institute & Computing Research Centre

The Open University, Milton Keynes, UK

www.kmi.open.ac.uk/people/sbssbs@acm.org

NASA-Ontolog-KMWG OKMDS mini-series Session-06 - Thu 17-April-2008 http://ontolog.cim3.net/cgi-bin/wiki.pl?ConferenceCall_2008_04_17

2 © Simon Buckingham Shum

Hypermedia

Discourse

3 © Simon Buckingham Shum

HypermediaModelling discourse relationsExpressing different perspectives on a conceptual spaceSupporting the incremental formalization of ideas Rendering structural visualizationsConnecting heterogeneous content

4 © Simon Buckingham Shum

DiscourseVerbal and written workplace communicationDiscourse communities: “making and taking perspectives”DialogueArgumentation Claim makingAnalytical narrativeMeetings

5 © Simon Buckingham Shum

Notation(s)

IntuitiveUser Interface

ComputationalServices

Literacy/Fluency

DiscourseOntology

Hypermedia Discourse research

6 © Simon Buckingham Shum

CompendiumCompendium

• personal or group personal or group concept mappingconcept mapping

• real time meeting real time meeting capture capture

• participatory participatory modelling modelling

• discourse as discourse as semantic hypertextsemantic hypertext

7 © Simon Buckingham Shum

Discourse grounded in Horst Rittel’s IBIS:Issue-Based Information System

8 © Simon Buckingham Shum

Compendium: hypertext discourse mapping/conceptual modelling

9 © Simon Buckingham Shum

Compendium: hypertext discourse mapping/conceptual modelling

10 © Simon Buckingham Shum

Compendium: Descendent of gIBIS

11 © Simon Buckingham Shum

Modelling using Issue-templates

12 © Simon Buckingham Shum

Modelling organisational processes in Compendium using a Template

13 © Simon Buckingham Shum

Completing a Compendium template

14 © Simon Buckingham Shum

Generating Custom Documents and Diagrams from Compendium Templates

BuildAssignableInventory

AssignableInventory

Deviations/Changes

(Engr Sched)Approvals

Integrated/Revised

Requirements

FieldSpecific

Assignments/Assignment

List

InstallationDetails/

Specs/NDO

AssignableInventory

Notice (E1)

15 © Simon Buckingham Shum

Structure management in Compendium

Associative linkingnodes in a shared context connected by graphical Map links

Categorical membership nodes in different contexts connected by common attributes via metadata Tags

Hypertextual Transclusion reuse of the same node in different views

Templates reuse of the same structure in different views

HTML, XML and RDF data exports for interoperability

Java and SQL interfaces to add services

16 © Simon Buckingham Shum

Using Compendium for personnel recovery planning

Example of Conversational Modelling:real time dialogue mapping combined with model

driven templates (AI+IA)

Co-OPR Project (with Austin Tate): http://www.aiai.ed.ac.uk/project/co-opr

17 © Simon Buckingham Shum

Mission Briefing: Intent template

Answers to template issues provided in the JTFC Briefing. Answers may be constrained

by predefined options, as specified in the XML schema

18 © Simon Buckingham Shum

Capturing political deliberation/rationale

Dialogue Map capturing the

planners’ discussion of this

option

19 © Simon Buckingham Shum

Planning Engine input to Compendium

Issues on which the I-X planning engine provided candidate Options

20 © Simon Buckingham Shum

Modelling a document corpus:The Iraq Debate

QuickTime™ and aTIFF (LZW) decompressor

are needed to see this picture.

http://kmi.open.ac.uk/projects/compendium/iraq

21 © Simon Buckingham Shum

Annotating a document corpus:Chomsky’s article in the Iraq Debate

http://kmi.open.ac.uk/projects/compendium/iraq

22 © Simon Buckingham Shum

Large scale NASA e-science field trials:

Interoperability with other databases, software agents and collaboration tools

www.kmi.open.ac.uk/projects/coakting/nasa

Clancey, W.J., Sierhuis, M., Alena, R., Berrios, D., Dowding, J., Graham, J.S., Tyree, K.S., Hirsh, R.L., Garry, W.B., Semple, A., Buckingham Shum, S.J., Shadbolt, N. and Rupert, S. (2005). “Automating CapCom Using Mobile Agents and Robotic Assistants.” 1st Space Exploration Conference, American Institute of Aeronautics and Astronautics, 31 Jan-1 Feb, 2005, Orlando, FL. Available from: AIAA Meeting Papers on Disc [CD-ROM]: Reston, VA, and as Advanced Knowledge Technologies ePrint 375: http://eprints.aktors.org/375

23 © Simon Buckingham Shum Image Credits--- Mars: NASA/JPL/MSSS; Earth: NASA/JSC; Composite: MSSS

24 © Simon Buckingham Shum

NASA e-science field trials (2004 and 2005)

Distributed Mars-Earth planning and data analysis toolsfor Mars Habitat field trial in Utah desert, supported from US+UK

www.kmi.open.ac.uk/projects/coakting/nasa

25 © Simon Buckingham Shum

NASA Mobile Agents Architecture

26 © Simon Buckingham Shum

Collaboration Configuration

Scientist (Mars)

Scientist (Earth)

Scientist (Earth)

Scientist (Mars)

Scientist (Earth)

Software Agent

Architecture (Mars)

Compendium used as a collaboration medium at all intersections: humans+agents, reading+writing maps

RST-telecon-2005-04-11.i.avi

00:49:08

27 © Simon Buckingham Shum

NASA testbed:Compendium activity plans for surface exploration, constructed by scientists on ‘Earth’, interpreted by software agents on ‘Mars’

The Compendium nodes and relationships in this plan were interpreted by Brahms software agents for monitoring and coordinating astronaut and robot activity during surface explorations.

Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission

RST-telecon-2005-04-11.i.avi1:11:57

28 © Simon Buckingham Shum

CoAKTinG NASA testbed:Compendium science data map, generated by software agents, for interpretation by Mars+Earth scientists

The Compendium maps were autonomously created and populated with science data by Brahms software agents that use models of the mission plan, work process, data flow and science data relationships to create the maps.

Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission

29 © Simon Buckingham Shum

CoAKTinG NASA testbed:Compendium-based photo analysis by geologists on ‘Mars’

Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission

30 © Simon Buckingham Shum

NASA testbed:Compendium scientific feedback map from Earth scientists to Mars colleagues

Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission

31 © Simon Buckingham Shum

Collaborative sensemaking in e-Science:Meeting Replay tool for Earth scientists, synchronising video of Mars crew’s discussion as they annotate their mission plans

Copyright, 2004, RIACS/NASA Ames, Open University, Southampton UniversityNot to be used without permission

NASA MR Clip: 00:50

32 © Simon Buckingham Shum

Memetic Meeting ReplayThe CoAKTinG project’s results are now mainstreamed in the Access Grid by the JISC Memetic VRE project

33 © Simon Buckingham Shum

Memetic Meeting ReplayThe CoAKTinG project’s results are now mainstreamed in the Access Grid by the JISC Memetic VRE project

34 © Simon Buckingham Shum

In Gutenberg’s shadow (or standing on his shoulders)

Philosophical Transactions of the Royal Society of LondonMarch 1665

Le Journal des SçavansJanuary 1665

Newspapers + Invisible Colleges = Scholarly Journals[Information Technology] + [Social Networks] = Knowledge Medium

35 © Simon Buckingham Shum

Jumping forward 343 years…

Buckingham Shum, S. (2007). Digital Research Discourse? Computational Thinking Seminar Series, School of Informatics, University of Edinburgh, 25 Apr. 2007. http://kmi.open.ac.uk/projects/hyperdiscourse/docs/Simon-Edin-CompThink.pdf

36 © Simon Buckingham Shum

…digital paper!

2008… Ideas and arguments (=knowledge claims) are now digital…

37 © Simon Buckingham Shum

Paper: “The Scent of a Site: A System for Analyzing and Predicting Information

Scent, Usage, and Usability of a Web Site”

“Web User Flow by Information Scent (WUFIS)”

Paper: “Information foraging”

“Information foraging theory”

“Information scent models”

“People try to maximise their rate of gaining information”

?

applies

Beyond document citations…These annotations are freeform

summaries of an idea, as one would find in researchers’ journals,

fieldnotes, lit. review notes or blog entries

These annotations are freeform summaries of an idea, as one would

find in researchers’ journals, fieldnotes, lit. review notes or blog

entries

Addressable triple which can be contested

e.g. supported/challenged

Addressable triple which can be contested

e.g. supported/challenged

Method

Theory

Claim

Making formal connections between

ideas creates a semantic citation network —> novel

literature navigation, querying and visualization

Making formal connections between

ideas creates a semantic citation network —> novel

literature navigation, querying and visualization

38 © Simon Buckingham Shum

Combining formal relations with the expressive freedom of ‘folksonomies’Relational classes and dialects (KMi Scholarly Ontologies project)

39 © Simon Buckingham Shum

If we model concepts in a literature as concept maps… (KMi’s ClaiMapper, built on Compendium)

40 © Simon Buckingham Shum

“Semantic del.icio.us”: KMi’s ClaimSpotter assigning and linking freeform tags

Sereno, B., Buckingham Shum, S. and Motta, E. (2007). Formalization, User Strategy and Interaction Design: Users’ Behaviour with Discourse Tagging Semantics. Workshop on Social and Collaborative Construction of Structured Knowledge, 16th Int. World Wide Web Conference (WWW 2007), Banff, 8-12 May 2007. http://www2007.org/workshops/paper_30.pdf

41 © Simon Buckingham Shum

Visualising claims and arguments

claimfinder.open.ac.uk

When multiple analysts annotate web documents via a server, they can generate a shared view of how they see the field, and where they agree/disagree

42 © Simon Buckingham Shum

“Semantic Google Scholar” KMi’s ClaimFinder

QuickTime™ and aTIFF (LZW) decompressor

are needed to see this picture.

QuickTime™ and aTIFF (LZW) decompressor

are needed to see this picture.

43 © Simon Buckingham Shum

Lineage tree (the roots of a concept)

44 © Simon Buckingham Shum

Adding Web 2.0 functionality to an open platform for mapping concepts and arguments

Cohere: http://cohereweb.net

<demo>

45 © Simon Buckingham Shum

Cohere: creating a new Idea for Google’s “Knol”, linked to a website

46 © Simon Buckingham Shum

Cohere: embedding an Idea in a blog

47 © Simon Buckingham Shum

Cohere: raising issues about Google’s “Knol” Idea

48 © Simon Buckingham Shum

Cohere: from tag clouds to idea webs

49 © Simon Buckingham Shum

Cohere: all incoming and outgoing links from a focal Idea

50 © Simon Buckingham Shum

Cohere: extensible connection language doesn’t lock users into one ontology

51 © Simon Buckingham Shum

Cohere: Argument from Expert Opinion with Critical Questions

52 © Simon Buckingham Shum

Cohere: semantically filtering a focal Idea by “contrasting” connections

53 © Simon Buckingham Shum

Cohere: a mashup visualization merging different connections around a common Idea

54 © Simon Buckingham Shum

Cohere: homepage integrates People, Ideas and Connections

55 © Simon Buckingham Shum

Social Software vs Argumentation?

Social Software Argumentation Tools

social work

v. rapid highly reflective

v. low learning required

purpose

pace

entrythreshold

v. low semiformal / formalstructure

multimedia textualfocalartifact

56 © Simon Buckingham Shum

Acknowledgements

QuickTime™ and aTIFF (LZW) decompressor

are needed to see this picture.

Funding Funding gratefully gratefully

acknowledged:acknowledged:

Scholarly Ontologies Project:Scholarly Ontologies Project:

Victoria UrenVictoria UrenGangmin LiGangmin LiClara ManciniClara ManciniNeil BennNeil BennBertrand SerenoBertrand SerenoJohn DomingueJohn DomingueEnrico MottaEnrico Motta

Compendium Project:Compendium Project:

Al Selvin (Verizon/Open U.)Al Selvin (Verizon/Open U.)Maarten Sierhuis (NASA)Maarten Sierhuis (NASA)Jeff Conklin (CogNexus Inst.)Jeff Conklin (CogNexus Inst.)Michelle Bachler (Open U.)Michelle Bachler (Open U.)

57 © Simon Buckingham Shum

Hypermedia Discourse project:community / theory / software / screencasts / case studies /

user studies

www.kmi.open.ac.uk/projects/hyperdiscourse

Compendium Institutewww.CompendiumInstitute.o

rg

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Dialogue Mappingwww.cognexus.or

g

Visualizing Argumentationwww.VisualizingArgumentation.in

fo

Knowledge Cartography