The GLAIR Cognitive Architecture
description
Transcript of The GLAIR Cognitive Architecture
![Page 1: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/1.jpg)
cse@buffal
o
The GLAIR Cognitive Architecture
Stuart C. Shapiro and Jonathan P. BonaDepartment of Computer Science & Engineering
Center for Cognitive ScienceState University of New York at Buffalo
[email protected]@buffalo.edu
![Page 2: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/2.jpg)
cse@buffal
o
Outline
Overview
Integration of Acting and Reasoning
Symbol Grounding
BICA 2009Shapiro & Bona 2
![Page 3: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/3.jpg)
cse@buffal
o
Grounded Layered Architecture with Integrated Reasoning
• Major Concern:– Knowledge Representation and Reasoning
• Driving Motivation:– Natural Language Understanding & Generation
• Additional Concern:– Agents that act
• Question:– Where do beliefs come from?
• Partial Answer:– Agent’s being embodied– Agent’s being situated in the world
BICA 2009 Shapiro & Bona 3
![Page 4: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/4.jpg)
cse@buffal
o
Shapiro & Bona
BICA 2009 4
KL
PMLa
PMLb
PMLc
SAL
Mind
BodyIndependentof lower-body
implementation
Hearing
Vision
Motion
Speech WORLD
I/P s o c k e t s
GLAIR Architecture
Dependenton lower-bodyimplementation
Proprioception
![Page 5: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/5.jpg)
cse@buffal
o
Sensori-Actuator Layer
• Sensor and effector controllers
BICA 2009Shapiro & Bona 5
![Page 6: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/6.jpg)
cse@buffal
o
Perceptuo-Motor Layer
• PMLa• PMLb• PMLc
BICA 2009Shapiro & Bona 6
![Page 7: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/7.jpg)
cse@buffal
o
PMLc
• Abstracts sensors & effectors• Body’s behavioral repertoire
BICA 2009Shapiro & Bona 7
![Page 8: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/8.jpg)
cse@buffal
o
PMLb
• Translation & Communication– Between PMLa & PMLc
• Highest layer that knows body implementation
BICA 2009Shapiro & Bona 8
![Page 9: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/9.jpg)
cse@buffal
o
PMLa• Grounds KL symbols
– Perceptual structures– Implementation of primitive actions
• Registers for Embodiment & Situatedness– Deictic Registers– Modality Registers
BICA 2009Shapiro & Bona 9
![Page 10: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/10.jpg)
cse@buffal
o
The Knowledge Layer• Implemented in SNePS• Agent’s Beliefs• Representations of conceived of entities• Semantic Memory• Episodic Memory• Quantified & conditional beliefs• Plans for non-primitive acts• Plans to achieve goals• Beliefs re. preconditions & effects of acts• Policies: Conditions for performing acts• Self-knowledge• Meta-knowledge
BICA 2009 Shapiro & Bona 10
![Page 11: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/11.jpg)
cse@buffal
o
Outline
Overview
Integration of Acting and Reasoning
Symbol Grounding
BICA 2009Shapiro & Bona 11
![Page 12: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/12.jpg)
cse@buffal
o
SNePS
• A KRR system• Every non-atomic expression is simultaneously
– An expression of SNePS logic– An assertional frame– A propositional graph
• Every SNePS expression is a term– Denoting a mental entity
BICA 2009Shapiro & Bona 12
![Page 13: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/13.jpg)
cse@buffal
o
Ontology of Mental Entities• Entity
– PropositionAgent can believe it or its negationIncludes quantified & conditional beliefs
– ActAgent can perform it
– PolicyCondition-act rule agent can adopt
– ThingOther entities: individuals, categories, properties, etc.
BICA 2009Shapiro & Bona 13
![Page 14: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/14.jpg)
cse@buffal
oPolicies
Reasoning Acting• Forward Reasoning
whendo(φ, α)wheneverdo(φ, α)
• Backward Reasoningifdo(φ, α)
BICA 2009Shapiro & Bona 14
![Page 15: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/15.jpg)
cse@buffal
o
Types of Acts I• External Acts
affect the environmentsupplied by agent designer
• Mental Actsaffect the knowledge layerbelieve, disbelieveadopt, unadopt
• Control Actssequence, selection, loop, etc.
BICA 2009 Shapiro & Bona 15
![Page 16: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/16.jpg)
cse@buffal
o
Types of Acts II
• Primitive ActsImplemented in PMLa
• Composite ActsStructured by control acts
• Defined ActsDefined by ActPlan(α, p) belief
BICA 2009Shapiro & Bona 16
![Page 17: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/17.jpg)
cse@buffal
oActing Reasoning
Control Actssnif({if(φ1, α1), …, if(φn, αn), [else(δ)]})
sniterate({if(φ1, α1), …, if(φn, αn), [else(δ)]})
withsome(x, φ(x), α(x), [δ])
withall(x, φ(x), α(x), [δ])
BICA 2009Shapiro & Bona 17
![Page 18: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/18.jpg)
cse@buffal
o
Goal Talk
GoalPlan(φ, p)
achieve(φ)
BICA 2009Shapiro & Bona 18
![Page 19: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/19.jpg)
cse@buffal
o
Shapiro & Bona
Behavior CycleEnglish
(Statement, Question, Command) (Current) Set of Beliefs
(Updated) Setof BeliefsActions(New Belief)
English sentence expressingnew belief answering question reporting actions
Answer
NL Analysis
NL Generation
ReasoningClarification DialogueLooking in World
Reasoning
BICA 2009 19
![Page 20: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/20.jpg)
cse@buffal
o
Outline
Overview
Integration of Acting and Reasoning
Symbol Grounding
BICA 2009Shapiro & Bona 20
![Page 21: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/21.jpg)
cse@buffal
o
Shapiro & Bona
Entities, Terms, Symbols, Objects
• Agent’s mental entity: a person named Stu
• SNePS term: B4
• Object in world:
21BICA 2009
![Page 22: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/22.jpg)
cse@buffal
o
Shapiro & Bona
AlignmentMind (KL)
Body (PML/SAL)
World
KL term
PML structure
Object/Phenomenon Action
BICA 2009 22
![Page 23: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/23.jpg)
cse@buffal
o
Deictic Registers
For being situated in the worldPML registers hold KL terms
I term denoting agentYOU term denoting dialogue partnerNOW term denoting current time
BICA 2009Shapiro & Bona 23
![Page 24: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/24.jpg)
cse@buffal
o
Modality Registers
For privileged first-person knowledge of what agent is doing
Register for each modality holdsKL term denoting act modality is engaged in
BICA 2009Shapiro & Bona 24
![Page 25: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/25.jpg)
cse@buffal
o
Building Episodic Memory
BICA 2009Shapiro & Bona 25
KL
PML
e1
I
a1 b1
!
t1 e2
a2
!
t2
!
NOWCOUNT n
hom0
q!
before afterevent eventtime
time
time
act act
agent
agent
duration
ACT
![Page 26: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/26.jpg)
cse@buffal
o
For More DetailsSee the Paper
BICA 2009 Shapiro & Bona 26
![Page 27: The GLAIR Cognitive Architecture](https://reader035.fdocuments.net/reader035/viewer/2022062520/5681654c550346895dd7c58c/html5/thumbnails/27.jpg)
cse@buffal
o
BICA 2009Shapiro & Bona 27
Collaborators
Past and present members ofSNeRG: The SNePS Research Grouphttp://www.cse.buffalo.edu/sneps/