Vector Symbolic Architectures: A New Building Material for AGI
description
Transcript of Vector Symbolic Architectures: A New Building Material for AGI
![Page 1: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/1.jpg)
Vector Symbolic Architectures:
A New Building Material for AGI
Simon D. LevyWashington & Lee University
Lexington, Virginia, USA
Ross GaylerVeda Advantage Value Solutions
Melbourne, Australia
![Page 2: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/2.jpg)
The Yin & Yang of Intelligence
![Page 3: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/3.jpg)
![Page 4: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/4.jpg)
![Page 5: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/5.jpg)
The Need for New Representational
Principles• Ecological affordances (Gibson 1979)
• Distributed/Connectionist Representations (PDP 1986)
• Holographic Representations (Gabor 1971; Plate 2003)
• Fractals / Attractors / Dynamical Systems (Tabor 2000; Levy & Pollack 2001)
![Page 6: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/6.jpg)
Fractal RAAM
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
![Page 7: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/7.jpg)
The Appeal of Connectionism(Rumelhart &
McClelland 1986)
![Page 8: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/8.jpg)
WALK
WALKED
![Page 9: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/9.jpg)
ROAR
ROARED
![Page 10: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/10.jpg)
SPEAK
SPOKE
![Page 11: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/11.jpg)
GO
WENT
![Page 12: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/12.jpg)
ignores(mary, john)
Mary won’t give John the time of day.
![Page 13: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/13.jpg)
The Binding Problem
+
? ? ? ?
![Page 14: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/14.jpg)
Solution? Local Representations
![Page 15: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/15.jpg)
Local Representations
![Page 16: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/16.jpg)
The Problem of Two
?
![Page 17: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/17.jpg)
The Problem of Variables
ignores(X, Y)
X won’t give Y the time of day.
![Page 18: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/18.jpg)
Vector Symbolic Architectures
(Plate 1991; Kanerva 1994; Gayler 1998)
![Page 19: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/19.jpg)
Tensor Product Binding
(Smolensky 1990)
![Page 20: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/20.jpg)
Binding
![Page 21: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/21.jpg)
Bundling
+ =
![Page 22: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/22.jpg)
Unbinding (query)
![Page 23: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/23.jpg)
Lossy
![Page 24: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/24.jpg)
Lossy
![Page 25: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/25.jpg)
Cleanup
Hebbian / Hopfield /
Attractor Net
![Page 26: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/26.jpg)
Reduction
![Page 27: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/27.jpg)
Composition / Recursion
![Page 28: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/28.jpg)
Variables
X
john
![Page 29: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/29.jpg)
Current Applications
• Modeling Surface and Structural Properties in Analogy Processing (Eliasmith & Thagard 2001)
• Variables & Quantification / Wason Task (Eliasmith 2005)
• Representing Word Order in a Holographic Lexicon (Jones & Mewhort 2007)
![Page 30: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/30.jpg)
Future Work: Banish the
Homunculus
MSC (Arathorn 2002)
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
![Page 31: Vector Symbolic Architectures: A New Building Material for AGI](https://reader035.fdocuments.net/reader035/viewer/2022062309/5681448a550346895db1236e/html5/thumbnails/31.jpg)
Future Work: Banish the
Homunculus
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
MSC (Arathorn 2002)