Stochastic Methods in Robotics (Probability, Fourier ... · • Pose Distributions for Nonholonomic...
Transcript of Stochastic Methods in Robotics (Probability, Fourier ... · • Pose Distributions for Nonholonomic...
Stochastic Methods in Robotics (Probability, Fourier Analysis, Lie Groups and Applications)
Gregory S. Chirikjian
Department of Mechanical Engineering Johns Hopkins University
Georgia Tech, June 12-22
Contents
• Overview of Problem Domains• Introduction to Classical Probability, Convolution and Fourier Analysis• Stochastic Differential Equations• Lie Groups – What are they and how to use them (Invariant Integration, Differential
Operators, Convolution, Fourier Analysis, Gaussian Distributions)
• Workspace Generation and Inverse Kinematics of Highly Articulated Manipulators
• Calculus of Variations• Conformational Statistics of Stiff Macromolecules (DNA)• Pose Distributions for Nonholonomic Systems (Mobile Robots
and Steerable Needles)• Lie-Theoretic Estimation and Filtering Problems• New Insights into AX=XB Sensor Calibration • Coset-Spaces of Lie Groups by Discrete Subgroups • Action Recognition
Binary Manipulators in Our Lab
215 3.3104
configurations
236 6.91010
configurations2.1106
configurations
Workspace Density
• It describes the density of the reachable frames in the work space.
• It is a probabilistic measure-ment of accuracy over the workspace.
Ebert-Uphoff, I., Chirikjian, G.S., ``Inverse Kinematics of Discretely Actuated
Hyper-Redundant Manipulators Using Workspace Densities,'' ICRA’96, pp. 139-145
Long, A.W., Wolfe, K.C., Mashner, M.J., Chirikjian, G.S., ``The Banana Distribution
is Gaussian: A Localization Study with Exponential Coordinates,'‘ RSS, Sydney,
NSW, Australia, July 09 - July 13, 2012.
SDE for the Kinematic Cart
(Zhou and Chirikjian, ICRA 2003)
A. Long, K. Wolfe, M. Mashner, G.
Chirikjian, ``The Banana Distribution
is Gaussian’’ RSS 2012
Examples of Lie Groups
PART 1: INTRODUCTORY MATHEMATICS
9
PART 1(a): Probability and Statistics
10
Gaussian Distribution on the Real Line
Convolution of Gaussians
Classical Fourier Analysis
Gaussians Wrapped Around the Circle
This is exactly equivalent to
Gassian as Solution to Heat Equation (circle case)
Gassian as Solution to Heat Equation (R^n case)
Multivariate Gaussian
Convolution on R^n
A Little Bit of Information Theory
Entropy
Kullback-Leibler Divergence
Entropy Power Inequality
PART 1(b): Lie Groups and Lie Algebras
21
Rigid-Body Motion Group
• Special Euclidean motion group SE(N)
– An element of G=SE(N):
– Group operation: matrix multiplication
• For example, an element of SE(2) in polar coordinates:
10T
aAg
100
sincossin
cossincos
),,(
r
r
rg
• Lie algebra of SE(2)
• Lie algebra of SE(3)
• Infinitesimal motions
000
001
010~
1X
000
000
100~
2X
000
100
000~
3X
0000
0010
0100
0000
~1X
0000
0000
0001
0010
~3X
0000
0001
0000
0100
~2X
0000
0000
0000
1000
~4X
0000
1000
0000
0000
~6X
0000
0000
1000
0000
~5X
iii XIXH~
)~
exp()(
A Little Bit of Lie Group Theory
exp and log for SO(3)
26
Lie-group-theoretic Notation
• Coordinate free no singularities
(3) ofelement basis:
0
(3)))(),(()(For
1
6
1
1
seX
A
AAgg
AAAXgg
SEtAttg
i
T
T
T
TT
i
ii
v
ω
aξ
0
a
a
(3) ofelement basis :
,)3()(For
3
1
soX
AA
XAA
SOtA
i
T
i
ii
T
ω
)(tg
Space-fixed frame
Body-fixed frame
ω
v
For more details see
Differential Operators Acting on Functions on SE(N)
00 ))~
(())(())((~
titi
R
i XtIHfdt
dtHHf
dt
dqHfX
00 ))~
(())(())((~
titi
L
i HXtIfdt
dHtHf
dt
dqHfX
Differential operators defined for SE(2)
rrX
rrX
X
R
R
R
)cos()sin(
~
)sin()cos(
~
~
3
2
1
rrX
rrX
X
L
L
L
cossin
~
sincos
~
~
3
2
1
Differential operators defined for SE(3)
6,5,4for
3,2,1for~
3iA
iXX
ia
T
R
iR
i
6,5,4for
3,2,1for)(~
3
3
1
ia
ia
eeaX
X
i
k k
ki
L
iL
i
31
Variational Calculus on Lie groups• Given the functional and constraints
one can get the Euler-Poincaré equation as:
where
2
1
2
1
)(,);;( 1
t
t
kk
t
t
dtghCdttgggfJ
,)(11,
m
l
ll
R
i
n
kj
j
k
ij
ki
hfXCff
dt
d
6
1
0
,
))exp(()(
k
k
k
ijji
t
i
R
i
XCXX
tXgfdt
dgfX
Probability on Lie Groups
• Integration of functions on SO(3)
• Integration of functions on SE(2) and SE(3)
)3(
321|))((det|))((1
)(SO Qq
dqdqdqqAJqAfV
dAAf
)3(
2
0 0
2
0
2sin),,(
8
1)(
SOdddfdAAf
)(
1|))((det|))(()(NSE Qq
NdqdqqHJqHfdHHf
21212
1),,( dxdxdxxdH
3212321 sin8
1),,(),,,,,( dadadaddddaddAaaadH
e.g.
e.g.
SE(2)
e.g.
SE(3)
Fourier Analysis of Motion
• Fourier transform of a function of motion, f(g)
• Inverse Fourier transform of a function of motion
G
dgpgUgfpffF ),()()(ˆ)( 1
dpppgUpftracegffF N 11 )),()(ˆ()()ˆ(
where g SE(N) , p is a frequency parameter,
U(g,p) is a matrix representation of SE(N), and
dg is a volume element at g.
Convolution and the SE(3) Fourier Transform
)()()*( 1221 fFfFffF
Gdhghfhfgff )()())(*( 1
2121
G.S. Chirikjian, Stochastic Models, Information Theory,and Lie Groups, Vol. 1, 2, Birkhauser, 2009, 2011.
G.S. Chirikjian, A.B. Kyatkin, Engineering Applications ofNoncommutative Harmonic Analysis, CRC Press, 2001.
PART 2: APPLICATIONS TO
CONFORMATIONAL ENSEMBLES
38
Workspace Density
• It describes the density of the reachable frames in the work space.
• It is a probabilistic measure-ment of accuracy over the workspace.
Ebert-Uphoff, I., Chirikjian, G.S., ``Inverse Kinematics of Discretely Actuated
Hyper-Redundant Manipulators Using Workspace Densities,'' ICRA’96, pp. 139-145
Long, A.W., Wolfe, K.C., Mashner, M.J., Chirikjian, G.S., ``The Banana Distribution
is Gaussian: A Localization Study with Exponential Coordinates,'‘ RSS, Sydney,
NSW, Australia, July 09 - July 13, 2012.
A diffusion equation describing the PDF of relative
pose between the frame of reference at arc length s and
that at the proximal end of the chain
zp
yp
Proximal End
zp’
yp’
zd yd
Distal End s L
),,()~~~~
2
1(
),,(6
3
1
3
1,
sfXXdXXDs
sf R
l
R
ll
lk
R
k
R
llk RaRa
Initial condition: f(a,R,0)= (a) (R)
1][ BD lkD bBd1][ ldDefining
A General Semiflexible Polymer Model
41
Operational Properties of SE(n) Fourier Transform
)(ˆ),~
(
)(),()(),~
exp(
)(,)~
exp()(
)(),())~
exp((~
1
0
),(),(),(
0
1
)~
exp(
1
0
2121
pfpX
hdphUhfpXtUdt
d
hdphXtUdt
dhf
gdpgUXtgfdt
dfXF
i
G
ti
pgUpgUpggU
G
ti
Xtgh
G
ti
R
i
i
Explicit Expression of for SE(2)
0)),~
(exp(),~
(
tii pXtU
dt
dpX
)()),,,(( ])([ paJeipagu mn
nmnimn
mn
)(2
),~
(
)(2
),~
(
),~
(
1,1,3
1,1,2
,1
nmnmmn
nmnmmn
nmmn
ppX
jppX
jmpX
),~
( pX i
Explicit Expression of for SE(3)
0)),~
(exp(),~
(
tii pXtU
dt
dpX
mmllmlml
mmll
l
mmmll
l
mmlml
mmll
l
mmmll
l
mmlml
jmpX
cj
cj
pX
ccpX
,,3,;,
,1,,1,2,;,
,1,,1,1,;,
''''
''''''
''''''
),~
(
22),
~(
2
1
2
1),
~(
l
lk
l
km
s
mlmlAUamlspmlpgu )()](,|,|,[),( ''
,;, ''
),~
( pX i
Explicit Expression of (Xi , p) for SE(3)
llmm
s
mlllmm
s
mlllmm
s
ml
llmm
s
mlllmm
s
mlllmm
s
mlmlml
jpjpjp
jpjpjppX
i
i
,11,,,1,,,11,,
,11,,,1,,,11,,4,;,
'''''''
'''''''''
222
222),
~(
llmm
s
mlllmm
s
mlllmm
s
ml
llmm
s
mlllmm
s
mlllmm
s
mlmlml
ppp
ppppX
i
i
,11,,,1,,,11,,
,11,,,1,,,11,,5,;,
'''''''
'''''''''
222
222),
~(
llmm
s
mlllmmllmm
s
mlmlmljp
ll
smjpjppX i ,1,,,,,1,,6,;, '''''''''
)1(),
~(
45
Solving for the evolving PDF Using the SE(3) FT
rrr
ds
dfB
f ˆˆ
where B is a constant matrix.
),,()~~~~
2
1(
),,(6
3
1
3
1,
sfXXdXXDs
sf R
l
R
ll
lk
R
k
R
llk RaRa
rsr esp Bf ),(ˆ
dpppUpfsfr rl rl
l
lm
l
lm
r
mlml
r
mlml
2
||' ||
'
''0
,;','',';,2);,()(ˆ
2
1),,(
RaRa
Applying SE(3) Fourier transform
Solving ODE
Applying inverse transform
Numerical Examples
2
1
0.50.1
47
The Structure of a Bent Macromolecular Chain
xd1,xp2
b
zd2
yd2
xd2
zp1 yp1
xp1
zp2 yp2
yd1
zd1
Subchain 1 Subchain 2
1) A bent macromolecular chain consists of two
intrinsically straight segments.
2) A bend or twist is a rotation at the separating point
between the two segments with no translation.
A General Algorithm for Bent or
Twisted Macromolecular Chains
48
The PDF of the End-to-End Pose for a Bent Chain
),)(**(),( 321 RaRa ffff
•f1(a,R) and f3(a,R) are obtained by solving the
differential equation for nonbent polymer.
•f2(a,R)= (a)(Rb-1R), where Rb is the rotation
made at the bend.
2) The convolution on SE(3)
)3(
1 )()()())(*(SE
jiji dffff hghhg
A General Algorithm for Bent or
Twisted Macromolecular Chains
1) A convolution of 3 PDFs
49
1. Variation of f(a) with respect to Bending Angle
and Bending Location
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 -0.5
0
0.5
1
1.5
2
2.5
3
3.5
4
Kratky-Porod model with 0=0.5, L1=L2=0.5
a
f(a)
b=
b=3/4
b=/2
b=0
b=/4
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 -0.5
0
0.5
1
1.5
2
2.5
3
3.5
4
a
f(a)
Kratky-Porod model with 0=0.5, b=/2
L1=0.1 L1=0.2
L1=0.3 L1=0.4 L1=0.5
Examples
1) G. S. Chirikjian, ``Modeling Loop Entropy,’’ Methods in
Enzymology, 487, 2011
1) Y. Zhou, G. S. Chirikjian, ``Conformational Statistics of SemiflexibleMacromolecular Chains with Internal Joints,’’
Macromolecules. 39:1950-1960. 2006
1) Zhou, Y., Chirikjian, G.S., “Conformational Statistics of Bent Semi-flexible Polymers”, Journal of Chemical Physics, vol.119, no.9, pp.4962-4970, 2003.
2) G. S. Chirikjian, Y. Wang, ``Conformational Statistics of StiffMacromolecules as Solutions to PDEs on the Rotation and MotionGroups,’’ Physical Review E. 62(1):880-892. 2000
DNA References
PART 4: STOCHASTIC KINEMATICS AND INFORMATION-DRIVEN MOTION
Flexible Needles with Bevel tip
http://research.vuse.vanderbilt.edu/MEDLab/research_files/needlesteer.htm
Needle with a bevel tip
Needle Model
v
v
v
v
v
z
y
x
z
y
x
0
0
0
Deterministic nonholonomic model
: insertion speed : twisting angular velocityv
Experiments by Dr. Kyle Reed
Stochastic needle model
)(twi
i
: Unit Gaussian white noise
: Strength of noise)(1)( 22 twtv
)()( 11 twt
2
1
22
11
0000
0000010000)(
W
WT
d
ddtdtgg
T
: Wiener process
g : SE(3) frame for needle tip pose
)(tiW
Park, W., Kim, J.S., Zhou, Y., Cowan, N.J., Okamura, A.M., Chirikjian,G.S., ``Diffusion-based motion planning for a nonholonomicflexible needle model,'‘ ICRA’05, Barcelona, Spain
Park, W., Reed, K. B., Okamura, A. M., Chirikjian, G. S., ``Estimation of modelparameters for steerable needles,'' ICRA, Anchorage, Alaska, 2010.
63
1) Chirikjian, G.S. "A binary paradigm for robotic manipulators.“ICRA 1994. pp. 3063-3069.
2) Ebert-Uphoff, I., Chirikjian, G.S., ``Inverse Kinematics ofDiscretely Actuated Hyper-Redundant Manipulators UsingWorkspace Densities,'‘ ICRA 1996, 139-145.
3) Chirikjian, G.S., Burdick, J.W., ``An Obstacle AvoidanceAlgorithm for Hyper-Redundant Manipulators,''ICRA 1990, 625-631.
4) Park, W., Wang, Y., Chirikjian, G.S., ``The path-of-probabilityalgorithm for steering and feedback control of flexible needles,'‘International Journal of Robotics Research, Vol. 29, No. 7,813-830 (2010)
References
Alterovitz, R., Lim, A., Goldberg, K., Chirikjian, G.S., Okamura, A.M.,``Steering flexible needles under Markov motion uncertainty,'' IROS,pp. 120-125, August 2005.
R. J. Webster III, J. S. Kim, N. J. Cowan, G. S. Chirikjian and A. M. Okamura,"Nonholonomic Modeling of Needle Steering," International Journal ofRobotics Research, Vol. 25, No. 5-6, pp. 509-525, May-June 2006.
Park, W., Wang, Y., Chirikjian, G.S., ``The path-of-probability
algorithm for steering and feedback control of flexible needles,'‘
IJRR, Vol. 29, No. 7, 813-830 (2010)
Other References
GC’s presentation is supported by the NSF IRD Program
SDE for the Kinematic Cart
(Zhou and Chirikjian, ICRA 2003)
Long et al, ``The Banana Distribution is Gaussian’’ RSS 2012
Exponential Coordinates for SE(2)
Matching 2nd Order Taylor Series and 2nd Order BCH Expansions
Both are of the form
We match a, b, K for each.
If you like this …
Have a look at my book:
``Stochastic Models, Information Theory, and Lie Groups’’
An Information-Theoretic Approach to theCorrespondence-Free AX=XB Sensor Calibration
ProblemM. Kendal Ackerman1, Alexis Cheng2
and Gregory Chirikjian1
1Dept. Mech. Engineering, 2Dept. Computer Science
Johns Hopkins University, Baltimore, MD, USA
International Conference on Robotics and Automation
June 2014
Outline
• The AX=XB Problem
• Notation and Probability Theory Review
• Solution Constraints
• An information Theoretic Approach
• Results and Conclusions
AX = XB is one of the most common mathematical formulations used in robot-sensor calibration problems.
It can be found in a variety of applications including:
Camera calibration [1] Robot eye-to-hand
calibration [1]
Aerial vehicle sensor
calibration [2]
Image guided therapy
(IGT) sensor
calibration [3][1] Tsai, R., Lenz, R. (1989)[2] Mair, E., Fleps, M., Suppa, M., Burschka, D. (2011)
[3] Boctor, E.M. (2006)
Courtes
y:
Darius
Burschk
a
Courtes
y:
CAMP
at TUM
𝐴, 𝐵, 𝑋 ϵ 𝑆𝐸 3 whereSE 3 = ℝ3⋉ 𝑆𝑂 3 and
SO 3 ≔ {𝑅 𝜖 ℝ3x3|𝑅𝑅𝑇 = 𝕀, det 𝑅 = +1}SE(3) is the Lie Group describing rigid body motions in 3-dimensional space, i.e.:
𝐻 ϵ 𝑆𝐸(3), where and
𝑅 ϵ 𝑆𝑂(3) (a proper rotation matrix), 𝐭 ϵ ℝ3 (a translation vector)
AX=XB
AX=XB Solution Space
It is well known that it is not possible to solve for a unique X from a single pair of exact (A, B),but if there are two instances of independent exact measurements, (A1,B1) and (A2, B2), then the
problem can be solved.
One Parameter solution set
Rank 2
+
Two unspecified degrees of freedom
The goal becomes one of finding an X with least-squared error given corresponding pairs (Ai, Bi) for i=1,2,...,n.
A unique solution is possible given two pairs
with certain constraints[4,5]
• SE(3) geometric invariants satisfied
• Angle of the rotation axes is “sufficiently
large”
• (Ai, Bi) pairs have Correspondence
AX=XB Solution Space
[4] Chen (1991)
[5] Ackerman, M.K., Cheng, A., Shiffman, B., Boctor, E., Chirikjian, G. (2014)
In experimental applications, it is often the case that the data streams containing the A’s and B’s:
• will present at different sample rates,• will be asynchronous, • and each stream may contain gaps in information.
AX=XB Correspondence
Data Stream
Data Stream A’s
B’s
A1
B1
A2
B2
An
Bn
…
What we mean by correspondence:
While our method removes the need to know the correspondence of the data, there have been other attempts in the literature to regenerate the correspondence by
1. time stamping the data[5]
2. dedicated software modules for syncing the data[6]
3. analyzing components of the sensor data stream to determine a correlation[7,8]
We present a method for calculating the calibration transformation, X, that works for data without any a priori knowledge of the correspondence between the A’s and B’s.
AX=XB Correspondence
[5] Mills, D. L.[6] Kang, H. J., Cheng, A., Boctor, E. M.[7] Mair, E., Fleps, M., Suppa, M., Burschka, D [8] Ackerman, M.,K., Cheng, A., Shiffman, B., Boctor, E., Chirikjian, G.
Rigid Body Motion
is a Lie group and therefore the concept of integration exists:
, where:
The group of rigid body
motions, SE(3),
which is “natural”, because for any
𝐻0 ϵ 𝑆𝐸 3 ,
,
Convolution on SE(3)
Define a delta function as:
Define the convolution of two functions as:
And a shifted delta function as:, where A 𝜖 𝑆𝐸 3
The “v” operator is defined as:
(x1, x2, … , xn)T
PDFs on SE(3)
The mean and covariance of a probability density function, f(H), can be defined as
Where is usually something akin to
Traditional Riemannian-geometric approach:
Avoid the arbitrary bias of a weighting matrix and avoid the need for a bi-invariant distance metric, which does not
exist for SE(3)
Mean and Covariance
and
We use:
Where is usually something
akin to
Traditional Riemannian-geometric approach:
Avoid the arbitrary bias of a weighting matrix and avoid the need for a bi-invariant distance metric, which does not
exist for SE(3)
The “Batch” Equations
because real-valued functions can be added and convolution is a linear operation on functions, all n instances can be written into a single equation of the form
Given
We can normalize the functions to be
probability density functions (pdfs):
where
The “Batch” Equations
Given that , we can write the evolution of the mean and covariance as:
where
and the “hat” operator is defined such
that given
and
≈
The “Batch” Equations
Since the mean of is and its covariance is the zero matrix we can write the “Batch” formulation
Batch Method “AX=XB” Equations:
(1
)
(2
)
Solution Space
The search for an appropriate X can begin with re-writing (1) asBy defining
The equation can be separated into
rotational and translational components,
From which it can be seen that the
possible solution space, for (1), is two
dimensional.
Batch Method “AX=XB” Equations:
(1
)
(2
)
and
Discretization
With the discrete nature of our application, we can likewise define the mean and covariance in a discrete sense
An iterative procedure can be used for
computing MA which uses an initial
estimate of the formThen a gradient descent procedure is used
to update so as to minimize the cost
The covariance can then be computed:
Where is the free parameter and
where is the free
parameter
Solution Space
For the rotational part, we can write 𝑅𝑋 as
We then re-write the translation part as
𝒏𝑨 is rank 2 so there is a degree of freedom in 𝒕𝑿along 𝒏𝑨. Therefore we write 𝒕𝑿 as
Solution Space
A feasible solution to the batch equation can be parameterized as
where
Given that (1) constrains the possible
solutions to a two-dimensional “cylinder”,
the problem of solving for X reduces to
that of solving (2) on this cylinder by
determining the values (𝝓, 𝒔). There is
therefore no need to search elsewhere in
the 6D group SE(3).
∙ 𝑭𝟐 Minimization
Minimize the cost function
𝐶1is quadratic in 𝑠 and can be written
as
The minimization of 𝑠 is solved for in
closed-form,
and then is substituted into the
original expression, leaving a one
dimensional search over
KL Divergence
A Gaussian on SE(3) can be defined when the norm Σ is small as
where Σ denotes the determinant of Σ and
We write the Kullback-Leibler divergence
of the two distributions as
Minimal KL Divergence
Minimize the cost function
where
If we take into account that our
search is limited to the cylinder as
defined in (1), then automatically
an
d
Minimal KL Divergence
We can now write a new variable,, and minimize the cost function
where
Since SE(3) is unimodular, and additive
and positive multiplicative constants can
be ignored, we can simply consider the
first term in the KL-divergence, scaled by a
factor of two:
an
d
Minimal KL Divergence
Since SE(3) is unimodular, and
additive and positive multiplicative
constants can be ignored, we can
simply consider the first term in the
KL-divergence, scaled by a factor of
twominimized over
Minimization over s can be done in
closed form as in the previous
approach, since 𝐶2is also quadratic
in s. After substitution, this again
results in a one dimensional search
To experimentally test our methods for AX=XB calibration we use an Ultrasound (US) sensor calibration process. It should be noted that these methods can be extended to other application areas, both in US and more
generally.
Calibration of Sensor Data
on the Euclidean Group
Ultrasound Calibration
The AX=XB Problem
3D image volumes Augmented reality environments
US Elastography
Through calibration we recover parameters that are required to perform more advanced forms of image based guidance using Ultrasound (US)
Simulation Results
The two algorithms were unaffected by knowledge
of correspondence and, in each case performed
with a high level of accuracy. The results are the
average of ten trials.
US Experimental Results
For each reconstruction point, we found its closest
point match on the model and computed the sum
squared difference between them. Our results
show the mean and the standard deviation of this
sum of squared differences and indicates that the
error is reasonable.
US Experimental Results
To examine the accuracy of the computed X, we
performed a reconstruction of the phantom model.
• We established that the AX = XB sensor calibration problem can be formulated with a “Batch”, probabilistic formulation that does not require a priori knowledge of the A and B correspondence.
• We presented an information-theoretic algorithm (KL Batch) that solves for X by minimizing the Kullback-Leibler divergence of the A and B sensor stream distributions with respect to the unknown X.
• In both simulation and experimentation, we demonstrated that this method reliably recovers an unknown X without the need for correspondence.
Conclusions
• We will further examine the proposed methods experimentally, for ultrasound calibration, as well as other contexts.
• We will work to improve our probability theoretic formulation by specifically accounting for sensor measurement noise, representing X by a mean and covariance, and not just a Dirac delta distribution.
Future Work
This work was supported by NSF Grant RI-
Medium: 1162095
Acknowledgements
Voronoi Cells in Lie Groups and Coset Decompositions: Implications for
Optimization, Integration, and Fourier Analysis
Yan Yan and Gregory S. Chirikjian
Department of Mechanical Engineering
Johns Hopkins University, Baltimore, MD 21218
• Review of basic concepts in group theory and the Lie groups SE(2) and SO(3).
• Generating almost-uniform sample points in SE(2)and SO(3) based on coset decomposition.
• More efficient computations of convolutions on groups developed by coset decomposition.
Outlines
• A group 𝐺,∘ is a set, 𝐺, together with a binary operation,∘,
that satisfies (1) closure; (2) associativity; (3) existence of identity element; (4) existence of inverse element.
In this paper, we mainly focus on the group of rotations in space, SO(3), and the group of rigid-body motions of the plane, SE(2).
• A subgroup is a subset of a group 𝐻 ⊆ 𝐺 which is itself a group that is closed under the group operation of 𝐺.
• SO(3) and SE(2) contain discrete subgroups.
Basic concepts in group theory
Groups of rotational symmetry operations of the Platonic solids Five chiral wallpaper groups
p1 p2 p4
p3 p6
Let Γ, Γ′ < G denote discrete subgroups, then left- and right-coset-spaces are defined as
A double coset space is define as
Basic concepts in group theory
and .
Associated with any (double-) coset, it is possible to define a fundamental domain in G, which is a set of distinguished (double-) coset representatives, exactly one per (double-) coset. It has the same dimension as G, but lesser volume.
It can be constructed as Voronoi cells in G.
and when
SO(3) represented in
exponential coordinates
Voronoi cells
Γ: the Icosahedral group
The center Voronoi cell
the fundamental domain
Fundamental domains for SO(3)
Constructed as Voronoi cells with 0
Fundamental domain for other discrete subgroups in SO(3):
The Tetrahedral group The Icosahedral groupThe Octahedral group
Smallest volume!
(Yan and Chirikjian, ICRA’12)
Fundamental domains for SE(2)
For the first time, we establish the fundamental domains for SE(2) when Γ is one of the five chiral wallpaper groups, p1, p2, p3, p4 and p5.
Distance function: 0
SE(2) represented in ℝ3 Voronoi cells with 𝜞 = p1
The center Voronoi cell the fundamental domain
For p1: it looks like a hexagonal box with the height
from –π to π.
We note that if the lattice is square instead of
parallelogrammatic, the center Voronoi cells
becomes a square box.
Fundamental domains for SE(2)
Fundamental domains of SE(2) based on the five chiral wallpaper groups:
p1 p2 p4
p3 p6
Why do we study this?
Application 1: generating almost-uniform samples
• The discretization of the groups of rotations or rigid-body motions, arises in many applications such as robot motion planning;
computational structural biology;
Computer graphics
• Uniform sampling will prevent search algorithms from oversampling or undersampling large portions of the C-space.
• This affects both the performance and reliability of planning algorithms.
Importance of uniform sampling
SO(3) Example:
…
Sampling based on single coset decomposition
(Yan and Chirikjian, ICRA’12)
when is small,
Distortion measure: ,
our sampling method ZXZ Euler angles
The grids generated on SO(3) are almost uniform!
Can we do better than this?
Sampling based on double coset decomposition
Given two finite subgroups, 𝐻,𝐾 < 𝐺, where 𝐺 = 𝑆𝑂 3 , 𝐻 ∩ 𝐾 = 1,the resulting non-overlapping tiles satisfy
Some examples of double-coset spaces:
Yellow-shaded region: single coset-space 𝐹𝑆𝑂(3)/𝐾 with 𝐾= the icosahedral group
Red-shaded region: double coset-space 𝐹𝐻\𝑆𝑂(3)/𝐾 with 𝐾= the icosahedral group,
𝐻= the conjugated (a) tetrahedral , (b) octahedral, and (c) icosahedral groups.The conjugated group 𝐻: 𝐻 = 𝑔𝐻0𝑔
−1 for 𝑔 ∈ 𝐺.
Sampling based on double coset decomposition
As 𝑯| ∙ |𝑲 increases, the size of the center Voronoi cells shrinks, which leads to smaller distortion.
Advantages of this sampling approach?
has low metric distortionis deterministichas grid structure with respect to the metric on SO(3)can easily achieve any level of resolution
Application 2: Efficient computation of convolution on rotation and motion groups
Fast Convolutions by Direct Evaluation
Convolution on groups:
Here, 𝑑ℎ is the natural integration measure for 𝐺.
An integration over 𝐺 :
where 𝑑𝑔′ is the same volume element as for 𝐺, but restricted to 𝐹𝐻\G/𝐾 < 𝐺.
Efficient algorithms for computing convolutions on roation and motion groups have been developed previously using “group FFTs” --- Chirikjian and Kyatkin, 01; Kostelec and Rockmore, 08; Maslen and Rockmore, 97.
Usually Euler angle decompositions are used for SO(3). We introduce two potential alternatives to this approach based on double
coset decompositions described earlier.
Computed by direct evaluation:
Fast Approximate FFTs on SO(3) and SE(2)
Instead of using Euler angles to parameterize SO(3), we can develop different FFT algorithms based on different parameterizations and coset decompositions.
Specific property of IURs (irreducible unitary representations)
We use this property together with the double coset decomposition:
• The fact that on the fundamental domain centered on the identity 𝑈(𝑒𝑥𝑝𝑋, 𝑙) can be expressed as a truncated Taylor series in 𝑋 is then very useful because 𝑊 𝑋, 𝑙 will have polynomial entries, each of which can be computed by evaluation on their boundary.
• Therefore, the computation of the integral over 𝐹𝐻\𝑆𝑂(3)/𝐾 is efficient.
• We make a connection between Voronoi cells in the groups SO(3) and SE(2) centered on elements of discrete subgroups, and coset- and double-coset-spaces.
• We show that sampling within these Voronoi cells can be made almost uniform by exponentiating a Cartesian grid in a region of the corresponding Lie algebra, which is the pre-image of these cells under the exponential map.
• We show how the resulting cells, and the samples therein, can be used for searches, optimization, and Fourier analysis on certain Lie groups of interest in robotics and control.
Conclusions (for this part)
First Some Pretty Pictures from Old Work: Elastic Network Interpolation for the GroEL-GroES complex
What is the Structure of the Space of Motions of
Bodies that Move Collectively with Symmetry ?
Figure generated using ``Escher Mobile iphoneApp’’
developed in the group of G. Chapuis at EPFL
How to Characterize the Free Space of Motions of Bodies that Move Collectively with Symmetry ?
:electron density of a single protein; : Fourier transform;
:crystal symmetry operation (known); :rigid-body motion (unknown).
Protein X-Ray Crystallography
FilmDiffracted X-rays
Direct X-ray beam
Reflection
Diffraction pattern from X-ray crystallography experiment:
Electron density of a single-protein:
: the Cartesian coordinates of the i-th atoms; :the electron density map of i-th atom in a reference frame centered on it.
Symmetries in the Density Functionof a Protein Crystal
Rigid-Body Motions in Euclidean Space
Decomposing Continuous Motions
Discrete (Crystallographic) Motion Groups
Examples of Crystallographic Space Groups
Cosets, Quotients, and Fundamental Domains
Concrete Planar Examples
p4 =
Embeddings and Immersions of Motion Spaces in R^n
p1\SE(2) = T^3
Immersions of p4\SE(2) in R^6
Conclusions
• In protein crystals bodies are arranged with symmetry, but there is a hidden rigid-body motion that is important to find.
• This motion lives in a coset space (quotient of SE(3) by a discrete subgroup of crystallo-graphic symmetry operations).
• This paper characterizes this space (which is a manifold) and corresponding fundamental domains
References
G.S. Chirikjian, ``Mathematical Aspects of Molecular Replacement: I. Algebraic Properties of Motion Spaces,'‘ Acta. Cryst. A (2011). A67, 435–446
G.S. Chirikjian, Yan, Y., ``Mathematical Aspects of Molecular Replacement: II. Geometry of Motion Spaces,'‘ Acta. Cryst. A (2012). A68, 208-221.
Chirikjian, G.S., Stochastic Models, Information Theory, and Lie Groups: Volume 2 - Analytic Methods and Modern Applications,
Birkhauser, Dec. 2011.
Chirikjian, G.S., Kyatkin, A.B., Engineering Applications of Noncommutative Harmonic Analysis, CRC Press, 2001.