Automatic Adaptive Sampling in Parametric Model Order ...

33
Chair of Automatic Control Department of Mechanical Engineering Technical University of Munich Control and Automation Group Department of Electrical Engineering Indian Institute of Technology-Delhi Automatic Adaptive Sampling in Parametric Model Order Reduction by Matrix Interpolation Maria Cruz Varona*, Mashuq-un-Nabi , Boris Lohmann § * § Chair of Automatic Control, Technical University of Munich, Germany Department of Electrical Engineering, Indian Institute of Technology Delhi, India July 4th, AIM 2017

Transcript of Automatic Adaptive Sampling in Parametric Model Order ...

Page 1: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

Automatic Adaptive Sampling in Parametric

Model Order Reduction by Matrix Interpolation

Maria Cruz Varona*, Mashuq-un-Nabi‡, Boris Lohmann§

*§Chair of Automatic Control,

Technical University of Munich, Germany

‡Department of Electrical Engineering,

Indian Institute of Technology Delhi, India

July 4th, AIM 2017

Page 2: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

Large-scale full order model (FOM)

2

Motivation

MOR

Reduced order model (ROM)

Page 3: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

3

Projective Model Order Reduction

Petrov-Galerkin projection:

Approximation of the state vector:

Page 4: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

Moments of a transfer function

4

Rational Interpolation by Krylov subspace methods

: i-th moment around

Bases for input and output Krylov-subspaces:

Moments from full and reduced order model around certain shifts match!

100

101

102

103

-100

-90

-80

-70

-60

-50

-40

Magnit

ude

/dB

Frequency / rad/ sec

original

Moment Matching by Rational Krylov (RK) subspaces

Krylov subspace:

Page 5: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

Large-scale parametric model

5

Parametric Model Order Reduction (pMOR)

Flow sensing anemometerTimoshenko beam

pMOR

Reduced order parametric model

• Linear dynamic systems with design parameters (e.g. material / geometry parameters,…)

• Goal: numerically efficient reduction with preservation of the parameter dependency

Solar panels

Page 6: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

6

pMOR by Matrix Interpolation – Main Idea

?

Model at Model at

Reduced model at Reduced model at

Model at

Reduced model at

Interpolation of

reduced matrices

Reduced model at from reduced

models at sample points &

Page 7: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

7

pMOR by Matrix Interpolation – Procedure

1.) Individual reduction

direct interpolation

not meaningful

?

[Panzer et al. ’10]

Page 8: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

How to choose and ?

8

pMOR by Matrix Interpolation – Procedure[Panzer et al. ’10]

1.) Individual reduction

2.) Transformation to generalized coordinates

High

correlation

:

Goal: Adjustment of the local bases to

, in order to make the gen.

coordinates compatible w.r.t. a

reference subspace .

Dual procedure for the local bases

Page 9: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

9

pMOR by Matrix Interpolation – Procedure

1.) Individual reduction

2.) Transformation to generalized coordinates

3.) Interpolation

But: how to choose the sample points??

[Panzer et al. ’10]

Page 10: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

10

Adaptive Sampling

Requirements:

• Parametric space should be adequately

sampled

• Avoid undersampling and oversampling

• More parameter samples should be placed

in highly sensitive zones

Uniform Sampling:

Adaptive Sampling:Quantification of parametric sensitivity:

• System-theoretic measure that quantifies

the parametric sensitivity is needed in order

to guide the adaptive refinement

• Adaptive sampling using angle between

subspaces

Page 11: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

• and are orthonormal bases for the

subspaces and

• The largest angle between the subspaces

can be determined by

: smallest singular value of

Concept of subspace angles:

11

Adaptive Sampling via subspace angles

Usage for adaptive grid refinement:

• The larger the subspace angle, the more

different are the projection matrices, and thus:

the higher the parametric sensitivity

and the more sample points can be

introduced in the respective sub-span

Page 12: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

1) Input

2) Divide the entire parameter range into a uniform grid,

calling it

3) While all do

a) Calculate the projection matrices

corresponding to each of these values

b) Compute subspace angles

between these ´s, each taken pairwise

c) Calculate

d) Divide the interval between and into further

intervals. Likewise, do the same for all the other

intervals.

e) Obtain new grid points , whereas

End While12

Automatic Adaptive Sampling: Pseudo-Code

Next iteration: local reduction,

etc. only at points that got

added in the last while-loop

iteration (efficient!)

theta(i) =

subspace(Vp{i},Vp{i+1})

Quantitative indicator of how

many pieces each parameter

interval is to be further broken

Local reduction at sample

points possible using any

preferred MOR technique

Stopping criterion:

1. All ratios are equal to 1

2. Specified maximum number

2. of samples points reached

Page 13: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

• Finite element 3D model of a Timoshenko beam

• Parameter is the length of the beam:

• One-sided Krylov reduction with shifts at

• chosen

13

Numerical example: Timoshenko Beam

Page 14: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

14

Numerical example: Timoshenko Beam

Initial uniform grid with

Final refined grid with

Adaptive S

am

plin

g S

chem

e

Interpolation point

between ROM 3 & ROM 4

Page 15: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

15

Numerical results – Direct vs. Interpolated ROM

FOM size n = 240, ROMs size r = 17 FOM size n = 2400, ROMs size r = 25

Two errors: model reduction error + interpolation error

Page 16: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

16

Numerical results – Direct vs. Interpolated ROM

With MatrInterp: no need to reduce the model for every new parameter value

FOM size n = 2400, ROMs size r = 25FOM size n = 2400, ROMs size r = 25

Page 17: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

17

Numerical results – Initial vs. Final Grid

ROMs calculated with the final grid yield better approximations

FOM size n = 2400, ROMs size r = 25FOM size n = 240, ROMs size r = 17

Page 18: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

18

Numerical results – Initial vs. Final Grid

ROMs calculated with the final grid yield better approximations

FOM size n = 2400, ROMs size r = 25FOM size n = 2400, ROMs size r = 25

Page 19: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

19

Numerical results – Initial vs. Final Grid

Relative H2 error between FOMs and

interpolated ROMs for different parameter

values and grids: FOM size n = 240, ROM

size r = 17

• Quantitative evaluation of the

approximation

• Relative H2 error for nP=100 different

query points

• Errors particularly small in the

proximity of the sample points

• Final grid yields smaller errors for

smaller beam lengths due to the

adaptive refinement in this region

Page 20: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

20

Toolbox – Analysis and Reduction of

Parametric Models in

Different parametric reduction methods

available (offline- & online-phase)

localReduction & adaptiveSampling

as core functions

Definition of parametric sparse state-

space models

Manipulation of psss-class objects

Compatible with the sss & sssMOR

toolboxes

psys = loadFemBeam3D(Opts)

psys = loadAnemometer3parameter

psys = fixParameter(psys,2,1.7)

psys = unfixParameter(psys,3)

param = [p1, p2, p3, p4]

sys = psys(param)

bode(psys,param); step(sys);

psysr = matrInterpOffline

(psys,param,r,Opts);

psysr = globalPmorOffline

(psys,param,r,Opts)

sysr = psysr(pInterp)

www.rt.mw.tum.de/?morlab

Page 21: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

Takehome Messages:

• A simple automatic sampling strategy is presented for adaptively choosing sample

points in parametric model order reduction

• Scheme uses concept of subspace angles to measure need of further sampling points

• Adaptive approach is fully automated and embedded in the matrix interpolation

framework

• Algorithm is applied to a Timoshenko beam model, achieving satisfactory results.

Future Extensions / Ongoing Work:

• Extension of proposed adaptive sampling scheme to 2D and 3D parametric case

• Higher dimensional case (d > 3) with adaptive sparse grids is topic of future research

• psssMOR toolbox is being actively developed and will be available open-source very soon!!

21

Summary & Outlook

Thank you for your attention!

Page 22: Automatic Adaptive Sampling in Parametric Model Order ...

22

Backup

Page 23: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

23

References

[Amsallem ’10] Interpolation on manifolds of CFD-based fluid and finite element-

based structural reduced-order models for on-line….

[Bazaz et al. ’15] Adaptive Parameter Space Sampling in Matrix Interpolatory pMOR.

[Benner et al. ’15] A survey of projection-based model reduction methods for

parametric dynamical systems.

[Baur et al. ’15] Comparison of methods for parametric model order reduction of

instationary problems.

[Geuss et al. ’08] On Parametric Model Order Reduction by Matrix Interpolation.

[Panzer et al. ’10] Parametric Model Order Reduction by Matrix Interpolation.

Page 24: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

24

Numerical results – Direct vs. Interpolated ROM

FOM size n = 2400, ROMs size r = 25FOM size n = 240, ROMs size r = 17

Page 25: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

25

Numerical results – Direct vs. Interpolated ROM

FOM size n = 2400, ROMs size r = 25FOM size n = 240, ROMs size r = 17

Page 26: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

26

Numerical results – Initial vs. Final Grid

FOM size n = 2400, ROMs size r = 25FOM size n = 240, ROMs size r = 17

Page 27: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

27

Numerical results – Initial vs. Final Grid

FOM size n = 2400, ROMs size r = 25FOM size n = 240, ROMs size r = 17

Page 28: Automatic Adaptive Sampling in Parametric Model Order ...

sss & sssMOR – MATLAB Toolboxes

28

Page 29: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

Powered by: M-M.E.S.S. toolbox [Saak, Köhler, Benner] for Lyapunov equations

Available at www.rt.mw.tum.de/?sssMOR

[Castagnotto/Cruz Varona/Jeschek/Lohmann ’17]: „sss & sssMOR: Analysis and

Reduction of Large-Scale Dynamic Systems in MATLAB“, at-Automatisierungstechnik] 29

Toolboxes for sparse, large-scale models in

sys = sss(A,B,C,D,E); sysr = tbr(sys,r)

sysr = rk(sys,s0)

sysr = irka(sys,s0)

sysr = cure(sys)

sysr = cirka(sys,s0)

bode(sys), sigma(sys)

step(sys), impulse(sys)

norm(sys,2), norm(sys,inf)

c2d, lsim, eigs, connect,…

Page 30: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

30

Main characteristics

State-space models of very high order

on a standard computer

Many Control System Toolbox functions,

revisited to exploit sparsity

Allows system analysis in frequency (bode, sigma, …) and

time domain (step,norm,lsim,…), as

well as manipulations(connect,truncate,…)

Is compatible with the built-in syntax

New functionality: eigs, residue,

pzmap,…

Classical (modalMor, tbr, rk,…) and

state-of-the-art (isrk, irka, cirka,

cure,…) reduction methods

Both highly-automatizedsysr = irka(sys,n)

and highly-customizableOpts.maxiter = 100

Opts.tol = 1e-6

Opts.stopcrit = ‘combAll’

Opts.verbose = true

sysr = irka(sys,n,Opts)

solveLse and lyapchol as core

functions

Page 31: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

Comprehensive

documentation with

examples and references

sssMOR App

graphical user interface

completely free

and open source

(contributions welcome)

Page 32: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

Comprehensive

documentation with

examples and references

sssMOR App

graphical user interface

completely free

and open source

(contributions welcome)

Page 33: Automatic Adaptive Sampling in Parametric Model Order ...

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Control and Automation GroupDepartment of Electrical Engineering Indian Institute of Technology-Delhi

Comprehensive

documentation with

examples and references

sssMOR App

graphical user interface

completely free

and open source

(contributions welcome)