Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides ›...

14
Fabian Wahlster Technische Universität München – UX3D Nicolai Hähnle AMD Implementing SPMD control flow in LLVM using reconverging CFGs

Transcript of Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides ›...

Page 1: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

Fabian Wahlster

Technische Universität München – UX3D

Nicolai Hähnle

AMD

Implementing SPMD control flow in LLVM using reconverging CFGs

Page 2: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

Src: A. Sabne, P. Sakdhnagool, and R. Eigenmann

“Formalizing Structured ControlFlowGraphs.”

2Fabian Wahlster | Vectorising Divergent Control-Flow for SIMD Applications

Divergence on wide SIMD

Src: D. Lively and H. Gruen. “Wave Programming in D3D12 and Vulkan”

Page 3: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

3Fabian Wahlster | Vectorising Divergent Control-Flow for SIMD Applications

Converting thread-level code to wave-level ISA

M. Mantor and M. Houston: AMD Graphic Core Next Architecture, Fusion 11 Summit presentation

Page 4: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

4Fabian Wahlster | Vectorising Divergent Control-Flow for SIMD Applications

Structurization in LLVM

StructurizeCFG

pass

Unnecessary

flow blocks

Page 5: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

5Fabian Wahlster | Vectorising Divergent Control-Flow for SIMD Applications

Definition:

• Every non-uniform terminator B (conditional branch) has exactly two successors

• One of which post-dominates B

Reconverging CFGs

primary successor

secondary successor

Page 6: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

For each conditional non-uniform node N:

• Virtual register m holds re-join mask for basic block N

• Subtract m from the exec register to direct control flow to

secondary successor

• Add m the exec register at the beginning of the primary

successor to re-join divergent threads

• m must be correctly initialized to avoid unrelated data being

merged into the execution mask

6Fabian Wahlster | Vectorising Divergent Control-Flow for SIMD Applications

Lowering Reconverging CFGs

Page 7: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

Approach:

• Maintain open tree OT structure containing unprocessed open

edges to reroute control flow towards the exit node by inserting

new flow blocks

Ordering:

• Compute basic block ordering in which to process input CFG

• Ordering is based on traversal of the input CFG

• Any ordering is viable as long as the exit node comes last

• Quality of reconverging CFG depends on the input ordering

7Fabian Wahlster | Vectorising Divergent Control-Flow for SIMD Applications

Transforming to reconverging control flow

OpenTree OT

Page 8: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

Processing nodes:

• Nodes of the OT have sets of open Incoming and Outgoing

edges that need to be processed

• An outgoing edge (A, B) is closed if A has already been visited

when B is being processed

• A node can be closed if both sets are emptied by processing

• Closed nodes are removed from the OT and their child nodes

moved to its parent

• Divergent nodes are called armed if one of the outgoing edges

has already been closed

8Fabian Wahlster | Vectorising Divergent Control-Flow for SIMD Applications

Open Tree Structure

armed

parent

outgoing

closed

Page 9: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

9Fabian Wahlster | Vectorising Divergent Control-Flow for SIMD Applications

Transforming to reconverging control flow

Input CFG Added A Processing C…

A → C → B → D

Initialize OT

Page 10: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

10Fabian Wahlster | Vectorising Divergent Control-Flow for SIMD Applications

Transforming to reconverging control flow

Input CFG Adding FLOW

A → C → B → D

Processing C…

Output CFG

Page 11: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

11Fabian Wahlster | Vectorising Divergent Control-Flow for SIMD Applications

Transforming to reconverging control flow

A:%cc_A = icmp eq i32 %in_A, 0br i1 %cc_A, label %FLOW0, label %C

B:br label %D

FLOW0:%0 = phi i1 [ true, %A ], [ false, %C ]br i1 %0, label %B, label %D

C:%cc_C = icmp eq i32 %in_C, 0br i1 %cc_C, label %A, label %FLOW0

D:ret void

Reconverging CFG

Page 12: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

12Fabian Wahlster | Vectorising Divergent Control-Flow for SIMD Applications

Input Ordering Exit Condition

Input CFG

Depth First:

Page 13: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

13Fabian Wahlster | Vectorising Divergent Control-Flow for SIMD Applications

Input Ordering Comparison

RPOT:

Breadth First:

Depth First:

Page 14: Implementing SPMD control flow in LLVM using ... › devmtg › 2019-04 › slides › SRC-Wahlster...$ P % P FRQG % ! ' H[HF a P & ' H[HF _ P Fabian Wahlster Technische Universität

Contributions:

• New SPMD vectorization approach

• Simple and concise definition of Reconvergence for CFGs (weaker than structuredness)

• Proof-of-Concept lowering algorithm and CFG transformation

Properties:

• Support for unstructured and irreducible input CFGs

• Preserves uniform control flow

• Retains CFGs that are already reconverging

• Insert fewer new basic blocks than structurization (StructurizeCFG)

14Fabian Wahlster | Vectorising Divergent Control-Flow for SIMD Applications

Reconverging Control-Flow Graphs


14th & 15th - TMACADEMY · P. Seferovic • The EU HF guidelines approach - P. Ponikowski • The US HF guidelines approach - I. Piña • The importance of real-world evidence (RWE)

14th & 15th - TMACADEMY · P. Seferovic • The EU HF guidelines approach - P. Ponikowski • The US HF guidelines approach - I. Piña • The importance of real-world evidence (RWE)

EQI-80 RS HF EQI-70 VN HF EQI-70 RS HF

EQI-80 RS HF EQI-70 VN HF EQI-70 RS HF

KM C258-20180125110025 · pnev 40 hf pnev hf pne60x20 hf pne60x202z hf pne80x20 hf pne80x202z hf pneioox20 hf pneioox202z hf lp-35/1z hf lp-35/2z i-if lp-35/2zs hf pn80x25 hf pn80x252z

KM C258-20180125110025 · pnev 40 hf pnev hf pne60x20 hf pne60x202z hf pne80x20 hf pne80x202z hf pneioox20 hf pneioox202z hf lp-35/1z hf lp-35/2z i-if lp-35/2zs hf pn80x25 hf pn80x252z

Heart failure with preserved ejection fraction ( HF p EF )

Heart failure with preserved ejection fraction ( HF p EF )

zop-zo HS BßSJŒTBßLL · 'hf 'hf 'hf 'hf 'hf 'hf -dq -dq -dq -dq -dq -dq -dq -dq -dq )he )he )he )he )he )he

zop-zo HS BßSJŒTBßLL · 'hf 'hf 'hf 'hf 'hf 'hf -dq -dq -dq -dq -dq -dq -dq -dq -dq )he )he )he )he )he )he

239.- · 2 x P-33037 P-20155 Schleifpapier 6 assortierte für Klammern Schleifbänder Korn 100 / 2x10 Stk Korn 40/80/100 (Wert HF 302.-(Wert HF 24.-(Wert 2x HF 7.50 9911J LS1216L

239.- · 2 x P-33037 P-20155 Schleifpapier 6 assortierte für Klammern Schleifbänder Korn 100 / 2x10 Stk Korn 40/80/100 (Wert HF 302.-(Wert HF 24.-(Wert 2x HF 7.50 9911J LS1216L

Perspektiven der Informatik Ringvorlesung WS 2002/2003 Wolfgang Wahlster Fachrichtung Informatik Universität des Saarlandes & Deutsches Forschungszentrum.

Perspektiven der Informatik Ringvorlesung WS 2002/2003 Wolfgang Wahlster Fachrichtung Informatik Universität des Saarlandes & Deutsches Forschungszentrum.

取扱説明書 ホームフリーザー HF-10CP/HF-21CPpanasonic.jp/manualdl/p-db/HF/HF-10CP.pdfHF-10CP HF-21CP この取扱説明書をよくお読みいただき、正しくお使い

取扱説明書 ホームフリーザー HF-10CP/HF-21CPpanasonic.jp/manualdl/p-db/HF/HF-10CP.pdfHF-10CP HF-21CP この取扱説明書をよくお読みいただき、正しくお使い

hf · k'tnLahf/ gu/kflnsf :ofª\hf cfly{s sfo{ljwL lgoldt ug{ ag]sf] P]g, @)&% :yfgLo /fhkq v08M!÷;+VofM@÷ ldltM @)&%÷)#÷)# efu–! | |

hf · k'tnLahf/ gu/kflnsf :ofª\hf cfly{s sfo{ljwL lgoldt ug{ ag]sf] P]g, @)&% :yfgLo /fhkq v08M!÷;+VofM@÷ ldltM @)&%÷)#÷)# efu–! | |

1 HFSystemSimulation1.PPTCopyright © 2003 by Richard P. Buckner, P. E. HF SYSTEM SIMULATION TECHNIQUES by Richard P. Buckner, P. E.

1 HFSystemSimulation1.PPTCopyright © 2003 by Richard P. Buckner, P. E. HF SYSTEM SIMULATION TECHNIQUES by Richard P. Buckner, P. E.

STAR 8 - NOVA Medical Products · vt-33207 bearing for swivel front fork each p-cable brake cable (pair) pair hf-425821 brake cable holder pair hf-425809 brake shoe (set) set hf-420506

STAR 8 - NOVA Medical Products · vt-33207 bearing for swivel front fork each p-cable brake cable (pair) pair hf-425821 brake cable holder pair hf-425809 brake shoe (set) set hf-420506

Courses with General Education Classification Revised: … Introduction to Art HF HF HF HF ART-111 Art Appreciation HF HF HF HF-AA/AS HF HF HF HF ART-113 Art Methods and Materials

Courses with General Education Classification Revised: … Introduction to Art HF HF HF HF ART-111 Art Appreciation HF HF HF HF-AA/AS HF HF HF HF ART-113 Art Methods and Materials

HF Portable Loop Antenna 2.0 (CHA P-LOOP 2.0) · 2017-04-11 · CHA P-LOOP 2.0 Page 3 Introduction Thank you for purchasing and using the Chameleon AntennaTM High Frequency (HF) Portable

HF Portable Loop Antenna 2.0 (CHA P-LOOP 2.0) · 2017-04-11 · CHA P-LOOP 2.0 Page 3 Introduction Thank you for purchasing and using the Chameleon AntennaTM High Frequency (HF) Portable

G Opsomer en M Van Eetvelde€¦ · Primi HF Primi BB Multi HF Multi BB * * * * P

G Opsomer en M Van Eetvelde€¦ · Primi HF Primi BB Multi HF Multi BB * * * * P

Índice - images.philips.comimages.philips.com/is/content/PhilipsConsumer/PDFDownloads/Spain/... · hf-p 136 tl-d iii idc 9137130315 1 hf-p 236 tl-d iii idc 9137130316 2 hf-p 336

Índice - images.philips.comimages.philips.com/is/content/PhilipsConsumer/PDFDownloads/Spain/... · hf-p 136 tl-d iii idc 9137130315 1 hf-p 236 tl-d iii idc 9137130316 2 hf-p 336

INTEGRATE-HTA How to integrate apples and oranges? – A systematic review of approaches to integrate different dimensions in HTA P. Wahlster a, R. Baltussen.

INTEGRATE-HTA How to integrate apples and oranges? – A systematic review of approaches to integrate different dimensions in HTA P. Wahlster a, R. Baltussen.

Lokale Netze Namensliste Lisa Wahlster Hatice Yilmaz Andrea Rovezzi.

Lokale Netze Namensliste Lisa Wahlster Hatice Yilmaz Andrea Rovezzi.

Hf I f rEfrlllil-i Ullill/A ^ |i*^ ^Uia^ Pjl Ma Ml P]

Hf I f rEfrlllil-i Ullill/A ^ |i*^ ^Uia^ Pjl Ma Ml P]

Bezdrátový GSM alarm HF-GSM02...HF-GSM02 7 3. PROCES ZAPOJENÍ DŮLEŽITÁ UPOZORN ĚNÍ: ① Nikdy nepropojujte drátové p říslušenství s centrální jednotkou pod proudem,

Bezdrátový GSM alarm HF-GSM02...HF-GSM02 7 3. PROCES ZAPOJENÍ DŮLEŽITÁ UPOZORN ĚNÍ: ① Nikdy nepropojujte drátové p říslušenství s centrální jednotkou pod proudem,

Legria Hf r56 Legria Hf r57 Legria Hf r506 Instruction Manual Es

Legria Hf r56 Legria Hf r57 Legria Hf r506 Instruction Manual Es