In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of...

61
In-Situ Surface Roughness Measurement of Laser Beam Melted Parts a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen 1 , Stefan Kleszczynski 2 , Alexander Ladewig 3 , Gerd Witt 2 and Dorit Merhof 1 1 RWTH Aachen University 2 University of Duisburg-Essen 3 MTU Aero Engines AG

Transcript of In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of...

Page 1: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts – a Feasibility Study of Layer Image Analysis

Joschka zur Jacobsmühlen1, Stefan Kleszczynski2, Alexander Ladewig3,

Gerd Witt2 and Dorit Merhof1

1RWTH Aachen University2University of Duisburg-Essen3MTU Aero Engines AG

Page 2: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

2

Motivation of Studies

Laser Beam Melting of Metal Components

• Production of complex and individual components

• Of special interest for aerospace and aero engine industry

• First production lines established at MTU Aero Engines AG in Munich, Germany

• High requirements quality assurance

process stability

reproducibility

11.08.2015

MTU Aero Engines AG

Page 3: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

3

Motivation

Surface Roughness

Target of optimization in LBM produced parts

Reduce post-processing

Optimize internal structures for which post-processing is impossible (e.g.

channels)

Related Work

• Minimization of surface roughness (Yasa and Kruth, 2011)

• Identification of dependencies between roughness and process parameters

(Strano, 2013)

• Inline 3D surface metrology using optical coherence tomography (Schmitt, 2013)

In-situ measurement is highly desirable

• Inspect surface roughness of internal surfaces

• Check fulfilment of design requirements

Page 4: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

4

Layer Image Acquisition

zur Jacobsmühlen, J.; Kleszczynski, S.; Schneider, D. & Witt, G.

High Resolution Imaging for Inspection of Laser Beam Melting Systems

IEEE International Instrumentation and Measurement Technology Conference (I2MTC), 2013

Page 5: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

5

Layer Images

scan line: ca. 90 µm 1 pixel: 25…35 µm

Page 6: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

6

Objective

Replicate physical surface roughness measurements

z

x

y

layer images

Page 7: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

7

Objective

Replicate physical surface roughness measurements

z

x

y

layer images

segmented contour

Page 8: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

8

Objective

Replicate physical surface roughness measurements

z

x

y

layer images

segmented contour

Page 9: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

9

Objective

Replicate physical surface roughness measurements

Extract surface profiles

z

x

y

layer images

segmented contour

Page 10: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

10

Objective

Replicate physical surface roughness measurements

Extract surface profiles

z

x

y

y

zlayer images

segmented contour

Page 11: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

11

Objective

Replicate physical surface roughness measurements

Extract surface profiles

z

x

y

y

zlayer images

segmented contour

Page 12: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

12

Objective

Replicate physical surface roughness measurements

Extract surface profiles

Compute surface roughness

z

x

y

y

zlayer images

segmented contour

Page 13: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

13

Outline

• Motivation

• Experimental Setup and Physical Measurements

• Segmentation of Part Contours

• Surface Profile Reconstruction

• Surface Roughness Measurements

• Results

• Discussion and Conclusion

Page 14: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

14

Experimental Setup and Physical Measurements

EOSINT M270, NickelAlloy IN718

• 2x 12 faces for measurements (outside and inside),

placed at multiples of 30°

• Measurement of 𝑅𝑧 (EN ISO 4287) using Mitutoyo

SJ-400 profilometer: divide each profile (A - C) into five segments

measure maximum peak-to-peak distance for each

segment 𝑅𝑧 (𝑖) compute average

• Average of three 𝑅𝑧 measurements yields surface

roughness for each pyramid face

• Part is built nine times: 216 measurements

11.08.2015

𝑅𝑧 =1

5

𝑖=1

5

𝑅𝑧(𝑖)

A

B

C

Kleszczynski, S.; Ladewig, A.; Friedberger, K.; zur Jacobsmühlen, J.; Merhof, D. & Witt, G.

Position Dependency of Surface Roughness in Parts from Laser Beam Melting Systems

Proceedings of the 26th Internation Solid Freeform Fabrication (SFF) Symposium, 2015

Page 15: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

15

Segmentation of Part Contours

• Goal: identify part boundary

• Powder appears as noise-like background edge detection yields false positive edges

Page 16: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

16

Segmentation of Part Contours

Difficult Regions

Page 17: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

17

Segmentation of Part Contours: Edge Detection 1

• Multiscale results

(fine to coarse)

• Many edges in powder regions

(fine scale)

• Combine scales for optimum

result

But: no closed boundary!

Problems

Jacob, M. & Unser, M.

Design of steerable filters for feature detection using

canny-like criteria

Pattern Analysis and Machine Intelligence, IEEE

Transactions on, 2004, 26, 1007 -1019

Page 18: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

18

Segmentation of Part Contours: Edge Detection 1

• Multiscale results

(fine to coarse)

• Many edges in powder regions

(fine scale)

• Combine scales for optimum

result

But: no closed boundary!

Problems

Jacob, M. & Unser, M.

Design of steerable filters for feature detection using

canny-like criteria

Pattern Analysis and Machine Intelligence, IEEE

Transactions on, 2004, 26, 1007 -1019

Page 19: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

19

Segmentation of Part Contours: Edge Detection 1

• Multiscale results

(fine to coarse)

• Many edges in powder regions

(fine scale)

• Combine scales for optimum

result

But: no closed boundary!

Problems

Jacob, M. & Unser, M.

Design of steerable filters for feature detection using

canny-like criteria

Pattern Analysis and Machine Intelligence, IEEE

Transactions on, 2004, 26, 1007 -1019

Page 20: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

20

Segmentation of Part Contours: Edge Detection 1

• Multiscale results

(fine to coarse)

• Many edges in powder regions

(fine scale)

• Combine scales for optimum

result

But: no closed boundary!

Problems

Jacob, M. & Unser, M.

Design of steerable filters for feature detection using

canny-like criteria

Pattern Analysis and Machine Intelligence, IEEE

Transactions on, 2004, 26, 1007 -1019

Page 21: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

21

Segmentation of Part Contours: Edge Detection 2

• Structured Forests for

edge detection• Incorporate texture

information

• Edges correlate to

subjective results

Still no closed boundary!

Robust Detection

Dollár, P. & Zitnick, C.

Structured Forests for Fast Edge Detection

Computer Vision (ICCV), 2013 IEEE International Conference on, 2013

Page 22: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

22

Segmentation of Part Contours: Graph Cuts

Find Optimum Region Boundaries

29 von 47

layer image

Page 23: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

23

Segmentation of Part Contours: Graph Cuts

Find Optimum Region Boundaries

• Represent each image pixel as node in a graph

29 von 47

layer image

Page 24: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

24

Segmentation of Part Contours: Graph Cuts

Find Optimum Region Boundaries

• Represent each image pixel as node in a graph

29 von 47

part pixel

layer image

Page 25: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

25

Segmentation of Part Contours: Graph Cuts

Find Optimum Region Boundaries

• Represent each image pixel as node in a graph

29 von 47

part pixel

powder pixel

layer image

Page 26: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

26

Segmentation of Part Contours: Graph Cuts

Find Optimum Region Boundaries

• Represent each image pixel as node in a graph

• Edges are assigned weights

29 von 47

part pixel

powder pixel

layer image

Page 27: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

27

Segmentation of Part Contours: Graph Cuts

Find Optimum Region Boundaries

• Represent each image pixel as node in a graph

• Edges are assigned weights High: strong link between neighbors: “don’t cut here”

29 von 47

part pixel

powder pixel

strong link

layer image

Page 28: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

28

Segmentation of Part Contours: Graph Cuts

Find Optimum Region Boundaries

• Represent each image pixel as node in a graph

• Edges are assigned weights High: strong link between neighbors: “don’t cut here”

Low: weak link between neighbors: “cut allowed”

29 von 47

part pixel

powder pixelweak link

strong link

layer image

Page 29: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

29

Segmentation of Part Contours: Graph Cuts

Find Optimum Region Boundaries

• Represent each image pixel as node in a graph

• Edges are assigned weights High: strong link between neighbors: “don’t cut here”

Low: weak link between neighbors: “cut allowed”

• Maximize flow between source s

and target t

29 von 47

part pixel

powder pixelweak link

strong link

layer image

Page 30: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

30

Segmentation of Part Contours: Graph Cuts

Find Optimum Region Boundaries

• Represent each image pixel as node in a graph

• Edges are assigned weights High: strong link between neighbors: “don’t cut here”

Low: weak link between neighbors: “cut allowed”

• Maximize flow between source s

and target t

• Cut weak edges to form regions

29 von 47

part pixel

powder pixelweak link

strong link

layer image

Page 31: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

31

Segmentation of Part Contours: Graph Cuts

Find Optimum Region Boundaries

• Represent each image pixel as node in a graph

• Edges are assigned weights High: strong link between neighbors: “don’t cut here”

Low: weak link between neighbors: “cut allowed”

• Maximize flow between source s

and target t

• Cut weak edges to form regions

29 von 47

part pixel

powder pixelweak link

strong linkcut

layer image

Page 32: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

32

Segmentation of Part Contours

Weight Assignment

segmentation

region

Page 33: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

33

Segmentation of Part Contours

• Set labels for definitive part and

powder regions („keep regions“)

Weight Assignment

powder

segmentation

region

powder

Page 34: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

34

Segmentation of Part Contours

• Set labels for definitive part and

powder regions („keep regions“)

Weight Assignment

powder

segmentation

region

powder

Page 35: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

35

Segmentation of Part Contours

• Set labels for definitive part and

powder regions („keep regions“)

• Set low edge weight for pixels with

edges („cut at edges“)

Weight Assignment

powder

segmentation

region

powder

Page 36: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

36

Segmentation of Part Contours

• Set labels for definitive part and

powder regions („keep regions“)

• Set low edge weight for pixels with

edges („cut at edges“)

Weight Assignment

powder

segmentation

region

low

similarity

on edges

powder

Page 37: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

37

Segmentation of Part Contours

• Set labels for definitive part and

powder regions („keep regions“)

• Set low edge weight for pixels with

edges („cut at edges“)

Weight Assignment

powder

segmentation

region

low

similarity

on edges

powder

double

boundary

Page 38: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

38

Segmentation of Part Contours

• Set labels for definitive part and

powder regions („keep regions“)

• Set low edge weight for pixels with

edges („cut at edges“)

• Assign lower weights to outer regions

(„prefer outer boundary for cut“)

Weight Assignment

powder

segmentation

region

low

similarity

on edges

powder

double

boundary

Page 39: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

39

Segmentation of Part Contours

• Set labels for definitive part and

powder regions („keep regions“)

• Set low edge weight for pixels with

edges („cut at edges“)

• Assign lower weights to outer regions

(„prefer outer boundary for cut“)

Weight Assignment

powder

segmentation

region

low

similarity

on edges

low

weights

high

weights

powder

double

boundary

Page 40: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

40

Segmentation of Part Contours: Accuracy

Comparison of Edge Detectors

31 von 47

• Compared to manually annotated ground truth

• bidirectional local distance measure

Kim et al. Bidirectional local distance measure for comparing segmentations

Medical Physics, 2012, 39, 6779-6790

Median: 39.1 µm Median: 27.7 µm

Page 41: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

41

Segmentation of Part Contours: Accuracy

Comparison of Edge Detectors

31 von 47

• Compared to manually annotated ground truth

• bidirectional local distance measure

Kim et al. Bidirectional local distance measure for comparing segmentations

Medical Physics, 2012, 39, 6779-6790

Median: 39.1 µm Median: 27.7 µm

Page 42: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

42

Segmentation of Part Contours: Errors

Glare / shadows introduce edges inside of part

33 von 47

Page 43: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

43

Surface Profile Reconstruction

Measurement Profiles

• Measure surface roughness of pyramid segments

• Use multiple profiles to capture roughness statistics Additional rays at +/- 3° for each face

z y

layer images

segmented contour

Page 44: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

44

Surface Profile Reconstruction

Measurement of Internal and External Contour

• Intersections of radial rays and contours yield surface points

• Surface profile as difference of segmented contour and reference geometry

Page 45: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

45

Surface Profile Reconstruction

Roughness Component from Filtration according to ISO16610-21

• Limit wavelength λc=2,5 mm

Page 46: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

46

Surface Roughness Measurement

Visualization

• Determine Rz from reconstructed surface profiles (ISO16610-21)

• Average three values of Rz for each face

Page 47: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

47

Results

Compare to profilometer

measurements (gray)

• Normalized values for

analysis of correlation

• Deviations are not

captured correctly

No consistent correlation

Page 48: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

48

Results

• Comparison against profilometer measurements• Absolute error [µm]

• Error between normalized measurements

• Absolute error is very high (reference value range: 70…160 µm)

• Most normalized roughness values are too low (some large outliers)

Median: 131.3 µm Median: -0.135

Page 49: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

49

Discussion

32 von 47

Page 50: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

50

Discussion

• Image resolution (20…30 µm/px) may be too low to capture

roughness deviations (20…50 µm)

32 von 47

Page 51: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

51

Discussion

• Image resolution (20…30 µm/px) may be too low to capture

roughness deviations (20…50 µm)

• Accuracy of segmentation: median error 27.7 µm

32 von 47

Page 52: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

52

Discussion

• Image resolution (20…30 µm/px) may be too low to capture

roughness deviations (20…50 µm)

• Accuracy of segmentation: median error 27.7 µm

32 von 47

Kleszczynski, S.; Ladewig, A.; Friedberger, K.; zur Jacobsmühlen, J.; Merhof, D. & Witt, G.

Position Dependency of Surface Roughness in Parts from Laser Beam Melting Systems

Proceedings of the 26th Internation Solid Freeform Fabrication (SFF) Symposium, 2015

Page 53: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

53

Discussion

• Image resolution (20…30 µm/px) may be too low to capture

roughness deviations (20…50 µm)

• Accuracy of segmentation: median error 27.7 µm

32 von 47

Kleszczynski, S.; Ladewig, A.; Friedberger, K.; zur Jacobsmühlen, J.; Merhof, D. & Witt, G.

Position Dependency of Surface Roughness in Parts from Laser Beam Melting Systems

Proceedings of the 26th Internation Solid Freeform Fabrication (SFF) Symposium, 2015

Page 54: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

54

Discussion

• Image resolution (20…30 µm/px) may be too low to capture

roughness deviations (20…50 µm)

• Accuracy of segmentation: median error 27.7 µm

• Melt extensions below current layer are possible cause of

roughness deviations

32 von 47

Kleszczynski, S.; Ladewig, A.; Friedberger, K.; zur Jacobsmühlen, J.; Merhof, D. & Witt, G.

Position Dependency of Surface Roughness in Parts from Laser Beam Melting Systems

Proceedings of the 26th Internation Solid Freeform Fabrication (SFF) Symposium, 2015

Page 55: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

55

Discussion

• Image resolution (20…30 µm/px) may be too low to capture

roughness deviations (20…50 µm)

• Accuracy of segmentation: median error 27.7 µm

• Melt extensions below current layer are possible cause of

roughness deviations• Cannot be captured by layer images

32 von 47

Kleszczynski, S.; Ladewig, A.; Friedberger, K.; zur Jacobsmühlen, J.; Merhof, D. & Witt, G.

Position Dependency of Surface Roughness in Parts from Laser Beam Melting Systems

Proceedings of the 26th Internation Solid Freeform Fabrication (SFF) Symposium, 2015

Page 56: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

56

Conclusion

Page 57: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

57

Conclusion

• Image-based method for in-situ measurement of surface roughness• Replicates physical measurement method

• Extract surface profiles from contour segmentation

Page 58: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

58

Conclusion

• Image-based method for in-situ measurement of surface roughness• Replicates physical measurement method

• Extract surface profiles from contour segmentation

• High measurement errors compared to reference profilometry in experiments

Page 59: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

59

Conclusion

• Image-based method for in-situ measurement of surface roughness• Replicates physical measurement method

• Extract surface profiles from contour segmentation

• High measurement errors compared to reference profilometry in experiments

• Not suitable for direct quantitative measurements

Page 60: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts – a Feasibility Study of Layer Image Analysis

Joschka zur Jacobsmühlen1, Stefan Kleszczynski2, Alexander Ladewig3,

Gerd Witt2 and Dorit Merhof1

1RWTH Aachen University2University of Duisburg-Essen3MTU Aero Engines AG

Page 61: In-Situ Surface Roughness Measurement of Laser Beam …In-Situ Surface Roughness Measurement of Laser Beam Melted Parts –a Feasibility Study of Layer Image Analysis Joschka zur Jacobsmühlen1,

In-Situ Surface Roughness Measurement of Laser Beam Melted Parts |

DDMC 2016 | Institute of Imaging and Computer Vision | 16.03.2016

61

References

• zur Jacobsmühlen, J.; Kleszczynski, S.; Schneider, D. & Witt, G.

High Resolution Imaging for Inspection of Laser Beam Melting Systems

IEEE International Instrumentation and Measurement Technology Conference (I2MTC)

2013, 2013, 707-712

• Kleszczynski, S.; Ladewig, A.; Friedberger, K.; zur Jacobsmühlen, J.; Merhof, D. & Witt, G.

Position Dependency of Surface Roughness in Parts from Laser Beam Melting Systems

Proceedings of the 26th Internation Solid Freeform Fabrication (SFF) Symposium, 2015

• Schmitt, R.; Pfeifer, T. & Mallmann, G.

Machine integrated telecentric surface metrology in laser structuring systems

ACTA IMEKO, 2013, 2, 73-77

• Strano, G.; Hao, L.; Everson, R. M. & Evans, K. E.

Surface roughness analysis, modelling and prediction in selective laser melting

Journal of Materials Processing Technology , 2013, 213, 589 - 597

• Yasa, E. & Kruth, J.

Application of Laser Re-Melting on Selective Laser Melting Parts

Advances in Production Engineering & Management, 2011, 6, 259-270