Kyle Dymowski Automated DOMM Detection in TEM...

20
Automated DOMM Detection in TEM Imagery By Kyle Dymowski

Transcript of Kyle Dymowski Automated DOMM Detection in TEM...

Page 1: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Automated DOMM Detection in TEM Imagery 

By Kyle Dymowski

Page 2: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

What is DOMM

• DNA Origami Machines and Mechanisms

Page 3: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Motivation

• Josh Johnson –M.S. 2014 Applied Physics– Currently working on at OSU

Page 4: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx
Page 5: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Problem Domain

• Transmission electron microscopy– Noise related to the process

• Filtering• Edge Detection • Normalized Cross Correlation

Page 6: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Assumptions

• Does not need to capture all DOMM in the image. 

• All images will be similar. 

Page 7: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Previous Works

• Auto‐adaptive Algorithm for the Stacking‐Level Estimation of Membranes in TEM Images

Page 8: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

• TEM Images of Membrains: A Multiresolution Edge‐Detection Approach for Watershed Segmentation

Page 9: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx
Page 10: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Development

• Removing the noise• Gaussian in nature 

Page 11: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Results of Noise RemovalMedian Filtering size 10x10 

Before After

Page 12: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Visual Representation, actual images are complemented 

Page 13: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Canny Edge Detection

• Must crop out lower 320 pixels to remove information tag of image

• This was causing issues for auto thresh of gray levels

Page 14: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

• Average Canny edge returned a threshOut of: 

[0.01875,0.04687]

Simply multiplying this by a scaler of 2 resulted in images like the following.

Page 15: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Building the Templates

• GIMP 2

Page 16: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Normalized Cross Correlation

• Check image for all rotations at 5 degree increments

• Using a normxcorr2 only returned Correlation coefficients high than .31 were considered.

Page 17: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Results

72% of the expected mechanisms found4% were false positives28 repeated structures

Page 18: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Increasing Results

• Can find a considerable larger amount of mechanisms if correlation coefficient is lowered

• Problems– Increase occurrence of finding the same mechanism considerably

– Increase in finding false positives

Page 19: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx

Achievements / Further Work

• While only 72% accurate structures are extracted at a fraction of the time

• Automatic alignment has been achieved with‐in a tolerance of  degrees

• Second set of images provided were not the visually similar. 

Page 20: Kyle Dymowski Automated DOMM Detection in TEM Imageryinside.mines.edu/~whoff/courses/EENG510/projects/... · Microsoft PowerPoint - Kyle Dymowski Automated DOMM Detection in TEM Imagery.pptx