WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of...
Transcript of WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of...
![Page 1: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/1.jpg)
WALL-E
Yini Wang; Ran Mo
![Page 2: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/2.jpg)
Development Team
Yini Wang: Photomultiplier Tube & Machine Learning
Ran Mo: Video Processing & Machine Learning
![Page 3: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/3.jpg)
Problem Specification
● Study cypridinid ostracods● Record videos of the bioluminescence● Record light levels with extreme precision● Recognize species
![Page 4: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/4.jpg)
Previous WALL-E
● Watec Camera● Frame Synchronizing● Create 3D map of ostracod light
pulses
![Page 5: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/5.jpg)
Proposed Solutions
● Use PhotoMultiplier Tube (PMT) to record overall light levels● Collect data from Watec Cameras● Post processing the recorded videos (de-noising, convert to RGB)● Build a neural network to recognize cypridinid ostracods
![Page 6: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/6.jpg)
Block Diagram
![Page 7: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/7.jpg)
PhotoMultiplier Tube (PMT)
Hamamatsu H11890-210
● I/O interface: USB Port● Power supply: single board computer● Spectral response: 230 to 700 nm● Effective area diameter: 8 mm
![Page 8: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/8.jpg)
LattePanda computer (Windows 10)
LattePanda single board computer V1.0
● Processor: Intel Cherry Trail Z8359 Quad Core Processor● Base Frequency: 1.44 GHz (1.92 GHz Burst Frequency)● Operating System: Windows 10 Home Edition● RAM: 2GB● Storage Capacity: 32GB● Power Supply: 5V@2A
![Page 9: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/9.jpg)
LattePanda computer (Windows 10)
![Page 10: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/10.jpg)
Current Progress
● Control Hamamatsu software to automatically complete the whole recording process and save the data as .txt file
● Denoise the recorded videos ● Convert the grayscale denoised videos into RGB● Find the periods of signals occurred in the denoised videos
![Page 11: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/11.jpg)
PhotoMultiplier Tube (PMT)
● Hamamatsu Software● UI Automation
![Page 12: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/12.jpg)
PhotoMultiplier Tube (PMT)
● Hamamatsu Software● UI Automation
![Page 13: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/13.jpg)
Denoise
![Page 14: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/14.jpg)
Denoise
Before denoise After denoise
![Page 15: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/15.jpg)
Acknowledgement
Oakley Lab:
● Prof. Oakley● Emily Lau● Niko Hensley
UCSB Capstone
● Prof. Yogananda● Kyle Douglas● Aditya Wadaskar
![Page 16: WALL-E - web.ece.ucsb.edu · Previous WALL-E Watec Camera Frame Synchronizing Create 3D map of ostracod light pulses. Proposed Solutions Use PhotoMultiplier Tube (PMT) to record overall](https://reader034.fdocuments.net/reader034/viewer/2022050500/5f92ed975dc578615027bc5a/html5/thumbnails/16.jpg)
Thanks!Questions?