CMPS 261 – Project Proposal
-
Upload
maxwell-frost -
Category
Documents
-
view
39 -
download
2
description
Transcript of CMPS 261 – Project Proposal
![Page 1: CMPS 261 – Project Proposal](https://reader036.fdocuments.net/reader036/viewer/2022082417/568130e9550346895d9705b3/html5/thumbnails/1.jpg)
CMPS 261 – Project Proposal
Visually Representing American Sign LanguageTranslations
Victor Geislinger
![Page 2: CMPS 261 – Project Proposal](https://reader036.fdocuments.net/reader036/viewer/2022082417/568130e9550346895d9705b3/html5/thumbnails/2.jpg)
Background/Motivation
● American Sign Language (ASL)● Fingerspelling (FS)● Handshapes
– Basis of language
![Page 3: CMPS 261 – Project Proposal](https://reader036.fdocuments.net/reader036/viewer/2022082417/568130e9550346895d9705b3/html5/thumbnails/3.jpg)
Background/Motivation
● Interpreters– Emergency– Inaccessible– Expensive
● Learning Tool– Feedback
![Page 4: CMPS 261 – Project Proposal](https://reader036.fdocuments.net/reader036/viewer/2022082417/568130e9550346895d9705b3/html5/thumbnails/4.jpg)
Method
● Collect Data via Leap Motion Controller– Focus on hand(s)/finger(s)– Real time capture
http://reviews.cnet.com/input-devices/leap-motion-controller/4505-3133_7-35823002.html
![Page 5: CMPS 261 – Project Proposal](https://reader036.fdocuments.net/reader036/viewer/2022082417/568130e9550346895d9705b3/html5/thumbnails/5.jpg)
Method
● Categorize individual letters– Form hard to determine
● Classify group shapes– Easier to guess– “Autocorrect” feature
![Page 6: CMPS 261 – Project Proposal](https://reader036.fdocuments.net/reader036/viewer/2022082417/568130e9550346895d9705b3/html5/thumbnails/6.jpg)
Method
● Transitions sometimes exist as one unit– “J” and “Z”– Double letters– “I-L-Y”– “A-I-R”– “B-U-S”
![Page 7: CMPS 261 – Project Proposal](https://reader036.fdocuments.net/reader036/viewer/2022082417/568130e9550346895d9705b3/html5/thumbnails/7.jpg)
Output
● Gives interpreted word/sentence● Color coded to give likely letter from shape
group
![Page 8: CMPS 261 – Project Proposal](https://reader036.fdocuments.net/reader036/viewer/2022082417/568130e9550346895d9705b3/html5/thumbnails/8.jpg)
Output
● Features other possible guesses– Given by opacity, position, and/or hierarchy tree
● Gives timeline of duration of letter– Possibly used to visually see speed of speech
![Page 9: CMPS 261 – Project Proposal](https://reader036.fdocuments.net/reader036/viewer/2022082417/568130e9550346895d9705b3/html5/thumbnails/9.jpg)
Potential Issues/Challenges
● Identifying letters from same group– Difficult/impossible to do with current technology
● Differences in style/accent● Transition lengths● Output might have to many possibilities
![Page 10: CMPS 261 – Project Proposal](https://reader036.fdocuments.net/reader036/viewer/2022082417/568130e9550346895d9705b3/html5/thumbnails/10.jpg)