Beta Presentation Image Recognition, Annotation and ...
11
From Students… …to Professionals The Capstone Experience Beta Presentation Image Recognition, Annotation and Validation Mobile Application Department of Computer Science and Engineering Michigan State University Fall 2018 Team Whirlpool Shruti Avutapalli Jessica Clappison Jackie Li Savanna Pinkoski Jack Turak
Transcript of Beta Presentation Image Recognition, Annotation and ...
From Students…
…to Professionals
The Capstone Experience
Beta PresentationImage Recognition, Annotation and
Validation Mobile Application
Department of Computer Science and EngineeringMichigan State University
Fall 2018
Team WhirlpoolShruti AvutapalliJessica Clappison
Jackie LiSavanna Pinkoski
Jack Turak
Project Overview
Problem:
• Lack of realistic training photos to achieve high object recognition accuracy.
Project Objective:
• Improve Yummly’s image recognition data model.
• Collect annotated photos from Whirlpool employees.
• Evaluate correctness of annotations through validation interface.
The Capstone Experience Team Whirlpool Beta Presentation 2
System Architecture
The Capstone Experience Team Whirlpool Beta Presentation 6
Android
iOS
Firebase
TensorFlowLite
Storage
Authentication
User Creation/Sign-In
Image Storage
Cloud Functions
Backend API
AdminDashboard
Image Capture Interface
The Capstone Experience Team Whirlpool Beta Presentation 7
Annotation Interface
The Capstone Experience Team Whirlpool Beta Presentation 8
Annotation Interface: Completed
The Capstone Experience Team Whirlpool Beta Presentation 9
Validation Interface
The Capstone Experience Team Whirlpool Beta Presentation 10
Admin Dashboard
The Capstone Experience Team Whirlpool Beta Presentation 10
Admin Dashboard
The Capstone Experience Team Whirlpool Beta Presentation 10
What’s left to do?
• Testing
User feedback
Bug fixes
Edge cases
• UI Design Finalization
• Documentation
The Capstone Experience Team Whirlpool Beta Presentation 10
Questions?
The Capstone Experience Team Whirlpool Beta Presentation 11
?
? ??
?
?
?
?
?
