Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social...
Transcript of Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social...
![Page 1: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/1.jpg)
Semantics Visualizations on Mobile Devices Wolfgang Jochum
Spectralmind OG Phorusgasse 8/9 1040 Vienna, Austria
www.spectralmind.com 22. März 2011
2. Potsdamer IScience Tag
![Page 2: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/2.jpg)
Finding music?
10 Mill. titles – overview?
– finding desired music quickly?
– finding new music? – usability?
![Page 3: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/3.jpg)
Our Vision
making the wealth of music
accessible by everyone
![Page 4: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/4.jpg)
Spectralmind
• TU Vienna spin-off, founded 2008
• backed by ~10 years of research
• intelligent semantic audio solutions
• audio analysis & indexing technology
![Page 5: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/5.jpg)
Spectralmind
• independent high-technology company
• supported by inits, AWS preseed, FFG
• located in Vienna, Austria
• research link with TU Vienna
![Page 6: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/6.jpg)
Spectralmind Team
Johann Waldherr Bizdev & Sales – [email protected]
Thomas Lidy Managing Director – [email protected]
Wolfgang Jochum Head of Technology – [email protected]
Ewald Peiszer Head of R&D– [email protected]
![Page 7: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/7.jpg)
Overview genre clusters
Music Browsing by Sound Similarity
Visual Music Discovery Product
Detail view titles with cover art
www.sonarflow.com
![Page 8: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/8.jpg)
Underlying Technology
Audio Search Engine
Automatic Labeling
Spectralmind Products
Music Recommendation
Audio files Semantic
Audio analysis
Audio Feature Extraction
![Page 9: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/9.jpg)
• basic approach
• sonarflow @ mobile
• predefined & simple placement
iPhone Launch
late March!
Mobile Visual Music Discovery sonarflow mobile – „music at your fingertips“
www.sonarflow.com
![Page 10: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/10.jpg)
About the Project
• media management and retrieval through mobile devices considering usability and visualization
• started August 2010
• 3 national partners
• funded by the FFG COIN program
![Page 11: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/11.jpg)
Overview
![Page 12: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/12.jpg)
• multimedia mgmt.
• semantic search on text, audio, video
• social annotation
• crowd sourcing
• semantic audio analysis
• search & annotation
• recommendation
• media visualization
• interactive interfaces
• mobile app
• mobile development
• multi-platform solutions
Partners
![Page 13: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/13.jpg)
Goals
Advanced and integrated multimedia search over interlinked networks of information by applying semantic technology.
![Page 14: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/14.jpg)
Goals
Novel visualization methods for usable and comprehensive search on multimedia.
![Page 15: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/15.jpg)
Goals
Flexible development framework for mobile application development and the provision of semantic multimedia search and visualization through mobile devices.
![Page 17: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation](https://reader035.fdocuments.net/reader035/viewer/2022062921/5f046f147e708231d40df258/html5/thumbnails/17.jpg)
www.spectralmind.com
Thank you!