Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May...
-
date post
20-Dec-2015 -
Category
Documents
-
view
221 -
download
1
Transcript of Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May...
![Page 1: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/1.jpg)
Enhanced Rendering of Fluid Field Data Using Sonification
and Visualization
Maryia Kazakevich
May 10, 2007
![Page 2: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/2.jpg)
2
Multi-Modal Project Overview
• Input: – Fluid field with velocity vector, pressure, plus
potentially density, temperature and other data– Changes with time
• Output:– Visualization of the given fluid field– Sound characterizing given fluid field
• Ambient: global to the whole field• Local: at the point or area of interaction• Local region: particles of the specific subset area around the
pointer contribute to the sound
![Page 3: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/3.jpg)
3
Structure
– Each rendering program is independent of any other
Solution Data Server
Max/MSP Program
Main Program asMax/MSP object
VisualizationProgram
Haptic Program
Haptic Device ImageSound
![Page 4: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/4.jpg)
4
Sonification Types
• Contrast vs. Inverted Amplitude Modulation– velocity value is mapped to either increase or decrease in
amplitude of the sound
• Amplitude vs. Frequency Modulation– highest velocity value is mapped to either loudest noise or highest
pitch noise
• Before vs. after interpolation– many separate sounds for each vertex in the local area vs. 1 sound
of the interpolated value at the position of virtual pointer
![Page 5: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/5.jpg)
5
Usability Study Setup
• Focus on usability study– Compare Visual, Audio and Multi-Modal interface
– Influence of audio setup
– Simple rendering• complex not always better, allows real-time calculations
• learning process
• Overall and single trials have to be fairly short – fatigue
– sound sensitivity
• Many short trials– Large nodes in small field
![Page 6: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/6.jpg)
6
Usability Study Setup
Visual and/or Audio cues, haptic - navigation
![Page 7: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/7.jpg)
7
Usability Study Setup
• Trials for each person:
• 3 groups of people:– frequency modulation– positive amplitude modulation (contrasted sound)– negative amplitude modulation (inverted sound)
![Page 8: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/8.jpg)
8
Usability Study Results
• worst results for the audio-only system:– participants are slower in locating the goal
– participants are less efficient in exploring the volume
– Participants are less precise in locating the goal
![Page 9: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/9.jpg)
9
Usability Study Results
Specific system setup might help to improve performance:
![Page 10: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/10.jpg)
10
Usability Study Results
• Multi-modal vs. Visual-only interface:
• Equal or better results for the multi-modal system– participants explore less space
– participants are much faster in locating the goal position
![Page 11: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/11.jpg)
11
Usability Study Results
Specific system setup helps to improve performance
![Page 12: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/12.jpg)
12
Usability Study Results
In a specific audio setup of multi-modal system, participants are more precise in locating the goal:
![Page 13: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/13.jpg)
13
Usability Study Conclusion
• Multi-modal system is more powerful than either pure visual or pure audio systems
• Specific mapping parameters influence system performance
• Different audio parameters are better for audio-only than for multi-modal interface
• Different audio parameters might be better for different conditions
![Page 14: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/14.jpg)
14
Further work
• More sophisticated rendering algorithms – for visualization– for sonification– for haptic representation of the data
• Sonifying along pathlines, streaklines, streamlines, streamribbons and streamtubes
• Sonifying other data parameters• Fully surrounding sound• Self-adjusting system
![Page 15: Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.](https://reader030.fdocuments.net/reader030/viewer/2022032800/56649d445503460f94a2052c/html5/thumbnails/15.jpg)
The End