Cloud Gaming Onward: Research Opportunities and Outlook
-
Upload
multimedia-networking-and-systems-laboratory -
Category
Technology
-
view
4.459 -
download
0
description
Transcript of Cloud Gaming Onward: Research Opportunities and Outlook
![Page 1: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/1.jpg)
Cloud Gaming Onward: Research Opportunities and
Outlook
Kuan-Ta Chen, Chung-Ying Huang, and Cheng-Hsin Hsu
![Page 2: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/2.jpg)
Cloud Gaming is Hot Cloud gaming is expected to lead the future growth of computer games: 9 times in 6 years [CGR]
[CGR] http://www.cgconfusa.com/report/documents/Content-5minCloudGamingReportHighlights.pdf
T5-Labs
![Page 3: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/3.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 4
Limitations of Existing Services OnLive demands for 5 Mbps for reasonable quality OnLive dictates a server rendering/processing latency of 100+ ms, and partially copes with it by setting up 5 data centers (CA, VA, TX, IL, GA)
Only people who live in 1000 mile radius from a data center can play the game
and more… We, researchers, have tons of ideas to improve cloud gaming services, but all existing cloud gaming systems are proprietary and closed
![Page 4: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/4.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 5
Solutions: GamingAnywhere is the first OPEN cloud gaming platform for researchers, service providers, and users
![Page 5: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/5.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 6
GA Has Lower Response Delay
Low response delay
![Page 6: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/6.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 7
Support of Android Devices Implement three proof-of-concept controllers, designed for
Nintendo 64 Nintendo DS Limbo
Nintendo 64 Controller Limbo Controller
![Page 7: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/7.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 8
Demo
![Page 8: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/8.jpg)
• 25k+ visitors, 70k+ downloads, and 400+ forum discussions since April 2013
http://gaminganywhere.org/
![Page 9: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/9.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 10
Research Opportunities
Game Integration Video Codec Virtualization User Interface QoE Measurement and Modeling Server Selection Parameter Adaptation Resource Scheduling
![Page 10: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/10.jpg)
![Page 11: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/11.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 12
Game Integration
Two facets When/how game screens are captured How game inputs are replayed
De facto approach Use API hooking to intercept events related to screen rendering Use API hooking to emulate user inputs
Goal A general framework to bridge cloud gaming middleware and games
![Page 12: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/12.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 13
Video Codec
H.264 is commonly used, but not necessarily the most efficient codec for gaming Network bandwidth is always scarce (e.g., continuous & stable 5 Mbps avail BW cannot be assumed) Considering the huge variety in graphics style…
![Page 13: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/13.jpg)
Video Codec (cont.)
E.g., [8] proposed a layered coding approach that can reduce bandwidth usage significantly
[8] S.-P. Chuah and N.-M. Cheung, “Layered coding for mobile cloud gaming,” in Proceedings of ACM MMVE 2014.
![Page 14: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/14.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 15
Virtualization
GPU virtualization is not as mature as virtualization of other resources (e.g., CPU, memory) Scalability problems financial difficulty of service providers Mediated GPU pass-through technology might be the solution
![Page 15: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/15.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 16
User Interface Mapping
?
![Page 16: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/16.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 17
QoE Measurement and Modeling
Challenges Low cost continuous QoE assessment Large parameter space (network delay/bandwidth/packet loss, codec, game, display, control, and so on)
Common approaches not sufficient Absolute Categorial Rating (ACR) SSCQE, DSCQE
Possible solutions Paired comparison [14] (not continuous and still costly) Physiological approach [15]
![Page 17: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/17.jpg)
Facial EMG Measurement
The corrugator supercilii muscle
Negative emotions
The amount of annoyance caused by latency
[15] Y.-T. Lee, K.-T. Chen, H.-I. Su, and C.-L. Lei, “Are all games equally cloud-gaming-friendly? An electromyographic approach,” in Proceedings of the IEEE/ACM Annual Workshop on Network and Systems Support for Games (NetGames’12), October 2012, pp. 3:1–3:6.
![Page 18: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/18.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 19
Quantifying QoE Degradation due to Latency in Cloud Gaming
![Page 19: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/19.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 20
Server Selection
The closest server may not be available due to Overloaded Not powerful enough for particular games Not installed with particular games
Also, we need to consider Multi-user games where multiple players participates in a game session simultaneously Online games that both (player <-> cloud gaming server delay) and (cloud gaming server <-> online game server delay) need to be considered
![Page 20: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/20.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 21
Parameter Adaptation for Real-time Graphics Streaming
Control-theoretic algorithms are required to adapt to changing network conditions Huge parameter space
Video codec Layer design: MDC, SVC, among others Various parameters associated with video codec
Network delivery Network condition measurement Path selection (overlay?) Multi-path delivery
Playout Error concealment Playout buffering
And lots more…
![Page 21: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/21.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 22
Resource Scheduling
Different games have different requirements on CPU, GPU, memory, and disks
Car racing games are disk read intensive Realistic shooting games are normally GPU intensive RPG games are normally memory intensive
Such requirements may change over time CPU, GPU, memory,
and disk co-scheduling
![Page 22: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/22.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 23
To Make Cloud Gaming Scalable…
In terms of # cloud-enabled games Game integration framework User interface mapping
In terms of # concurrent players GPU virtualization Resource scheduling
In terms of market adoption (UX) User interface, Video codec QoE assessment and management (including parameter adaptation and server selection)
![Page 23: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/23.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 24
Conclusion
Cloud gaming shares similar fundamental problems with many interesting applications
Screencasting Mobile smart lens Tele medicine Immersive remote communications
Thus, cloud gaming can be seen a rewarding entrance to fundamental multimedia system challenges!
![Page 24: Cloud Gaming Onward: Research Opportunities and Outlook](https://reader033.fdocuments.net/reader033/viewer/2022051610/54930885ac79590e2e8b479d/html5/thumbnails/24.jpg)
Cloud Gaming Onward / Kuan-Ta Chen 25
Kuan-Ta Chen Academia Sinica
cloud gaming rocks!
Thank You!
http://www.iis.sinica.edu.tw/~swc