s 3 Í i Ï Ã ¦ - ³ µ Â Ü q Web Õ µ w à » ± Ï µ t ® p $ s ... · ; æ s3 Í i Ï Ã...
Transcript of s 3 Í i Ï Ã ¦ - ³ µ Â Ü q Web Õ µ w à » ± Ï µ t ® p $ s ... · ; æ s3 Í i Ï Ã...
3 Web
*1 ∗1, ∗1, *2,∗1, ∗1, *3, ∗1
Efficient Educational Content Creation System Based on 3D Video Data
Using 3D Data Capturing and Editing System with Web-based Data Sharing Service
Hiroki Morinaga*1, Takuya Ushinohama∗1, Ryousuke Kimura∗1, Yasuhiro Akagi*2,
Michihiro Mikamo∗1, Satoshi Ono∗1, Takashi Yamanoue*3, Hiroshi Kawasaki∗1
Abstract – In this paper, we present an interactive 3D animation creation systemthat enables the user to capture, edit the moving objects and share them easily on theweb. Recently, educational concept called active leaning has been becoming important inthe field of education. The difference between the active leaning and usual education isthat the learner actively absorbs the educational information not only from the lecturer,but also from other media contents such as videos and images. Therefore, various kindsof media contents aiming for active learning are required to help the learners. As theone of such media contents, we developed a system that can create 3D video data andshare them on a web service. Concretely, in our system, the 3D contents are acquiredby using Kinects on a graphical user interface. By using the proposed system, the usercan edit and integrate the other contents such as music and images easily. The contentscan be uploaded on the web server that provides the experience to manipulate the 3Danimation intuitively through a touch interface. In this paper, we explain the overviewof the proposed system and the details of the our algorithms to reconstruct 3D data.The experiment shows our system can obtain the 3D data efficiently by using a novelapproach. As the conclusion, we show some demos to validate that the system is availablefor educational use and a user can operate the proposed system efficiently.
Keywords : education, active leaning, 3D contents, web service, Kinect
1
3
3
3
3
*1
*2
*3
*1Department of Information Science and Biomedical Engi-neering, Kagoshima University
*2Smart Mobility Research Center, Tokyo University ofAgriculture and Technology
*3Department of Computer Science, Fukuyama University
3
3
3
3
VR
3
Vol.20, No.4, 2015
[1]
3
3
Web
[2] [3]
3
GUI
Web
3
3
(Graphical User Interface:
GUI)
VR 3
Web Mooc
Massive open online course
3
Web
3
2
3
4 Kinect 3
5 3
3
6 7 3
8
3
3
9
2
2.1
“Laputa Project”
3
[4] 3
3
. Laputa Project
,
[5].
Laputa Project
WebCT Moodle CMS
Course Management System
[6][7] CMS Web
Mooc [8][9][10] [11]
[12] YouTube [2]
Ustream [13] [3]
[14][15]
Web
Mooc
Web
Web
2
3
3
: 3 Web
2
3
3
[16] 3
3
3
3
3
Web
3
Web
2.2 3
3
3 (Degree Of Freedom:
DOF) 2 3
2
Cohe 3
[17] Bruno
3
[18]
Held 3
Kinect
3
[19]
3
4
1Fig. 1 System construction
2Fig. 2 System overview
3
3
3.1
1 Kinect
Kinect 3
PC 3
4
( 2) 3
Kinect
Kinect
Kinect
3
Kinect
3
3
3 Web
Vol.20, No.4, 2015
3 4dbFig. 3 4db format
3
Web
3.2 3
3
3
1
“.4db” 1
.4db 3
“motion1.zip”
“motion2.zip”
“movie.xml” Web
“thumbnail.png”
“icon1.ply” “1.ply”
“2.ply” 3
“motion.xml”
“rgb0000.png”
“audio.wav”
zip 4db
4
Kinect 3
Kinect2
Kinect PC USB
4 2 Kinect 3DFig. 4 3D data capturing system
PC
Kinect
Kinect
4.1
Kinect
3
PC Kinect
4
GUI
Kinect 3 GUI
Kinect
Kinect 3
4db
CLI Command Line Interface
GUI
3
4db
PC TCP PC
Kinect
4.2
Kinect
Kinect
SDK
: 3 Web
5 3Fig. 5 Importing 3D objects
PC PC
PC
Kinect FPS
30
FPS
160 [sec.] × 1
60
5 3
3
GUI GUI 3
3
3
5.1
3
3
GUI 3
PLY OBJ 3
2 GUI
5
3
Web 3
6Fig. 6 Setting camera path
3
Web 3
3
GUI
6
5.2
3
1
Kinect
[24]
3 Kinect
2 3
[20]
2
1
Vol.20, No.4, 2015
7 3Fig. 7 3D data reconstruction
1
3
7 7(a) Kinect 3
7(b)
7(c)
7(b) Kinect
1
Kinect
6 Web
Web 3
Web
“Hyper3Dcast” Web
6.1 3
3 Web
Hyper3Dcast
3
Twitter Facebook
8
.4db
3
.4db
8Fig. 8 Screenshot of the uploading window
3
URL QR
3
GUI
3 SD Standard Defini-
tion HQ High Qual-
ity 3
HQ
3
HQ 3
Web
3 Web
3
URL
3
6.2 3
9 3
3
URL
3
: 3 Web
9 3Fig. 9 A screenshot of the viewing window
10 3
Fig. 10 Linking to other 3D video and exter-nal sites
URL 3
3 3
Web
3
3 SD HQ 2
HQ
3
3
Web 10
3 WebGL
WebGL
Web
3
11 Hyper3Dcast 3
Fig. 11 The application shows 3D videosposted on Hyper3Dcast
WebGL
PC
7
3
Web
Android OS
3
Hyper3Dcast
API Hyper3Dcast
3
3
Android OS
3
WebGL OpenGL
WebGL
3
3
3
3
3
Vol.20, No.4, 2015
3
8
3
2 Kinect
3
MMD (MikuMikuDance)[21] MMD
3
MMD
MMD
1.
2. Kinect
3. MMD
4. Web
3
2
3
8.1 3
3
magic dance maemawari 3
5 10 5
3 4
MMD magic 34 20
12 3MMD
Fig. 12 The comparison of the editing time tomake 3D video data
13 3Fig. 13 The 3D data used in reconstructing
dance 36 45
maemawari MMD
3
12 3
MMD 3
3 MMD
MMD 3
3
3
PC
3
8.2
2 3
1
: 3 Web
14Fig. 14 The comparison of the processing
time to reconstruct 3D data
Stanford 3D Scanning Repository [22]
3 Bunny2 Armadillo Dragon
13
7
Stanford
14
2
3
3
8.3
4 2 15
15Fig. 15 The proposed 3d video and previous
methods for comparison.
15
3 1 15(a)
3
15(b) 3 15(c) 1
3
3
16
16
t
3
1
5%(0.05) t
P (T≤t) 0.0065
0.0112
8.4
3
( 17). [23]
3
Vol.20, No.4, 2015
16Fig. 16 The time to arrange the boxes
17Fig. 17 Browsing 3D video using a tablet de-
vice
( 18) 3
( 19) 19
3
3
9
3
GUI 3
3
Web
3
18Fig. 18 Animations composed of state transi-
tions
19Fig. 19 Manipulating state transitions on a
tablet device
3
[1] Microsoft Xbox 360 Kinect,http://www.xbox.com/en-US/kinect.
[2] YouTube, http://www.youtube.com/.[3] , http://www.nicovideo.jp/.[4]
, : Laputa Project: The Potential of the 3DInteractive Education System in College EnglishEducation, Proceedings of The Fourth Conferenceon Foreign Language Education and Technology,pp.429-435, 2001 .
[5] : -
- 2005[6] :
: 3 Web
11 , pp. 85-98 2004
[7] Takashi Yamanoue, et al.: Information and Com-munication Technology Infrastructure and Man-agement for Collaboration with Regional Univer-sities and Colleges, Proceedings of the 39th an-nual ACM SIGUCCS conference on User services,pp.25-30, 2011.
[8] : MOOC MOOC, 57
6 , pp. 367-375 2014[9] gacco, http://gacco.org.
[10] jmooc, http://www.jmooc.jp.[11] : ICT ,
56 10 pp. 677-684, 2014[12] Takashi Yamanoue, Michio Nakanishi, Atsushi
Nakamura, Izumi Fuse, Ikuya Murata, ShozoFukada, Takahiro Tagawa, Tatsumi Takeo, ShigetoOkabe, Tsuneo Yamada: Digital Video Clips Cov-ering Computer Ethics in Higher Education, Pro-ceedings of the 33rd annual ACM SIGUCCS con-ference on User services, pp.456-461 2005.
[13] Ustream, http://www.ustream.tv/.[14] Ustream ,
22 1 , pp. 281-296, 2015
[15] GMS 2015http://live.nicovideo.jp/watch/lv222670215
[16] , ,(Web / ),
, 108146 2008 .
[17] Aurelie Cohe and Martin Hachet.: Understand-ing user gestures for manipulating 3d objects fromtouchscreen inputs, Proceedings of Graphics Inter-face 2012, pp. 157–164, 2012.
[18] Bruno De Araujo, Gery Casiez, Joaquim Jorge,and Martin Hachet.: Modeling on and above astereoscopic multitouch display, In 3DCHI-The3rd Dimension of CHI, pp. 79–86, 2012.
[19] Robert Held, Ankit Gupta, Brian Curless, and Ma-neesh Agrawala.: 3d puppetry: a kinect-based in-terface for 3d animation. In UIST, pp. 423–434.Citeseer, 2012.
[20] T. Ushinohama, Y. Sawai, S. Ono, andH. Kawasaki.: Simultaneous entire shape regis-tration of multiple depth images using depth dif-ference and shape silhouette. In Proceedings ofthe 12th Asian Conference on Computer Vision(ACCV’14), 2014.
[21] Vocaloid Promotion Video Project,http://www.geocities.jp/higuchuu4/
[22] The Stanford 3D Scanning Repository,http://graphics.stanford.edu/data/3Dscanrep/
[23] Masayuki Furukawa, Yasuhiro Akagi, YukikoKawai, and Hiroshi Kawasaki. Interactive 3d ani-mation creation and viewing system based on mo-tion graph and pose estimation method. In Pro-ceedings of the ACM International Conference onMultimedia, pp. 1213–1216, 2014.
[24] Genzhi Ye, Yebin Liu, Nils Hasler, Xiangyang Ji,Qionghai Dai, and Christian Theobalt.: Perfor-mance capture of interacting characters with hand-held kinects. In Proceedings of the 12th EuropeanConference on Computer Vision - Volume Part II,ECCV’12, pp. 828–841, 2012.
(2015 6 15 )
2014 3
2014 3
2015 9
20062006 2012
2012 20132014
( )
20132014 2015
( )
200220032010
1987
2015
)
20032008
2009 INRIA
2010( )