Automatic Storytelling in Comics: A Case Study on World of Warcraft

1
Game Logs and Screenshots Frame Selection Estimating n, number of images required for the desired comic Evaluating the significance scores of all images Selecting the estimated n images from the image pool Layout Computation We design an algorithm (see Fig. 1) to categorize the selected images into groups. The selected images are divided into page groups On each page, the algorithm arranges the appropriate image group into several rows. Once a page has been generated, the image set of the page, the positions and the sizes of the images on the page are fixed. The image's shape and size on a comic page are determined based on its importance. M MNet Lab Future Works Future Works Future Works Applying a better object detection technique To pinpoint the location and size of game characters in screenshots To crop the comic book frames and put word balloons on frames accurately To improve the layout computation algorithm to make the generated comics more similar to handdrawn publications. We are refining the interface design and adding new features to meet users’ needs. We plan to release our system for public use in the near future Introduction Introduction Introduction Case Study: World of Warcraft Case Study: World of Case Study: World of Warcraft Warcraft Automatic Storytelling in Comics: a Case Study on World of Automatic Storytelling in Comics: a Case Study on World of Warcraft Warcraft User Survey User Survey User Survey Some feedback from players: All players think the gadget is appealing and userfriendly. One user suggests: “I think the frame selection mechanism still has room for improvement. Although the automatic idea is cool, I wish I can contribute more in the comic creating process” “It would be better if the interface has more setting and editing flexibility. I hope I can cut and resize some scenes.” said another. The design of our system and the interface is then refined based on the user feedback. (see Fig. 4) Methodology Methodology Methodology Rendering Threelayer scheme (see Fig. 2) The image The mask of the image The word balloons and sound effects Nowadays, people share and preserve their gaming adventures on the Internet. This paper presents: An automatic comic generation system An approach that summarizes players’ interactions in the virtual world for storytelling A user interface with interactive editing functions for users to create their own comics. In the prototype, we chose World of Warcraft (WoW), an MMORPG, as the testing platform for our system. Fig. 3 shows a sample comic page. WoW is the most prevalent MMORPG worldwide. The WoW Players tend to share and preserve their gaming experiences with each other in both real life and virtual communities. WoW provides a sophisticated game log scheme. We created a WoW Addon to record the game session without modifying the game’s core engine. Figure 1 Figure 2 Figure 3 Chia-Jung Chan 1 , Ruck Thawonmas 2 , and Kuan-Ta Chen 1 1 Academia Sinica; 2 Ritsumeikan University http://mmnet.iis.sinica.edu.tw Multimedia Networking and Systems Lab Institute of Information Science, Academia Sinica Figure 4

description

This paper presents a development of our comic generation system that automatically summarizes players' actions and interactions in the virtual world. The feature of the system is that it analyzes the log and screenshots of a game, decides which events are important and memorable, and then generates comics in a fully automatic manner. Also, the interface of our system allows users to customize their own comics. As a result, users can easily use the system to share their stories and create individual comics for archival purposes or storytelling.

Transcript of Automatic Storytelling in Comics: A Case Study on World of Warcraft

Page 1: Automatic Storytelling in Comics: A Case Study on World of Warcraft

Game Logs and Screenshots

Frame Selection

Estimating n, number of images required for the desired comic

Evaluating the significance scores of all images 

Selecting the estimated n images from the image pool 

Layout Computation

We design an algorithm (see Fig. 1) to categorize the selected images into groups.

The selected images are divided into page groups 

On each page, the algorithm arranges the appropriate imagegroup into several rows. 

Once a page has been generated, the image set of the page,the positions and the sizes of the images on the page are fixed.

The image's shape and size on a comic page are determined   based on its importance. 

M

MNet

Lab

Future WorksFuture WorksFuture Works

Applying a better object detection technique

To pinpoint the location and size of game characters in screenshotsTo crop the comic book frames and put word balloons on framesaccurately

To improve the layout computation algorithm to make the generatedcomics more similar to hand‐drawn publications.

We are refining the interface design and adding new features tomeet users’ needs. We plan to release our system for public use in the near future 

IntroductionIntroductionIntroduction

Case Study: World of WarcraftCase Study: World of Case Study: World of WarcraftWarcraft

Automatic Storytelling in Comics: a Case Study on World of Automatic Storytelling in Comics: a Case Study on World of WarcraftWarcraft

User SurveyUser SurveyUser Survey

Some feedback from players:

All players think the gadget is appealing and user‐friendly. 

One user suggests: “I think the frame selection mechanism still has room for improvement. Although the automatic idea is cool, I wish I can contribute more in the comic creating process”“It would be better if the interface has more setting and editingflexibility. I hope I can cut and resize some scenes.” said another.

The design of our system and the interface is then refined based on theuser feedback. (see Fig. 4)

MethodologyMethodologyMethodology

Rendering  

Three‐layer scheme (see Fig. 2)

The image 

The mask of the image

The word balloons and sound effects 

Nowadays, people share and preserve their gaming adventureson the Internet.

This paper presents: 

An automatic comic generation system

An approach that summarizes players’ interactions in the virtual world for storytelling 

A user interface with interactive editing functions for users to create their own comics.

In the prototype, we chose World of Warcraft (WoW), an MMORPG, as the testing platform for our system. Fig. 3 shows a sample comic page.

WoW is the most prevalent MMORPG worldwide. 

The WoW Players tend to share and preserve their gaming experiences with each other in both real life and virtual communities.

WoW provides a sophisticated game log scheme. We created a WoW Addon to record the game session without modifying the game’s core engine. 

Figure 1

Figure 2

Figure 3

Chia-Jung Chan1, Ruck Thawonmas2, and Kuan-Ta Chen1

1Academia Sinica; 2Ritsumeikan University

http://mmnet.iis.sinica.edu.tw

Multimedia Networking and Systems LabInstitute of Information Science, Academia Sinica

Figure 4