TWITTER DATA MINING

Project Overview and RequirementsKatherine Mawhinney

GOALS To provide information for studies on movies and games.

To see the sentiment around a movie/game.

To understand the trend of what people are watching now, have watched, or will watch.

To understand the types of games people are playing – video, card, athletic.

Keep track of the different ways people access twitter.

See location and date/time info of where people are coming from when posting.

TECHNICAL FEATURES

Mining Twitter Data in real-time – interactively using web form interface or through a file.

Loading data into MySQL – bulk load utility and JDBC.

Report in CSV, HTML, and XML format.

REQUIREMENTS

Need up-to-date feeds from Twitter ("fresh").

Save the twitter data into a database to be able to perform sentiment analysis – trending over time.

Give the most popular users with respect to a movie.

Be able to output the reports in the specified formats.

See the people who post the most on movies.

TOOLS

SYSTEM

ARCH ITECTURE

DATABASE DESIGN

Sentiment Report

Most Popular User

Geographic Locations of Users

Devices people are using

Choose a Report to Generate:

SUBMIT

DEVELOPMENT PROCESS

Keep track of use cases and “to-dos,” complete a specified number during each week-long development iteration

Development Schedule January: Review user-centered design principles

(complete) Remainder of February: Finish database design and

complete literature review March: Core application development April: Implement system, fine-tune and style UI

QUESTIONS?