1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim,...

21
1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, Ch engXiang Zhai 2010/05/24 Yu-wen,Hsu

Transcript of 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim,...

Page 1: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

1

Generating Comparative Summaries of Contradictory

Opinions in Text

(CIKM09’)Hyun Duk Kim, ChengXiang Zhai

2010/05/24 Yu-wen,Hsu

Page 2: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

2

Outline

IntroductionProblem DefinitionAn Optimization FrameworkSimilarity FunctionsOptimization AlgorithmsExperiment Design & ResultConclusion

Page 3: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

3

Introduction

opinionated text often contains both positive and negative opinions about a topic makes it even harder to accurately digest mixed opinions. the battery life [of iPhone] has been excellent

I can tell you that I was very disappointed with the 3G [iPhone] battery life

the battery life is good when I rarely use button the battery life is bad when I use button a lot

Page 4: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

4

propose to automatically generate a comparative summary of contradictory opinions

help a user to understand possibly different conditions under which the specific polarity of opinions is expressed

this summarization problem has not been addressed in the existing work, and we call it contrastive opinion summarization (COS)

Page 5: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

5

Problem Definition

OPINIONATED SENTENCE A sentence is an opinionated sentence if it

expresses either a positive or a negative opinion.

CONTRASTIVE SENTENCE PAIR (x, y) is called a contrastive sentence pair sentence x and sentence y :the same topic but

opposite sentiment

Page 6: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

6

CONTRASTIVE OPINION SUMMARIZATION : a set of positive sentences : a set of negative sentences The task of contrastive opinion summarization

(COS) is to generate k contrastive sentence pairs:

Page 7: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

7

An Optimization Framework

based on two basic similarity measures defined on a pair of sentences. the content similarity of two sentences in the sa

me group of opinions the contrastiveness of a positive sentence and

a negative sentence.

Page 8: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

8

CONTENT SIMILARITY FUNCTION and :the same polarity, the content

similarity function

CONTRASTIVE SIMILARITY FUNCTION and :opposite polarities, the contrastive

similarity function

Page 9: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

9

REPRESENTATIVENESS The representativeness of a contrastive opinion

summary how well the summary S represents the

opinions expressed

Page 10: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

10

CONTRASTIVENESS The contrastiveness of a contrastive opinion su

mmary S measures how well each matches up with in the summary

Page 11: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

11

A good contrastive opinion summary should intuitively have both high representativeness and high contrastiveness

Page 12: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

12

Similarity Functions

:a term similarity function Word Overlap (WO): iff Semantic Word Matching (SEM):

if

,otherwise

, : the total counts of words in sentences and

:removing negation and adjectives

Page 13: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

13

Optimization Algorithms

Representativeness-First Approximation achieve this goal by clustering the sentences in

X and Y independently to generate k clusters take the most representative sentence from eac

h cluster

Page 14: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

14

Next we would like to keep constant and optimize

Set , object function

find the solutionThe pair that gives the highestthe optimal summary

Page 15: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

15

Contrastiveness-First Approximation compute for all and sort these pairs and gradually add a sentence p

air to our summary starting with the pair with the highest contrastive similarity score.

already chosen pairs We want to choose to maximize the foll

owing objective function

Page 16: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

16

choosing the first pair to maximize the “gain function”

Page 17: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

17

Experiment Design & Result

Data Set 14 tagged product reviews All the sentences in these data sets have

already been manually tagged with product features as well as sentiment polarities

Page 18: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

18

Measures

Precision: The precision of a summary with k contrastive sentence pairs is the percentage of the k pairs that are agreed by a human annotator (contrastive)

Aspect coverage: The aspect coverage of a summary is the percentage of human-aligned clusters covered in the summary (representativeness)

Page 19: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

19

Page 20: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

20

content sim.

contrastive sim.

Effectiveness of removing sentimental words in computing contrastive similarity

Page 21: 1 Generating Comparative Summaries of Contradictory Opinions in Text (CIKM09’)Hyun Duk Kim, ChengXiang Zhai 2010/05/24 Yu-wen,Hsu.

21

Conclusion

It aims to summarize contradictory or mixed opinions about a topic and generate a list of contrastive pairs of sentences with different sentiment polarities to help users to digest contradictory opinions.

framed the problem as an optimization problem and proposed two approximation methods to solve the optimization problem.

explored different similarity measures in our optimization framework.