A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation...

23
Motivation A Taxonomy of Web Searches Statistics Evaluation of Search Engines Conclusion A Taxonomy of Web Search by Andrei Broder Bahaeddin Eravci, Emre Yilmaz 2012 Bahaeddin Eravci, Emre Yilmaz

Transcript of A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation...

Page 1: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

A Taxonomy of Web Searchby Andrei Broder

Bahaeddin Eravci, Emre Yilmaz

2012

Bahaeddin Eravci, Emre Yilmaz

Page 2: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Outline

1 Motivation

2 A Taxonomy of Web Searches

3 Statistics

4 Evaluation of Search Engines

5 Conclusion

Bahaeddin Eravci, Emre Yilmaz

Page 3: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Outline

1 Motivation

2 A Taxonomy of Web Searches

3 Statistics

4 Evaluation of Search Engines

5 Conclusion

Bahaeddin Eravci, Emre Yilmaz

Page 4: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Aims of the Paper

Point out the difference between classic IR and web searchIntroduce and analyze a taxonomy of web searchesShow how search engines deal with web-specific needs

Bahaeddin Eravci, Emre Yilmaz

Page 5: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

The Classical Model for IR

Bahaeddin Eravci, Emre Yilmaz

Page 6: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Web-spesific Needs

Bahaeddin Eravci, Emre Yilmaz

Page 7: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Outline

1 Motivation

2 A Taxonomy of Web Searches

3 Statistics

4 Evaluation of Search Engines

5 Conclusion

Bahaeddin Eravci, Emre Yilmaz

Page 8: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Classification of Web Queries

1 Informational2 Navigational3 Transactional

Bahaeddin Eravci, Emre Yilmaz

Page 9: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Informational Queries

Acquire some information assumed to be present on oneor more web pagesInformation is in static formNo further interaction is predicted

Example: Where will WC 2018 be heldWC 2018

Bahaeddin Eravci, Emre Yilmaz

Page 10: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Navigational Queries

To reach a particular siteUser visited it in the past or assumes that it existsOnly one right result

Example: What is the official website of IBM?official website IBM

Bahaeddin Eravci, Emre Yilmaz

Page 11: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Transactional Queries

Perform some web-mediated activityFurther interaction is expectedMain categories: shopping, finding servers, downloadingvarious types of files

Example: I need an accommodation in Rome.hotel Rome

Bahaeddin Eravci, Emre Yilmaz

Page 12: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Outline

1 Motivation

2 A Taxonomy of Web Searches

3 Statistics

4 Evaluation of Search Engines

5 Conclusion

Bahaeddin Eravci, Emre Yilmaz

Page 13: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

User Survey

A survey of AltaVista userspresented to random usersusers are self selecteda pop-up window with the questions

Questions to distinguish type of the query.

Bahaeddin Eravci, Emre Yilmaz

Page 14: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

User Survey Questions

Bahaeddin Eravci, Emre Yilmaz

Page 15: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Log Analysis

A random set of 1000 queries from the daily AltaVista logOnly English queriesSexually oriented queries are removedQueries that are neither navigational, nor transactional areassumed to be informational

Bahaeddin Eravci, Emre Yilmaz

Page 16: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Results

Table: Query Classification

Type of query User Survey Query Log AnalysisNavigational 24.5% 20%Informational 39% 48%Transactional 36% 30%

Bahaeddin Eravci, Emre Yilmaz

Page 17: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Outline

1 Motivation

2 A Taxonomy of Web Searches

3 Statistics

4 Evaluation of Search Engines

5 Conclusion

Bahaeddin Eravci, Emre Yilmaz

Page 18: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Evaluation of Search Engines

First generation (1995-1997)On-page data, close to classic IR, mostly informationalqueriesAltaVista, Excite, WebCrawler, etc.

Second generation (1998-1999)Off-page, use of web-specific data such as link analysis,anchor-text, and click-through data, informational andnavigational queriesGoogle, DirectHit

Third generation (2000-now)Attempt to ask "the need behind a query"Data from multiple sources (San Francisco : hotelreservation links, map server, weather server etc.)Support for informational, navigational, transactionalqueries

Bahaeddin Eravci, Emre Yilmaz

Page 19: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Evaluation of Search Engines

First generation (1995-1997)On-page data, close to classic IR, mostly informationalqueriesAltaVista, Excite, WebCrawler, etc.

Second generation (1998-1999)Off-page, use of web-specific data such as link analysis,anchor-text, and click-through data, informational andnavigational queriesGoogle, DirectHit

Third generation (2000-now)Attempt to ask "the need behind a query"Data from multiple sources (San Francisco : hotelreservation links, map server, weather server etc.)Support for informational, navigational, transactionalqueries

Bahaeddin Eravci, Emre Yilmaz

Page 20: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Evaluation of Search Engines

First generation (1995-1997)On-page data, close to classic IR, mostly informationalqueriesAltaVista, Excite, WebCrawler, etc.

Second generation (1998-1999)Off-page, use of web-specific data such as link analysis,anchor-text, and click-through data, informational andnavigational queriesGoogle, DirectHit

Third generation (2000-now)Attempt to ask "the need behind a query"Data from multiple sources (San Francisco : hotelreservation links, map server, weather server etc.)Support for informational, navigational, transactionalqueries

Bahaeddin Eravci, Emre Yilmaz

Page 21: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Outline

1 Motivation

2 A Taxonomy of Web Searches

3 Statistics

4 Evaluation of Search Engines

5 Conclusion

Bahaeddin Eravci, Emre Yilmaz

Page 22: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Conclusion

Web search is task-driven.Search engines need to deal with different types of queries.The main aim of third generation search engines is to dealefficiently with transactional queries via semantic analyses(understanding what the query is about) and blending ofvarious external databases.

Bahaeddin Eravci, Emre Yilmaz

Page 23: A Taxonomy of Web Search by Andrei Broder · 2 A Taxonomy of Web Searches 3 Statistics 4 Evaluation of Search Engines 5 Conclusion Bahaeddin Eravci, Emre Yilmaz. ... Perform some

MotivationA Taxonomy of Web Searches

StatisticsEvaluation of Search Engines

Conclusion

Questions

Bahaeddin Eravci, Emre Yilmaz