Evaluation of Google Co-op and Social Bookmarking at the Overseas Development Institute By Paul...
19
Evaluation of Google Co-op and Social Bookmarking at the Overseas Development Institute By Paul Matthews ([email protected]) and Arne Wunder ([email protected])
-
Upload
maria-henderson -
Category
Documents
-
view
215 -
download
0
Transcript of Evaluation of Google Co-op and Social Bookmarking at the Overseas Development Institute By Paul...
Evaluation of Google Co-op
and Social Bookmarking at the
Overseas Development Institute
By Paul Matthews ([email protected])and Arne Wunder ([email protected])
Background
• Knowledge management strategy at ODI• Interest in Web 2.0 approaches: Communities of
Practice share recommended sources and bookmarks
• Focuss.eu: Initiative of European development think tanks
• Growing popularity of social bookmarking, interest in usage within organisations
Objective 1
• Comparative relevance assessment of specialised international development search engine Focuss.eu (using Google Custom Search) against Google web search
• http://www.focuss.eu/– 6600 Sources
– 23 Institutions
Objective 2
• Investigate how staff use bookmarking and test a pilot intranet-based bookmarking system
Search engines: Application
Blind Relevance Ranking:72 Test Subjects
1100 rankings2.66 Words / Query
Search engines: Findings (1) Mean overall relevance
Interpretation: Globally, Focuss slightly outperforms Google web search
Search engines: Findings (2) Relevance - Rank
Search engines: Findings (3) Term-sensitive relevance
Interpretation: The strength of Focuss lies in dealing with relatively ambiguous terms.
Arne
Animated, at the end
Arne
Is it possible to animate each column?
Search engines: Findings from Interviews
Aspect CommentsSearch engines Search engines are quick and convenient starting
points, but much less appropriate for complex enquires.
Search engines are excellent for “grey material” (news, contacts, policy documents, less formal research).
Professional directories such as Eldis or ReliefWeb often provide a better, more structured introduction into specific development topic.
Scholarly material
Printed/electronic scholarly journals and books are most authoritative, but suffer from access/subscription issues.
Contribution of Focuss
Focuss appears to be a bit more targeted starting point than Google, but cannot replace other sources.
Arne
Should be animated, at the end
Search engines: Conclusion
• In most cases Focuss delivers “better” results than Google
• But still no guarantee that Focuss is always a better choice than Google
• Focuss’s strength is its context-specificitiy• Search engines are quick and convenient starting
points• Doing good development research means more
than just choosing the “right” search engine
Bookmarking: Design
• Survey of user requirements and behaviour• Creation of bookmarking module for intranet (MS
SharePoint)• Usability testing• Preliminary analysis
Bookmarking: Survey (n=18)
Bookmarking: Survey (n=18)
Bookmarking: Testing - feedback
• 681 bookmarks, 633 URLS, 140 tags• Usability problems
• What are incentives for and advantages of sharing?
• Preference for structured over free tagging
• Public v private bookmarking.
Bookmarking: Conclusions
• Use of implicit taxonomy useful & time –saving
• User base technically unsophisticated • Users want both order (taxonomy) and
flexibility (free tagging)• We need to prove the value of sharing
& reuse (maybe harness interest in RSS)
What can you take from this?
• Not promoting specific engine or bookmarking system, but approaches may be useful to your own networks
• Community filters may help to mitigate information overload!http://www.focuss.eu/yourcontent.htmlhttp://www.google.com/coop
References
• Brophy, J. and D. Bawden (2005) ‘Is Google enough? Comparison of an internet search engine with academic library resources’. Aslib Proceedings Vol. 57(6): 498-512.
• Kesselman, M. and S.B. Watstein (2005) ‘Google Scholar™ and libraries: point/counterpoint’. Reference Services Review Vol. 33(4): 380-387.
• Mathes, A. (2004) ‘Folksonomies - Cooperative Classification and Communication Through Shared Metadata’
• Millen, D., Feinberg, J., and Kerr, B. (2005) 'Social bookmarking in the enterprise', ACM Queue 3 (9): 28-35.
Copyright note
Copyright Paul Matthews and Arne Wunder 2007. This work is the intellectual property of the authors. Permission is granted for this material to be shared for non-commercial, educational purposes, provided that this copyright statement appears on the reproduced materials and notice is given that the copying is by permission of the authors. To disseminate otherwise or to republish requires written permission from the authors.
