Clough PD - Sheffield · Clough PD CURRICULM VITAE Paul David Clough SUMMARY 1. General Paul Clough...

Clough PD

CURRICULM VITAE

Paul David Clough

SUMMARY

1. General Paul Clough is Professor in Information Retrieval at the Information School, University of Sheffield. He received a B.Eng. (hons) degree in Computer Science from the University of York in 1998 and a Ph.D. from the University of Sheffield in 2002. Prior to joining Sheffield he worked for British Telecommunications Plc. His research interests mainly revolve around developing technologies to assist people with accessing and managing information. In particular, Paul has published work in the areas of multilingual information retrieval, information access to digital cultural heritage, evaluation of search systems, geographical information retrieval, text-based image retrieval, plagiarism detection, text re-use, and search analytics. Paul was Scientific Director for the FP7 EU-funded Personalised Access to Cultural Heritage Spaces (PATHS) and a Google Faculty Research Award investigating patterns of users' search behavior in query logs. Paul is co-author of a book on multilingual information retrieval and has over 120 peer-reviewed publications. He is head of the Sheffield IR Group and Programme Coordinator the MSc Data Science programme. 2. Teaching • Coordinator of three undergraduate and postgraduate courses: Introduction to Data Science (PGT)

and Information Retrieval (UG and PGT). Delivery of lecturers on several other courses in the Information School.

• Involved in supervising and co-supervising 19 PhD students since appointment (9 successfully completed). External examiner for 16 PhD students and internal examiner for 2 PhDs.

• Fellow of the UK Higher Education Academy and Member of the British Computer Society (Membership No. 990654797).

• Programme Coordinator for the MSc Data Science programme.

3. Leadership, Management and Administration • Key departmental roles: Programme coordinator of BA undergraduate programmes (2006-2009),

deputy programme coordinator for MSc Digital Library Management (2012-2015), Postgraduate taught Examinations Officer (2010-2013), Member of the Departmental Research Committee (2010-), Member of Departmental Strategy Group (2014-).

• Director of Research for the Information School (2016-).

• REF Coordinator for the Information School (2015-).

• Head of Information Retrieval research group (2013-).

4. Professional and External Development Activities • Regular reviewer for major journals and conferences in the field; involved in the organisation of

major conferences and workshops in the field; member of organising committee for Enterprise Search Europe (2011-2015), served on the steering committee of the European Cross Language Evaluation Forum (since 2003), General Chair for CLEF 2014 conference.

• Involved in the organisation of major international evaluation events at the US Text Retrieval Conference (TREC), European Cross Language Evaluation Forum (CLEF) and Indian Forum for Information Retrieval Evaluation (FIRE).

• External reviewer for research projects for funding bodies, including Science Foundation Ireland (SFI), UK Engineering and Physical Sciences Research Council (EPSRC), Leverhulme Trust, UK

Updated: 17 May 2017 of 28

Economic and Social Research Council (ESRC), Netherlands Organisation for Scientific Research (NWO) and the UK Arts and Humanities Council (AHRC).

5. Research & Publications • Principal or co-investigator on 15 research grants and studentships since employment in 2005 worth

~£7 million (of which ~£2 million for Sheffield).

• Co-author of 1 book on multilingual search, 2 edited books, 8 book chapters, 35 refereed journal papers, 13 professional articles, 64 refereed conference papers and 63 refereed workshop papers since 2001.

• Founder and co-founder of two internationally recognised research collaborations (ImageCLEF and GeoCLEF) that have run for 12 years in total and involved 60 international research groups producing hundreds of papers.

• Awarded US Patent for an information management system.


THE UNIVERSITY OF SHEFFIELD

CURRICULUM VITAE

1 PERSONAL DETAILS

SURNAME: Clough FORENAMES: Paul David DEPARTMENT: Information School DATE OF BIRTH: 28th December 1974 CITENZENSHIP: British QUALIFICATIONS: Postgraduate Certificate in Higher Education (PGCHE), University of

Sheffield, 2008

PhD Department of Computer Science University of Sheffield, 2002

BEng. Computer Science University of York (First Class Honours), 1995/98

BTEC Higher National Certificate Eng. (Software Engineering) Suffolk College (Distinction), 1993/95

BTEC National Certificate Eng. (Electronics and Communications) Suffolk College (Distinction), 1990/93

CURRENT APPOINTMENT(S) IN THE UNIVERSITY AND DATE(S): Professor in Information Retrieval, Information School, University of Sheffield, 2014-present PREVIOUS APPOINTMENTS: Reader in Information Retrieval, Information School, University of Sheffield, 2014-present Senior Lecturer in Information Retrieval, Information School, University of Sheffield, 2010-2014 Lecturer in Information Systems, Information School, University of Sheffield, 2005-2010 Research Assistant, Department of Information Studies, University of Sheffield, 2002-2005 Research Assistant, Department of Computer Science, University of Sheffield, 1999-2002 Manager, British Telecommunications Plc, 1998-1999 Technician, British Telecommunications Plc, 1994-1998 BT Labs training programme for technicians, British Telecommunications Plc, 1991-1994


2 TEACHING 2.1 CURRENT UNDERGRADUATE AND POSTGRADUATE TEACHING

Course Title Level of Teaching Student Contact Hours

Module coordinator: INF6027 Introduction to Data Science

Postgraduate 15 credits

22 Hours ~40 students

Module coordinator: INF6060 Information Retrieval: Search Engines and Digital Libraries



Contribute to: INF6050 Database Design



Contribute to: INF205 Database Design

Level Two 20 credits

2 Hours (shared with INF6050) ~30 students

Contribute to: INF6017 Content Management Systems


6 Hours ~8 students

Contribute to: INF317 Content Management Systems

Level Three 20 credits

2 Hours (shared with INF6017) ~5 students

Contribute to: INF6840 Archives and Records Management



Contribute to: INF6040 Business Intelligence



Contribute to: INF304 Business Intelligence

Level Three 20 credits


Dissertation Postgraduate 45 credits

1 hour per student per week ~6 students

Dissertation Level Three 20 credits

1 hour per student per week ~1 student

2.2 PREVIOUS UNDERGRADUATE AND POSTGRADUATE TEACHING

• INF6512 Information Systems in Health. 2008-2013. 16 hours lectures (distance learning) plus 6 hours discussion sessions; ~20 students; Postgraduate module (15 credits).

• INF205 Database Design. 2009-2013. ~2 hours lectures (shared with INF6050); ~30 students; Level Two (20 credits).

• INF206 Information Retrieval: Search Engines and Digital Libraries. 2010-2014. ~2 hours lectures (shared with INF6060); ~50 students; Level Two module (20 credits).

• INF211 Information Systems Modelling. 2005-2008. ~8 hours lectures; ~25 students; Level Two module (20 credits).

• INF6110 Information Systems Modelling. 2005-2008. ~8 hours lectures; ~50 students; Postgraduate module (15 credits).

• INF6090 Information Storage and Retrieval Research. 2007-2011. ~4 hours lectures; ~13 students; Postgraduate module (15 credits).


• INF6090 Information Storage and Retrieval Research. 2007-2011. ~4 hours lectures; ~13 students; Postgraduate module (15 credits).

• INF6440 Electronic Publishing. 2005-2007. ~6 hours lectures; ~12 students; Postgraduate module (15 credits).

• INF6400 Information Systems and the Society. 2005-2007. ~2 hours lectures; ~12 students; Postgraduate module (15 credits).

• INF6001 Information Systems Project Management. 2006-2008. ~6 hours practical sessions; ~40 students; Postgraduate module (15 credits).

• INF312 Information Management in the Digital Economy. 2005-2007. ~4 hours lectures; ~12 students; Level Three module (20 credits).

2.3 TEACHING INNOVATION AND DEVELOPMENT • Development of a new MSc programme in Data Science, including creating the programme

learning objectives, curriculum design, marketing and promotion activities and creation of new modules. The course attracted 42 students in 2015-16 from multiple countries (e.g. India, Mexico, Kuwait, Oman, Greece and the UK) in both full-time and part-time modes. Current activities are around further development of the part-time version and consideration of a distance learning offering. Innovation included developing a Data Science programme in a competitive market and creating a more information science perspective on the topic; together with establishing close links with industries (local and national) through the organisation of an ‘industry day’ event.

• Development of a new module in 2008 on Information Systems in Health (INF6512) for the MSc Health Informatics aimed mainly at healthcare professionals (e.g. UK NHS staff), including creating learning objectives and appropriate assessment criteria, and generating 9 new lectures (all 2 hour) and a range of online resources. Example student feedback includes: “I have found this a thoroughly enjoyable module which has given me a good introduction to the design and implementation of information systems which I feel will be very useful to me as my career develops in the future” and “I have been able to utilise aspects of this module immediately in my job which has been particularly satisfying.”

• Re-designed INF208 Digital Multimedia module in 2007 as part of completing a Certificate in Learning and Teaching (leading towards a PGCEHE) and used a model of constructive alignment to make the learning objectives, lecture material and practical sessions tie together more coherently. The quality of student’s work has been very high and demonstrated at undergraduate open days and our research panel advisory day.

• Took over as module coordinator of the undergraduate and postgraduate Information Retrieval module (INF206/6060) in 2010. This module is core for many students who come with various backgrounds (e.g. social science, computer science). The module aims to summarise the field of Information Retrieval in an accessible way, but also help students understand how IR systems actually work. The lecture content was re-written and new coursework designed that coincided with the arrival of new lecturers on the module. Martin White (visiting iSchool professor) mentioned the module in his O’Reilly book on Enterprise Search (http://shop.oreilly.com/product/0636920025689.do) as an example of the type of training teams supporting enterprise search should receive.

• To develop students transferable skills I have endeavoured to include exposure to professional software within the modules I teach where possible. Since 2007 Adobe Flash, professional software for time-based authoring of animations has featured as a core part of the practical sessions for INF208 Digital Multimedia. We use Flash to reinforce theoretical principles of animation taught in the lectures and the coursework is based on developing a professional animation to communicate, through multimedia, a news event. In the undergraduate and postgraduate Database Design module (INF205/6050), together with Dr. Peter Stordy, we use Oracle’s DBMS to introduce relational database design and teach SQL. Oracle is widely used in industry for data storage solutions.


2.4 TEACHING PUBLICATIONS • Currently writing a book with Gianluca Demartini for Facet entitled “Introduction to Data

Science”. This will provide a more information science perspective on the subject and be the course textbook for the MSc Data Science programme.

• Contributed to an article based on our experiences with our database design course: Stordy, P. and Clough, P. (2014) Practice makes Perfect: Improving success rates in a Database Design Module, In Proceedings of TLAD 2014 (Teaching, Learning and Assessment in Databases).

• Co-author of first book to be published describing both user- and system-centred issues with developing multilingual information retrieval systems (Peters et al., 2012).

2.5 OTHER TEACHING ACTIVITIES • In 2007 and 2008, together with Prof. Mark Sanderson (ex-iSchool) and Dr. Mark Stevenson

(Computer Science), we supervised Computer Science students who took projects within the DARWIN initiative, a group software development project. One of these groups contributed towards a publication in the journal Language Resources and Evaluation (Clough & Stevenson, 2010).

• I have successfully supervised undergraduate students with a number of personal issues. In 2008 I was shortlisted (12 out of 124 recommendations) for a campaign run by the Student Union called “I love my personal tutor”. In 2008 I received a formal letter of thanks from Major Alan Easingwood (Cartographer in the British Army) on the quality of supervision for his Master’s dissertation.

• Working with Dr. Peter Stordy and Prof. Mark Sanderson, in 2009 I contributed to setting up and running of the department’s inaugural “excellence hub”. This was a one day workshop for schools to bring classes of pupils into the University to give them a flavour of what undergraduate courses are like. I presented a lecture and exercise on search engines to a class of pupils from two local secondary schools. In 2006 and 2007 I gave a talk on literary forensics to local Sheffield College students studying forensics as part of the Audiometry Day, organised by Department of Computer Science).

• I have been invited as guest lecturer on several occasions: 2013 European Summer School in Information Retrieval (ESSIR 2013), TrebleCLEF cross language search summer school in Pisa 2009, University of Valencia (Valencia, Spain) in 2009, Universidad Nacional de Educación a Distancia (UNED) (Madrid, Spain) in 2008.

• In 2003 I was invited to write a report for the UK Plagiarism Advisory Service on the technical aspects of plagiarism detection, one of my research areas. I wrote a report entitled “Old and new challenges in automatic plagiarism detection” that has been cited 56 times (Google Scholar, 30th Sept 2013).

3 LEADERSHIP, MANAGEMENT AND ADMINISTRATION 3.1 CURRENT ACTIVITIES

• Director of Research for the Information School (2016-present).

• REF Coordinator for the Information School (2015-present).

• Member of the Information School Research Committee (2010-present).

• Staff Review and Development Scheme reviewer (2012-present).

• Mentor for two academic staff in the Information School as a part of our research mentoring scheme (2015-present)

• Programme Coordinator for the MSc Data Science programme (2014-present).

• Member of the Information School Strategy Group (2014-present).


• Member of the Discipline Committee of Senate, University of Sheffield (2014-present).

• Co-director of the Digital Society Network, University of Sheffield (2014-present).

• Member of Student Staff Committee representing Data Science (2014-present).

• Co-organiser with Gianluca Demartini from the Information School and staff from Sheffield Hallam University of the Data Science Forum (https://www.sheffield.ac.uk/is/about/datascienceforum) that aims to aims to provide a catalyst for networking and the sharing of knowledge between industry/business practitioners, academics and students on topics related to Data Science.

• Head of Information Retrieval Research Group with up to 15 researchers (academics, post-doctoral staff and PhD students). This role involves coordinating the research activities of IR group, representing the group within the School and externally (e.g. helping to shape our web presence), coordinating research group meetings and managing the group budget.

• Member of the Departmental Research Committee (DRC), since 2010. Duties of this role include attending DRC meetings, reviewing research activities within the department and contributing to discussions about departmental research strategies.

• Assisted Dr. Ana Vasconcelos with developing a REF Case Study for the iSchool entitled “Informed information systems development and evaluation: integrating information behaviour models in effective systems development”. This was one of two case studies being developed in the iSchool for REF 2014.

• Member of the Information School Promotions Panel.

3.2 PREVIOUS ADMINISTRATIVE ACTIVITIES • First Year Undergraduate Mentor (2010-2012).

• Postgraduate Taught Examinations Officer (2010-2013).

• Deputy programme coordinator for MSc Digital Library Management (2012-2014).

• Programme Coordinator for the BA Accounting & Finance/Information Management (NP41/MGTU18) and BA Accounting and Business Management/Information Management (NP21/MGTU17) programmes (2006-2009).

• Information School representative member of the Board of the Faculty of Pure Science (2006-2009).

• Dissertation coordinator on the MSc Health Informatics Programme (2006-2009).

• On the organising team for the undergraduate degree in Informatics offered by the iSchool (2012-2013).

3.3 INNOVATIONS • As PGT Exams Officer, I developed guidelines for our moderation process, updated our standard

marking grid template and gave presentations to new staff outlining procedures related to assessment.

• Programme design at both PG and UG level as indicated under Section 2.3.

4 PROFESSIONAL AND EXTERNAL STANDING

4.1 COMMITTEE MEMBERSHIP • Fellow of the UK Higher Education Academy (recognition ref. 41201) since August 2010.

• Member of American Society for Information Science & Technology (2007-2008).


4.2 REFEREEING AND EXTERNAL EXAMINING • Referred papers for major journals and conferences in the field, including Journal of the

American Society for Information Science and Technology, Computers, Environment and Urban Systems, Database Systems for Advanced Applications, ACM Transactions on Software Engineering and Methodology, International Journal on Geographic Information Systems, Information Processing and Management, ACM Transactions on Information Systems, ACM Transactions on the Web, ACM Transactions on Computing Education, Computers and the Humanities, Computer Speech and Language, Journal of Machine Learning Research, Journal of Knowledge based Systems, ACM Transactions on Knowledge and Data Engineering, ACM Special Interest Group on Information Retrieval (SIGIR), European Conference on Information Retrieval, European Semantic Web Conference, Joint Conference on Digital Libraries, Conference on Information and Knowledge Management, European Association for Computational Linguistics, Conference on Empirical Methods in Natural Language Processing and Theory and Practice in Digital Libraries.

• Reviewed grant proposals for: the Netherlands Organisation for Scientific Research (NWO), Science Foundation Ireland (SFI), UK Engineering and Physical Sciences Research Council (EPSRC), UK Arts and Humanities Council (AHRC), the Leverhulme Trust and the Portuguese Foundation for Science and Technology (FCT).

• Requested to provide input and professional judgment on the new “MSc and Postgraduate Diploma in Data Science & Analytics” being considered by Maynooth University, Australia.

• Panel member and external assessor for the “Quinquennial Review of Department of Computer and Information Sciences”, Strathclyle University, March 2016.

• External reviewer of the MSc Information Management programme as a part of a five-yearly Institution-Led Subject Review of the Department of Information Management at Aberdeen Business School, Robert Gordon University (2010).

• External advisor on the MSc, PGDip and PGCert in Geospatial Intelligence run by the Royal School of Military Survey (RSMS) and Cranfield University in 2009. I was invited to act as external examiner on the course from 2012-2016.

• External examiner for 16 PhD theses at the following institutions: University of Bedfordshire (UK), University of Glasgow (UK), University of Birmingham (UK), University of Tampere (Finland), Humboldt University Berlin (Germany), University of Cape Town (South Africa), University of Essex (UK), Polytechnic University of Valencia (Spain), University of Hull (UK), Bauhaus University Weimar (Germany), Universidad Nacional de Educatión a Dictancia (Spain), RMIT University (Australia), Humboldt University Berlin (Germany) and University of Bradford (UK).

4.3 CONFERENCE ORGANISATION • Co-organiser workshop “Accessing Cultural Heritage at Scale” held in conjunction with

JCDL’16, Newark, NJ, 22 June 2016. See: http://achs.group.shef.ac.uk/

• Workshop Co-chair for European Conference on Information Retrieval (ECIR 2016).

• General Chair for the CLEF 2014 conference 15-18 Sept. The conference (http://clef2014.clef-initiative.eu/) attracted around 150 delegates with three invited speakers: Susan Dumais (Microsoft Research), Fabio Ciravegna (University of Sheffield) and Ann Blandford (UCL). The conference was opened by Professor Paul White, Deputy Vice-Chancellor of the University of Sheffield.

• Poster co-chair for the 2014 international iConference (with Dr. Toine Borgers).

• Programme Co-chair of the world’s 3rd most prestigious conference on IR: the European Conference on Information Retrieval (ECIR) 2011. http://www.ecir2011.dcu.ie/

• Lab Organizing Committee Co-chair for the Cross Language Evaluation Forum (CLEF) 2011 conference (equivalent to PC co-chair). CLEF is the premier conference on multilingual information systems in Europe (and worldwide). http://clef2011.org/


• Regularly on the programme committees of various conferences/workshops, including: European Conference on Information Retrieval (ECIR), Association of Computing Machinery Conference of the Special Interest Group in Information Retrieval (ACM SIGIR), Conference on Information and Knowledge Management (CIKM) and Cross-Language Evaluation Forum (CLEF).

• Member of the workshop review panel at Theory and Practice of Digital Libraries (TPDL) 2013

• Student mentor at European Conference on IR (ECIR) 2012

• Tutorial selection committee member for ACM Special Interest Group on Information retrieval (SIGIR) 2012

• Senior Programme Committee member for the second most prestigious conference in information and knowledge management: the Conference on Information and Knowledge Management (CIKM) 2010. http://www.yorku.ca/cikm10/ and 2011 http://www.cikm2011.org/

• Involved in the mentoring programme for the ACM Special Interest Group on Information Retrieval (SIGIR) in 2008 and 2009

• General chair for the Cross Language Evaluation Forum (CLEF) 2014 that will be held in Sheffield in Sept. 2014. I am co-organising the conference with Dr. Robert Villa and Prof. Elaine Toms. The conference will likely attract 150-200 attendees.

• Co-organiser of “Exploration, and Navigation and Retrieval of Information in Cultural Heritage” 2013 (ENRICH’13) held at SIGIR 2013 (Dublin). See: http://www.cultura-strep.eu/events/enrich-2013

• Co-organiser of 6th Workshop on Geographic Information Retrieval (GIR'10), Zurich 18-19 February 2010. See: http://www.geo.uzh.ch/~rsp/gir10/

• Co-organiser of workshop on Information Retrieval Over Query Sessions held at ECIR 2012 (Barcelona). See: http://ir.cis.udel.edu/ECIR12Sessions/

• Co-organiser of Session Track at Text REtrieval Conference (TREC) from 2010: an evaluation exercise that aims to adapt current methods for system-oriented evaluation of IR systems to multi-query sessions. Rather than organising a workshop event, this is activity stretches over approximately 10 months and involves preparing data, tasks and evaluating participant submissions. See: http://ir.cis.udel.edu/sessions/

• Co-organiser of tasks to evaluate systems for plagiarism detection (and text reuse) at the Indian FIRE conference. The activity is called PAN@FIRE and has lead to collaborations with UPV University (Spain). This year (2013) the task has been focused on Cross-Language News Story Detection for Indian languages. See: http://users.dsic.upv.es/grupos/nle/clinss.html

• Organiser of TrebleCLEF Query Log Analysis Workshop "Query Log Analysis: From Research to Best Practice" (QLAW2009), May 27-28 2009, London. This workshop focused on the field of query log analysis and involved a range of speakers from around the world to provide input and discussion on the topic (Jim Jansen, USA; Lynn Silipigni Connaway, USA; Filip Radlinski, Microsoft UK; Vanessa Murdock, Yahoo! Spain; Mark Levene, UK; Bettina Berendt, Belgium). See: http://ir.shef.ac.uk/cloughie/qlaw2009/

• I have been actively involved in the Cross Language Evaluation Form (CLEF) since 2003, both on the steering committee and as a track organiser (ImageCLEF, GeoCLEF and iCLEF). My most significant contribution was in setting up a cross-language image retrieval track (called ImageCLEF) in 2003, that still runs today and lead to publication of an edited book on the subject (Müller et al., 2010). See: http://www.clef-campaign.org/

4.4 RECENT INVITED PRESENTATIONS

• Invited speaker for presentation entitled “Big Data: Big Opportunities and Big Problems” as part of the ESRC funded seminar series on “Exploring Big Data to Examine Employee Health and Wellbeing Big Data. See: http://wrdtc.ac.uk/event/big-data-and-employee-wellbeing-an-esrc-seminar-series/


• Invited speaker at “Evaluating Use and Impact,” which took place on March 31st at the University of Strathclyde. My talk was entitled “Evaluating Information Searching in Digital Cultural Heritage: Thinking Outside the (Search) Box?” See: https://www.youtube.com/playlist?list=PLGJRXP7d5Vs4mhr6BHHuil5tPponbKEZr

• Ran half-day tutorial at BCS Search Solutions in London (November 2015) entitled “Evaluating Search” that attracted 12 attendees, mainly from industry. See: http://irsg.bcs.org/SearchSolutions/2015/ss2015tutorials.php

• Invited to speak at the iFutures 2014 and 2015 student conferences, University of Sheffield. In 2014 I gave a presentation about working with industry; at 2015 my presentation was about data visualisation

• Invited keynote at Forum for Information Retrieval Evaluation (FIRE 2014). 4-6 December 2014. Bangalore, India. My talk was entitled “Examining the limits of crowdsourcing for relevance assessment”

• Invited speaker at EuropeanaTech 2015 conference. 11-13 February 2015. Paris, France. My talk was entitled “Supporting exploration and use of digital cultural heritage materials”

• Invited keynote speaker at PAN@CLEF workshop 2014. My talk was entitled “Proving ownership: the case of ‘wag in a bag’”

• Invited lecturer at the 9th European Summer School in Information Retrieval (ESSIR) 2013 (Granada, Spain). This attracted around 80 students (undertaking PhD and from industry) and my contribution was a 2-hour lecture on multilingual search. http://www.ugr.es/~essir2013/

• Invited talk at UK ISKO 2013 conference (July 8-9 2013) on the challenges of multilingual search. http://www.iskouk.org/conf2013/

• Invited talk to the Information Retrieval group at Glasgow University. The talk was entitled “Examining the limits of crowdsourcing for relevance assessment” (26 November 2012).

• Invited talk at the BIALL 2012 conference (Belfast) about exploratory search and paths for law librarians (with Iain Dunbar from LAC Group). The talk was entitled “Pathways in the legal domain” (14-16 June 2012). http://www.biall.org.uk/pages/belfast-2012-programme.html

• Keynote speaker at the second Spanish Conference on Information Retrieval (CERI 2012). My talk was entitled “Experimental Evaluation in Visual Information Retrieval” (19 June 2012). http://users.dsic.upv.es/grupos/nle/ceri/en/keynotes.html

• Invited speaker at the Enterprise Search Europe Conference 2011. My talk was entitled “The challenges of multilingual search” (24 October 2011).

• Invited talk to academic staff from the HCI group at York University and also two visitors from the Open Society Archives from the Central European University in Budapest. The talk was entitled "Using pathways for navigating and personalising access to cultural heritage materials" (2 June 2011).

• Invited talk to the Information Retrieval group at Glasgow University. The talk was entitled “Using pathways for navigating and personalising access to cultural heritage materials” (14 March 2011).

• Invited speaker to Department of Information Science at Loughborough University. The talk was entitled “MultiMatch: Multilingual Information Access to Cultural Heritage Materials” (4 February 2011).

• Invited speaker at the Online Computer Library Centre, Inc. in Dublin (Ohio, USA), and Talk entitled “The MultiMatch Project”, Part of the Distinguished Seminar Series (23 September 2009).

• Invited speaker at the TrebleCLEF Summer School on Multilingual Information Access (Pisa, Italy), Tutorials: "Multilingual Search Assistance: Interactive Aspects of Cross Language Information Access" and "MultiMatch: A Multilingual/Multimedia Search Engine for Cultural Heritage: Interface Design and Demo" (15-19 June 2009).


• Invited speaker at the University of Valencia (Valencia, Spain), Talks included "Experiments involving a Web2.0 application called Flickr", "Research in Geographical Information Retrieval" and "Measuring Text Reuse in the British Press Industry" (June 2009)

• Invited speaker at the MAVIR 2008 event (Madrid, Spain), "Multimedia retrieval and evaluation" (November 2008)

• Guest lecturer at the Universidad Nacional de Educación a Distancia (UNED) (Madrid, Spain), lectures on plagiarism detection and business intelligence (November 2008)

• Invited to speak at an interdisciplinary workshop held at Cambridge University (Cambridge, UK), "Measuring Text Reuse in Journalism", The workshop was entitled "Inspiration, Innovation, or Infringement: Multidisciplinary Perspectives on Piracy and Copyright" and organised by the Centre for Intellectual Property & Information Law and held at Emmanuel College, Cambridge (July 1 2008)

• Umbrella 2007 conference organised by the Chartered Institute of Library and Information Professionals (University of Hertfordshire, UK), "Trends in multimedia retrieval - the professional implications" (June 2007)

• Panel session on evaluation of medical retrieval systems at ISHIMR2007 conference (Sheffield, UK), "Current state-of-the-art in image retrieval" (July 2007)

• Panel session on evaluation of image retrieval systems at American Society for Information Science and Technology (ASIST) (Texas, USA), "ImageCLEF: the CLEF Cross-Language Image Retrieval Campaign" (November 2006)

• The DELOS Network of Excellence on Digital Libraries Demo Day, Bibliothèque Nationale de France, Francois-Mitterand site Paris, France (Paris, France), "Building and Evaluating Systems for Cross-Language Image Retrieval" (1 February 2006)

• The MICHAEL (Multilingual Inventory of Cultural Heritage in Europe) conference: towards a catalogue for the European digital library (Bristol, UK), "Bridging the Language Gap: making digital collections available to a multilingual society" (15 November 2005)

• Invited talk at Universidad Iberoamericana, Torreon, Coahuila (Torreon, Mexico), "SPIRIT: spatially-aware information retrieval on the Internet" (August 2005)

• Invited talk at Lancaster University to the Corpus Linguistics Research Group (CRG) (Lancaster, UK), "Measuring Text Reuse" (May 2005)

• Invited talk at Geneva University (Geneva, Switzerland), “Cross-language image retrieval" (17 March 2005)

• Invited talk at the Press Association (London, UK), "METER - Measuring Text Reuse" (4 November 2004)

• Keynote speaker at a Digital Forum event organised by Business Link South Yorkshire (Sheffield, UK), "SPIRIT: Spatially-Aware Information Retrieval on the Internet" (23 September 2004)

• Keynote speaker at RIAO'2004 Conference (Avignon, France), "The CLEF cross language image retrieval campaign - ImageCLEF" (May 2004)

4.5 KNOWLEDGE TRANSFER THROUGH CONSULTANCY

• Invited in 2008 as external reviewer for the UK National Archives (TNA) of their search strategy. Discussed potential project work for the coming months for geo-referencing their archived collections. This resulted in work described in (Clough et al., 2011).

• Provided consultancy on the way in which the search engine managers at TNA could monitor activity on their system and provide general information on how users typically interact with search engines (log analysis). TNA funded a 6 months project (April – September 2010) to formalise this collaboration (worth ~£70,000). Our study of using crowdsourcing to gather relevance assessments resulted in a publication in IEEE Internet Computing (Clough et al., 2013).


• Pursuing the use of pathways within the legal domain through a connection with Iain Dunbar from LAC Group. This has led to discussions with Lexus Nexus and Research Monitor and demonstrations of the PATHS prototype system (Sept. 2013).

4.6 PUBLIC ENGAGEMENT

• “What’s behind the little white search box” Public engagement event for Pint of Science, 25th May 2016, Roco Creative Co-op, Sheffield.

5 RESEARCH & PUBLICATIONS 5.1 RESEARCH AREAS

My research interests are focussed on developing algorithms and systems to assist people with accessing and managing information in different contexts and domains. I am best known for my work on multilingual search, retrieval of images, location-based search, analysis of search logs, text re-use and evaluation of search systems. I have published over 100 peer-reviewed articles, including co-authoring a Springer book on multilingual information retrieval (Peters et al., 2012). My background in natural language processing (gained during my PhD in Sheffield) has allowed me to develop more sophisticated approaches to accessing information. In addition to developing techniques, I have also built up an understanding of the users of information access systems and their information needs, taking a more user-oriented view to my research. For example, as PI in the EU-funded Multimatch project, I coordinated the work on designing the user interface for multilingual information access to multimedia cultural heritage information based on a user-centred approach (Marlow et al., 2008a). The approach was re-used in another EU-funded project (PATHS), which I am Scientific Director of, to develop an exploratory search system for cultural heritage content and a user-centred approach is also being taken to develop a recommender system a large-scale library catalogue managed by OCLC Inc. In addition to my research in the field of information access, I am also interested in how people use, and re-use, the information that they find. In particular, I have analysed legitimate text re-use within the context of the British Press (the METER project), and also published on plagiarism and its detection within an educational context (considered as illegitimate re-use). More recently I have been co-supervising PhD students on topics in plagiarism detection with Dr. Mark Stevenson in Computer Science. One of the most recent publications from this involved devising techniques to identifying the reuse of text in Medline abstracts (Nawab et al., 2013). A further theme of my research has been to create re-usable resources (corpora and test collections) for the wider research community. In 2003, together with members of the Sheffield Journalism Department and the UK Press Association, I helped create the METER Corpus: a resource for the study and analysis of text re-use in the British Press. The resource has been used by over 100 researchers and continues to be cited. One of my major contributions has been in the area of Information Retrieval (IR) evaluation. The availability of standard evaluation models, tools and methods has significantly benefited the IR community, bringing about novel developments in search technologies. I have been involved in the creation of standardised evaluation resources at three international evaluation campaigns: the Cross Language Evaluation Form (CLEF) in Europe, the Text Retrieval Conference (TREC) in the US and the Forum for Information Retrieval Evaluation (FIRE) in India. I have built resources to evaluate systems for image retrieval, promoting diversity, improving search across sessions and cross-language news story searching. I was co-founder of ImageCLEF in 2003, an evaluation exercise for assessing image retrieval systems that still runs today. The experiences of running ImageCLEF after the first seven years were written up into an edited collection of articles on state-of-the-art for cross-language image retrieval and evaluation (Muller et al., 2010). The book involved 63 contributors from 26 academic institutions and 7 businesses, including Xerox Research Centre Europe, Siemens, Yahoo!, Research, TecKnowMetrix and PA Images (UK). As stated by Little, Llorente and Ruger from The Open University in (Muller et al., 2010): “ImageCLEF is useful and fulfils a significant need in multimedia Information Retrieval” (p. 522).


A substantial proportion of my research has involved non-academic institutions or industrial collaborators, including the UK Press Association, Ordnance Survey, the UK National Archives, OCLC Inc., Alinari, the Netherlands Sound and Vision Archives, Press Association Images and Tate Online. This has allowed me to investigate ‘real’ information access problems and facilitate knowledge transfer. For example, in 2010 the UK National Archives (TNA) commissioned a 6 months project aimed at improving access to data managed by TNA. The project involved analysing TNA's main web server logs to establish the range of subjects being searched by online visitors to their archives and identifying common information searching behaviours. Additionally we proposed methods for creating test collections efficiently for commercial settings. Tim Gollins, Head Of Digital Preservation and Resource Discovery, said this of the project “I think it is important that I document some of the impact of this work here; you should know that the outputs of the work were provided in such a focused and timely way that they have been able to dovetail with our system development activities this year [2011] and inform critical decisions in designing our new resource discovery system to the benefit of the organisation and ultimately the public that use The National Archives.” [Email dated 9 Feb 2011]. As part of an EU-funded Coordinated Action (TrebleCLEF) designed to bring together investigators working in the field of evaluation for multilingual information access to consolidate and promote best practice, I organised a workshop on query log analysis (and evaluation) aimed at transfer of research to best practice (Clough & Berendt, 2009). This was attended by academics and representatives from business to discuss the area of analysing search logs. Given the ubiquity of search and the prevalence of information in all areas of our lives, my future research interest is in developing effective retrieval technologies that support users as they seek to fulfil their information needs. I plan to continue researching information access in this changing landscape and within different contexts with a focus on the end user, their information needs and required support. A future vision I have for my research could be entitled “Information Access for the Masses”. This involves understanding how people access information in their individual contexts to inform the design of next-generation information access technologies. Regardless of the personal, socio-economic or political matter, people should be able to, not just have equal access to, but be able to equally access information despite their socio-economic class, their disability and age, their language use or their mental abilities. I plan to pursue this with members of the IR group in the coming years.

5.2 RESEARCH GRANTS AND INCOME CURRENT GRANTS AND CONTRACTS DATE SPONSOR TITLE INVESTIGATORS FUNDING 2016 EUROPEAN

COMMISSION

(CEF)

EUROPEANA DSI-2 CLOUGH (PI) £48,000

2015 AHRC

COLLABORATIVE

DOCTORAL

PROJECT

INVESTIGATING

METHODS FOR

INFORMATION

EXPLORATION AND

DISCOVERY IN BIG

DIGITAL ARCHIVES

CLOUGH (PI) DEMARTINI (CI)

£70,000

2014 UOS

(INNOVATION, IMPACT AND

KNOWLEDGE

EXCHANGE R&D

AWARD)

USER PREFERENCE

VS. PERFORMANCE

FOR BUSINESS

INTELLIGENCE (BI)

DASHBOARDS

CLOUGH (PI) £10,000

2014 EUROPEAN

SCIENCE

FOUNDATION

CLEF 2014: INFORMATION

ACCESS EVALUATION

MEETS

CLOUGH (PI) ~£7,300


MULTILINGUALITY , MULTIMODALITY

AND INTERACTION 2013 GOOGLE DEVELOPING A

TAXONOMY OF

SEARCH SESSIONS

CLOUGH (PI) TOMS

(CI) £46,000

2012 UOS RESEARCH GRANT

STIMULATION FROM

FSS

CLOUGH (PI) £5,249

2012 CEC 7TH

FRAMEWORK

(CHIST-ERA)

VISUALSENSE: TAGGING VISUAL

DATA WITH SEMANTIC

DESCRIPTIONS

GAIZAUSKAS (PI) CLOUGH (CI)

~£388,000 (TOTAL ~£1.1 MILLION )

2011 CEC 7TH

FRAMEWORK

(STREP)

PATHS: PERSONALIZED

ACCESS TO

CULTURAL HERITAGE

SPACES

STEVENSON (PI) CLOUGH (PI)

£466,000 (TOTAL ~£2

MILLION )

2010 AHRC

COLLABORATIVE

DOCTORAL

AWARD

USER-CENTRED

DESIGN OF A

RECOMMENDER

SYSTEM FOR A

UNIVERSAL LIBRARY

CATALOGUE

CLOUGH (PI) SEN (CI)

~£70,000

TOTAL CURRENT RESEARCH GRANTS £1,023,249

PREVIOUS GRANTS AND CONTRACTS DATE SPONSOR TITLE INVESTIGATORS FUNDING 2012 ROYAL

HOLLOWAY

UNIVERSITY

LIBRARY

EVALUATING THE

SEARCH25 SYSTEM CLOUGH (PI) ~£30,000

2010 UK NATIONAL

ARCHIVES IMPROVING

INFORMATION FINDING

AT THE UKNATIONAL

ARCHIVES

CLOUGH (PI) SANDERSON (CI)

£70,000

2007-2009 CEC 7TH

FRAMEWORK

(CO-ORDINATED

ACTION)

TREBLECLEF: EVALUATION , BEST

PRACTICES AND

COLLABORATION FOR

MULTILINGUAL

INFORMATION ACCESS

SANDERSON (PI) CLOUGH (CI)

£73,000 (TOTAL

~£500,000)

2006-2008 CEC 6TH

FRAMEWORK

(STREP)

MULTIMATCH: MULTILINGUAL /MULTIM

EDIA ACCESS TO

CULTURAL HERITAGE

CLOUGH (PI) CIRAVENGA (CI) SANDERSON (CI) PETRELLI (CI)

£254,000 (TOTAL ~£2.6 MILLION )

2006-2008 CEC MARIE

CURIE

TRANSFER OF

KNOWLEDGE

MEMOIR: LEARNING

HOW TECHNOLOGY CAN

HELP PEOPLE CREATE

AND MANAGE LONG-TERM PERSONAL

MEMORIES

WHITTAKER (PI) CLOUGH (CI) SANDERSON (CI) PETRELLI (CI)

£474,000

2006-2008 EPSRC CASE

STUDENTSHIP DEFINING IMPRECISE

REGIONS USING

KNOWLEDGE FROM THE

CLOUGH (PI) £82,000


WEB TOTAL PREVIOUS RESEARCH GRANTS £983,000

TOTAL (CURRENT AND PREVIOUS) £2,006,249

RESEARCH DEGREE SUPERVISION CURRENT

• Philip Webster. Investigation of the use of entity-centric methods for information access in big digital archives. Funded by AHRC and UK National Archives. Start date Sept 2015.

• Xiaoli Chen. Crowdsourcing solutions for content curation in large-scale research digital libraries, with an application to a community-based information platform in High-Energy Physics. Funded by CERN. Start date July 2015. (Co-supervised with Stephen Pinfield from the Information School.)

• Marc Bonne. Educational games and their impact on mathematics anxiety in University social science students. Self-funded and part-time. Start date Sept 2015.

• David Walsh. Supporting initial encounters with cultural heritage collections. Self-funded. Start date Apr 2015.

• Faisal Alvi. Techniques from paraphrasing to automatically detect plagiarism. Self-funded. Start date Sept 2013. (Co-supervised with Mark Stevenson from Computer Science.)

• Paula Goodale. Constructing Personal Narratives in Cultural Heritage Spaces Online. Part-time staff candidate. Start date Apr 2011.

• Monica Lestari Paramita. Methods to Build Comparable Corpora. Part-time staff candidate. Start date Sept 2010.

• Sophie Rutter. Setting tasks and assessing children’s real-life use of search engines in primary school. University Scholarship. Start date Oct 2013.

PREVIOUS PHD SUPERVISORY EXPERIENCE

I have previously supervised (as primary and secondary supervisor) 9 PhD students, 7 of which completed successfully within 4 years (1 withdrawal and 1 did not submit revisions for award of MPhil):

• Munirah Abdulhadi. Towards enriching metadata descriptions with tags in a bilingual academic library context. Embassy of the State of Kuwait. Start date Feb 2011. Awarded 2016.

• Simon Wakeling. User-Centred Design of a Recommender System for a 'Universal’ Library Catalogue. AHRC CDA funded. Start date Oct 2010. Awarded 2014.

• Murad Abouammoh. Investigation into Diversity in Information Retrieval. Royal Embassy of Saudi Arabia. Start date Feb 2008. Did not submit required corrections for award of MPhil. No award given.

• Basheer Al Farwan. Automatically constructing gazetteers by mining the web (currently taking Leave of Absence). Self-funded. Start date Apr 2011. Withdrawn due to personal reasons in 2014.

• Rita Wan-Chik. Answers from the Quran: Online information seeking needs. Majlis Amanah Takyat (MARA). Start date Jan 2009. Awarded 2012.

• Antje Bothin. Analysing Meeting notes and their role in automatic meeting summarization. Self-funded. Awarded 2010.

• Azzah Al-Maskari. Beyond classical measures: how to evaluate the effectiveness of interactive information retrieval systems? Sultanate of Oman. Awarded 2009.

• Rob Pasley. Finding and defining vernacular geography using knowledge from unstructured data sources. EPSRC CASE Studentship. Awarded 2011.


• Muhammed Adeel Rao. Natural Language Processing for plagiarism detection. Self-funded. Awarded 2013. (Co-supervised with Mark Stevenson from Computer Science.)

• Shahram Sedghi. Relevance criteria used by health professionals in selecting medical images for educational purposes. Self-funded. Awarded 2009.

• Johannes Schanda. Novelty detection in remote databases. Self-funded. Awarded 2011.

I regularly supervise 7-8 Master’s dissertation projects per year and four of my dissertation projects have been part of the Ordnance Survey MSc Dissertation Programme. 3 of these students have won sponsorship prizes for their work: Stephen Aladiran in 2006, Alan Easingwood in 2008 and Paul Hurst in 2010. I was awarded £1,000 from Ordnance Survey for supervising Paul Hurst, which also resulted in a journal publication (Hurst & Clough, 2013).

I also successfully ran a Darwin project with Dr. Mark Stevenson in Computer Science on creating a corpus of simulated plagiarism examples which resulted in a journal paper submission to Language Resources and Evaluation (Clough & Stevenson, 2010).

5.3 PUBLICATIONS Summary: h-index of 28 (estimated 3,194 citations with 9.80 cites/paper). Most cited two papers are “The CLEF 2005 Cross–Language Image Retrieval Track” (cited 112 times) and “Plagiarism in natural and programming languages: an overview of current tools and techniques” (cited 142 times).

P = primary author; J = joint author; S = involves student as co-author.

5.4.1 CHAPTERS - IN PRESS

5.4.2 BOOKS - IN PRINT

J Peters, C., Braschler, M. and Clough, P. (2012) Multilingual Information Retrieval: From Research to Practice, Springer: Heidelberg, Germany ISBN 978-3-642-23007-3, 217 pages.

P J Clough, P., Foley, C., Gurrin, C., Jones, G.J.F., Kraaij, W., Lee, H., and Murdoch, V. (2011) Advances in Information Retrieval - 33rd European Conference on IR Research, ECIR 2011, Dublin, Ireland, April 18-21, 2011. Proceedings Springer: Heidelberg, Germany, LNCS 6611.

J Müller, H., Clough, P., Deselaers, T. and Caputo, B. (2010) ImageCLEF - Experimental Evaluation of Visual Information Retrieval, Springer: Heidelberg, Germany (Publication date: September 2010). 495 pages.

5.4.3 CHAPTERS - IN PRINT

J Russell-Rose, T. and Clough, P. (2016) Mining Search Logs for Usage Patterns, In: Hofmann, M. and Chisholm, A. (eds) Text Mining, Web Mining, and Visualization Use Cases Using Open Source Tools, Chapman and Hall, pp. 153-172.

P J Clough, P., Goodale, P., Hall, M., and Stevenson, M. (2015) Supporting Exploration and Use of Digital

Cultural Heritage Materials: the PATHS Perspective, In Ruthven, I. and Chowdhury, G.G. (eds) Cultural Heritage Information Access and Management, Facet, pp. 197-220.

J Paramita, M. L., Guthrie, D., Kanoulas, E., Gaizauskas, R., Clough, P. and Sanderson, M. (2013) Methods for Collection and Evaluation of Comparable Documents, In: Sharoff, S., Rapp, R., Zweigenbaum, P. and Fung, P (eds) BUCC: Building and Using Comparable Corpora, 93-112.

P Clough, P. (2012) User-related issues in multilingual access to multimedia collections, In Dobreva, Dwyer and Feliciati (eds) User Studies for Digital Library Development, Facet Publishing, 117-126.

P J Clough, P., Müller, H. and Sanderson, M. Seven Years of Image Retrieval Evaluation (2010) In Müller, H., Clough, P., Deselaers, T. and Caputo, B. (eds) ImageCLEF - Experimental Evaluation of Visual Information Retrieval, Springer, Heidelberg, Germany (Publication date: September 2010).


J Grubinger, M., Nowak, S. and Clough, P. Data sets Created in ImageCLEF (2010) In Müller, H., Clough, P., Deselaers, T. and Caputo, B. (eds) ImageCLEF - Experimental Evaluation of Visual Information Retrieval, Springer, Heidelberg, Germany (Publication date: September 2010).

P Clough, P. Measuring Text Re-Use in the News Industry (2010) In Lionel Bently, Jennifer Davis, and Jane C. Ginsburg (eds) Copyright and Piracy: An Interdisciplinary Critique, Cambridge University Press (Publication date: October 2010).

P J Clough, P. and Gaizauskas, R. (2009) Corpora and Text Re-use, In Anke Lüdeling, Merja Kytö and Tony McEnery (eds) Handbook of Corpus Linguistics. (Series: Handbooks of Linguistics and Communication Science), 1249–1271, Mouton de Gruyter.

5.4.4 REFEREED JOURNALS - IN PRESS J S Hayley, A., and Clough, P. (2017) Affective Experiences of International and Home Students During the

Information Search Process. New Review of Academic Librarianship. http://dx.doi.org/10.1080/13614533.2017.1308387

J S Wakeling, S., Clough, P., Silipigni Connaway, L., Sen, B., and Tomás, D. (2017) Users and Uses of a

Global Union Catalogue: a Mixed-Methods Study of WorldCat.org, Journal of the American Society for Information Science and Technology. https://doi.org/10.1002/asi.23708

J S Nawab, R.M.A., Stevenson, M. and Clough, P. (2016) An IR-based Approach Utilising Query Expansion

for Plagiarism Detection in MEDLINE, IEEE/ACM Transactions on Computational Biology and Bioinformatics. https://doi.org/10.1109/TCBB.2016.2542803

5.4.5 REFEREED JOURNALS - IN PRINT J S Bothin, A. and Clough, P. (2016) Predicting Meeting Participants’ Note-Taking From Previously Uttered

Dialogue Acts, Journal of Systems and Information Technology, Volume 18(2), pp. 170–185. J S Wakeling, S., Clough, P., Wyper, J., Ball, A., and Balmain, A. (2016) Do Users Understand Data

Visualisations used in Standard BI Dashboards?, Business Intelligence Journal, pp. 8-19.

J S Elbedweihy, K., Wrigley, S., Clough, P. and Ciravegna, F. (2015) An Overview of Semantic Search Evaluation Initiatives, Journal of Web Semantics: Science, Services and Agents on the World Wide Web, Volume 30, pp. 82-105.

J Goodale, P., Clough, P., Fernando, S., Ford, N. and Stevenson, M. (2014) Cognitive styles within an

exploratory search system for digital libraries, Journal of Documentation, Volume 70(6), pp. 970-996. J Hall, M., Fernando, S., Clough, P., Soroa, A., Agirre, E. and Stevenson, M. (2014) Evaluating Hierarchical

Organisation Structures for Exploring Digital Libraries, Information Retrieval, Volume 17(4), pp. 351-379. J S Nawab, R.M.A., Stevenson, M. and Clough, P. (2014) Comparing Medline Citations using Modified N-

grams, Journal of the American Medical Informatics Association, 21(1), 105-110. J S Bothin, A. and Clough, P. (2014) A User Evaluation Study: Do Participants' Personal Notes Help Us to

Summarise Meetings? Knowledge and Process Management, Volume 21(2), 122-133. J S Wan-Chik, R., Sanderson, M. and Clough, P. (2013) Investigating Religious Information Searching

through the Analysis of a Search Engine Log, Journal of the American Society for Information Science and Technology, 64(12), 2492-2512,

J S Darby, P. and Clough, P. (2013) Investigating the Information Seeking Behaviour of Genealogists and

Family Historians, Journal of Information Science, 39(1), 75-86. J S Hurst, P. and Clough, P. (2013) Will we be Lost without Paper Maps in the Digital Age?, Journal of

Information Science, 39(1), 50-62. J Aletras, N., Stevenson, M. and Clough, P. (2013) Computing Similarity between Items in a Digital Library

of Cultural Heritage, Journal on Computing and Cultural Heritage, 5(4), Article 16.


P J Clough, P., Sanderson, M., Tang, J., Gollins, T. and Warner, A. (2013) Examining the limits of crowdsourcing for relevance assessment, IEEE Internet Computing, 14(4), 32-38.

J Whittaker, S., Kalnikaite, V., Petrelli, D., Sellen, A., Villar, N., Bergman, O., Clough, P., and Brockmeier,

J. Socio-technical Lifelogging: Deriving design principles for a future proof digital past, Human Computer Interaction, 27(1-2), 37-62.

J S Sedghi, S., Sanderson, M. and Clough, P. (2012) How do health care professionals select medical images

they need?, Aslib Proceedings, 64(4), 437-456. J Petrelli, D. and Clough, P. Analysing User’s Queries for Cross-Language Image Retrieval from Digital

Library Collections, The Electronic Library, 30(2), 197-219. J S Wakeling, S., Clough, P., Sen, B. and Connaway, L. "Reader's who borrowed this also borrowed ...":

Recommender Systems in UK Libraries, Library Hi-Tech, 30(1), 134-150. J S Bothin, A. and Clough, P. (2011) Participants’ personal note-taking in meetings and its value for automatic

meeting summarisation, Information Technology and Management, Published online: 25 December 2011 (DOI: 10.1007/s10799-011-0112-7), 1-19.

J S Sedghi, S., Sanderson, M. and Clough, P. (2011) Medical image resources used by health care

professionals, Aslib Proceedings, 63(6), 570-585. P Clough, P., Hall, M., Warner, A., and Tang, J. (2011) Linking Archival Data to Location: A Case Study at

the UK National Archives, Aslib Proceedings, 63(2/3), 127-147. J Cox, A. M., Clough, P., and Siersdorfer, S. (2011) Developing Metrics to Characterize Flickr Groups,

Journal of the American Society for Information Science and Technology, 62(3), 493-506.

J Hanbury, A., Müller, H., and Clough, P. (2010) Introduction to Special Issue on Image and Video Retrieval Evaluation (Editorial), Computer Vision and Image Understanding, 114 (2010), 409-410.

P Clough, P. and Stevenson, M. (2010) Developing A Corpus of Plagiarised Short Answers, Language Resources and Evaluation, 45(1), 5-24.

P S Clough, P. and Eleta, I. (2010) Investigating Language Skills and Field of Knowledge on Multilingual Information Access in Digital Libraries, International Journal of Digital Library Systems, 1(1), 89-103.

J Whittaker, S., Bergman, O. and Clough, P. (2010) Easy on that Trigger Dad: A Study of Long Term Family Photo Retrieval, Personal and Ubiquitous Computing, 14(1), 31-43.

P Clough, P., Ireson, N. and Marlow, J. (2009) Extending Domain-Specific Resources to Enable Semantic Access to Cultural Heritage Data, Journal of Digital Information, Volume 10(6). Available online: https://journals.tdl.org/jodi/issue/view/89

J S Sedghi, S., Sanderson, M. and Clough, P. (2008) A Study on the Relevance Criteria for Medical Images, Pattern Recognition, 29(15), Nov. 2008, 2046-2057.

J Rorissa, A., Clough, P. and Deselaers, T. (2008), Exploring the relationship between feature and perceptual visual spaces, Journal of the American Society for Information Science and Technology, 59(5), 770-784.

J Jones, C., Purves, R.S., Clough, P., and Joho, H. (2008) Modelling Vague Regions with Knowledge from the Web, International Journal Geographic Information Systems, 22(10), 1045-1065.

J S Cox, A., Clough, P. and Marlow, J. (2008), Flickr: a first look at user behaviour in the context of photography as serious leisure, Information Research, 13(1) paper 336. [Available, 6 January, 2008 at http://InformationR.net/ir/13-1/paper336.html].

J Deselaers, T., Müller, H., Clough, P., Ney, H. and Lehmann, T. (2007), The CLEF 2005 Automatic Medical Image Annotation Task, International Journal of Computer Vision, 74(1), 51-58.

J Purves, R.S., Clough, P., Jones, C.B., Arampatzis, A., Bucher, B., Finch, D., Fu, G., Joho, H., Khirini, A.S., Vaid, S., and Yang, B. (2007), The Design and Implementation of SPIRIT: a Spatially-Aware Search


Engine for Information Retrieval on the Internet, International Journal Geographic Information Systems, 21(7), January 2007, 717-745.

P Clough, P. and Sanderson, M. (2006), User Experiments with the Eurovision Cross-Language Image Retrieval System, Journal of the American Society for Information Science and Technology, 57(5), 697 - 708.

J A. Arampatzis, M. van Kreveld., I. Reinbacher, C.B. Jones, S. Vaid, P.D. Clough, H. Joho, and M. Sanderson (2005), Web-based delineation of imprecise regions, Journal of Computers, Environment and Urban Systems, 30(4), 436-459.

5.4.6 REFEREED CONFERENCE PAPERS 5.4.6.1 FULL PAPERS J Otterbacher, J., Bates, J., and Clough P. (2017), Competent Men and Warm Women: Gender Stereotypes

and Backlash in Image Search Results. In Proceedings of the Conference on Human Factors in Computing Systems CHI’2017, ACM, New York, NY, USA, pp. 6620-6631.

P Clough, P. (2015) Evaluation: Thinking Outside the (Search) Box, In Proceedings of the Forum for

Information Retrieval Evaluation (FIRE '14), Prasenjit Majumder, Mandar Mitra, Madhulika Agrawal, and Parth Mehta (Eds.), ACM, New York, NY, USA, pp. 1-9.

J S Rutter, S., Ford, N. and Clough, P. (2015) How do children reformulate their search queries? In

Proceedings of ISIC, the Information Behaviour Conference, Leeds, 2-5 September, 2014: Part 2, (paper isic31).

J Otegi, A., Agirre, E. and Clough, P. (2014) Personalised PageRank for making recommendations in digital

cultural heritage collections, In Proceedings of the 14th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2014), IEEE Press, Piscataway, NJ, USA, pp. 49-52.

J Russell-Rose, T., Clough, P. and Toms, E. (2014) Categorising Search Sessions: Some Insights from

Human Judgments, In Proceedings of Fifth Information Interaction in Context Symposium (IIiX 2014), pp. 251-254.

J S Wakeling, S., Clough, P., and Sen, B. (2014) Investigating the Potential Impact of Non-Personalized

Recommendations in the OPAC: Amazon vs. WorldCat.org, In Proceedings of Fifth Information Interaction in Context Symposium (IIiX 2014), pp. 96-105.

J Stordy, P. and Clough, P. (2014) Practice makes Perfect: Improving success rates in a Database Design

Module, In Proceedings of TLAD 2014 (Teaching, Learning and Assessment in Databases). J Smith, J., Hall, M.M., Goodale, P., Clough, P. and Stevenson, M. (2014) PATHS in context: User

characteristics and the construction of cultural heritage narratives. In Proceedings of iConference 2014, 5-7 March 2014, Berlin.

J Hall, M., Goodale, P., Clough, P., and Stevenson, M. (2014) The PATHS System for Exploring Digital

Cultural Heritage, In: Clare Mills, Michael Pidd and Esther Ward. In Proceedings of the Digital Humanities Congress 2012. Studies in the Digital Humanities. Sheffield: HRI Online Publication.

J S Schanda, J., Sanderson, M. and Clough, P. (2014) Examining New Event Detection, In Proceedings of the

2014 Australasian Document Computing Symposium (ADCS '14), J. Shane Culpepper, Laurence Park, and Guido Zuccon (Eds.). ACM, New York, NY, USA, Pages 26, 8 pages.

J Barrón-Cedeño, A., Lestari Paramita, M., Clough, P. and Rosso, P. (2014) A Comparison of Approaches

for Measuring Cross-Lingual Similarity of Wikipedia Articles, In Proceedings of the 36th European Conference on Information Retrieval (ECIR 2014), pp. 424-429.

J Hall, M., Goodale, P., Clough, P., and Stevenson, M. (2014) The PATHS System for Exploring Digital

Cultural Heritage, In: Clare Mills, Michael Pidd and Esther Ward. Proceedings of the Digital Humanities Congress 2012. Studies in the Digital Humanities. Sheffield: HRI Online Publications, 2014.


J Goodale, P., Clough, P., Hall, M., Stevenson, M, Fernie, K., Griffiths, J., and Agirre, E. (2013) Pathways to Discovery: Supporting Exploration and Information Use in Cultural Heritage Collections. In Proceedings of Museums and the Web Asia 2013, Hong Kong, 9-12 December, 2013.

P J Clough, P. and Goodale, P. (2013) Selecting Success Criteria: Experiences with an Academic Library

Catalogue, In Proceedings of 4th Conference on Evaluation of Information Access Systems (CLEF 2013), pp. 59-70.

J Hall, M. and Clough, P. (2013) Exploring Large Digital Library Collections using a Map-based

Visualisation, In Proceedings of The International Conference on Theory and Practice of Digital Libraries (TPDL 2013), pp. 216-227.

J Fernie, K., Griffiths, J., Stevenson, M., Clough, P., Goodale, P., Hall, M., Archer, P., Chandrinos, K.,

Agirre, E., de Lacalle, O., de Polo, A., Bergheim, R. (2012) PATHS: Personalising access to cultural heritage spaces, In Proceedings of 18th International Conference on Virtual Systems and Multimedia (VSMM 2012), pp.469-474.

J Fernando, S., Hall, M., Agirre E., Soroa, A., Clough, P. and Stevenson, M. (2012) Comparing taxonomies

for organising collections of documents, In Proceedings of The 24th International Conference on Computational Linguistics (COLING 2012), pp. 879-894.

J Hall, M., Clough, P. and Stevenson, M. (2012) Evaluating the use of Clustering for Automatically

Organising Digital Library Collections, In Proceedings of The International Conference on Theory and Practice of Digital Libraries (TPDL 2012), pp. 323-334.

JS Paramita, M., Clough, P., Aker, A. and Gaizauskas, R. (2012) Correlation between Similarity Measures for

Inter-Language Linked Wikipedia Articles, In Proceedings of the Eighth international conference on Language Resources and Evaluation (LREC 2012), pp. 790-797.

JS Nawab, R.M.A., Stevenson, M. and Clough, P. Retrieving Candidate Plagiarised Documents using Query

Expansion (2012), In Proceedings of European Conference on Information Retrieval (ECIR 2012), pp. 207-218.

J S Wan-Chik, R., Clough, P., and Ford, N. (2011) Searching for Islamic and Qur’anic Information on the Web:

A Mixed-Methods Approach, In Proceedings of the 7th Asian Information Retrieval Societies Conference (AIRS 2011), 181-192.

J Kanoulas, E., Carterette, B., Clough, P., and Sanderson, M. (2011) Evaluating Multi-Query Sessions, In

Proceedings of the 34th Annual ACM SIGIR Conference, (SIGIR '11). ACM, New York, NY, USA, pp. 1053-1062.

J Sanderson, M., Paramita, M., Clough, P. and Kanoulas, E. (2010) Do user preferences and evaluation

measures line up?, In Proceedings of the 33rd Annual ACM SIGIR Conference, Geneva, Switzerland, pp. 555-562.

J S Bothin, A. and Clough, P. (2010) Quantitative Analysis of Individual Differences in Note-Taking and

Talking Behaviour in Meetings, In Proceedings of IADIS Multi Conference on Computer Science and Information Systems 2010, Freiberg, Germany, 26-31 July. Available on CD-ROM.

P Clough, P. and Stevenson, M. (2009) Creating A Corpus of Plagiarised Academic Texts, In Proceedings of

Corpus Linguistics Conference 2009, Liverpool, UK , Article 131, Available Online: http://ucrel.lancs.ac.uk/publications/cl2009/

P Clough, P. and Sen, B. (2008) Evaluating Tagclouds for Health-Related Information Research, In Proceedings of the 13th International Symposium on Health Information Management Research (ISHIMR), Auckland, New Zealand, October 20-22 2008. [Nominated for Best Paper]

J S Pasley, R., Clough, P., Purves, R. and Twaroch, F. (2008) Mapping Geographic Coverage of the Web, In Proceedings of 16th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM GIS 2008), pp. 154-162.


J S Al-Maskari, A., Sanderson, M. and Clough, P. (2008), The Good and the Bad System: Does the Test Collection Predict Users’ Effectiveness?, In Proceedings of the 31st Annual International ACM SIGIR Conference (SIGIR2008), 20-24 July 2008, Singapore, pp. 59-66.

J Marlow, J., Clough, P., Ireson, N., Cigarrán Recuero, J., Artiles, J. and Debole, F. (2008), The MultiMatch Project: Multilingual/Multimedia Access to Cultural Heritage on the Web, In Museums on the Web Conference (MW2008): Proceedings, J. Trant and D. Bearman (eds). Toronto: Archives & Museum Informatics. 2008. Available online: http://www.archimuse.com/mw2008/abstracts/prg_335001834.html

J Marlow, J., Clough, P., Cigarrán Recuero, J. and Artiles, J. (2008), Exploring the Effects of Language Skills on Multilingual Web Search, In Proceedings of the 30th European Conference on IR Research (ECIR'08), Glasgow, UK, April 2008, LNCS4956, pp. 126-137.

J S Al-Maskari, A., Sanderson, M. and Clough, P. (2007), Arabic Users' Satisfaction with the Online Information as Obtained from Google , In Proceedings of Sixth International Conference on Conceptions of Library and Information Science (CoLIS), Borås, Sweden, August 13-16.

J S Marlow, J., Clough, P., and Dance, K. (2007), Multilingual needs of cultural heritage website visitors: A case study of Tate Online, In International Cultural Heritage Informatics Meeting (ICHIM07): Proceedings, J. Trant and D. Bearman (eds). Toronto: Archives & Museum Informatics. 2007. Published September 30, 2007 at http://www.archimuse.com/ichim07/papers/marlow/marlow.html.

J Müller, H., Clough, P., Hersh, W., Deselaers, T., Lehmann, T., and Geissbuhler, A. (2006), Using heterogeneous annotation and visual information for the benchmarking of image retrieval systems, SPIE conference Photonics West, Electronic Imaging, special session on benchmarking image retrieval systems, San Diego, February 2006. Vol. 6061. Available online: http://spie.org/x648.html?product_id=660259.

J Müller, H., Clough, P., Hersh, W., Deselaers, T., Lehmann, T. and Geissbuhler, A. (2005), Axes for the evaluation of medical image retrieval systems - the Image CLEF experience, In Proceedings of ACM Multimedia 2005 (Brave New Topics track), 6-12 November, Singapore, pp. 1014-1022.

J Bucher, B., Clough, P., Joho, H., Purves, R., and Syed, A. K. (2005), Geographic IR Systems: Requirements and Evaluation. In Proceedings of the 22nd International Cartographic Conference, A Coruña, Spain, CD-ROM.

J Purves, R., Clough, P. and Joho, H. (2005), Identifying imprecise regions for geographic information retrieval using the web, In Proceedings of GIS RESEARCH UK 13th Annual Conference, Glasgow, UK, pp. 313-318.

J Stevenson, M. and Clough, P. (2004), EuroWordNet as a Resource for Cross-Language Information Retrieval, In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC-04), May 2004.

P Clough, P. and Stevenson, M. (2004), Cross-Language Information Retrieval using EuroWordnet and Word Sense Disambiguation, In Advances in Information Retrieval, McDonald and Tait (Eds), Proceedings of the 26th European Conference on IR Research (ECIR'04), Sunderland, UK, April 2004, Springer-Verlag LNCS 2997, pp.327-337.

J Sanderson, M., Clough, P.D., Paterson C. and Tung Lo, W. (2004), Measuring a Cross Language Image Retrieval System, In Advances in Information Retrieval, McDonald and Tait (Eds), Proceedings of the 26th European Conference on IR Research (ECIR'04), Sunderland, UK, April 2004, Springer-Verlag LNCS 2997, pp.353-363.

P Clough, P. and Sanderson, M.(2004), The Effects of Relevance Feedback in Cross Language Image Retrieval, In Advances in Information Retrieval, McDonald and Tait (Eds), Proceedings of the 26th European Conference on IR Research (ECIR'04), Sunderland, UK, April 2004, Springer-Verlag LNCS 2997, pp.238-252.

P Clough, P. and Stevenson, M. (2004), Evaluating the Contribution of EuroWordNet and Word Sense Disambiguation to Cross-language Retrieval, In Proceedings of the Second International Global WordNet Conference (GWC-2004), Brno, Czech Republic. pp. 97-107, January 2004.


J Gaizauskas, R., Burnard, L., Clough, P. and Piao, S.L. (2003), Using the XARA XML-Aware Corpus Query Tool to investigate the METER Corpus. In Proceedings of Corpus Linguistics 2003, Lancaster, UK.

P Clough, P., Gaizauskas, R. and Piao, S. L. (2002), Building and annotating a corpus for the study of journalistic text reuse. In Proceedings of the 3rd International Conference on Language Resources and Evaluation (LREC-02), pp.1678-1691 (Vol V), 29-31st May 2002, Los Palmas de Gran Canaria, Spain.

P Clough, P.D., Gaizauskas, Piao, S.L. and Wilks, Y. (2002), Measuring Text Reuse, In Proceedings of Association for Computational Linguistics (ACL2002), Philadelphia, PA, USA, pp.152-159.

J Gaizauskas, R., Foster, J., Wilks, Y., Arundel, J., Clough, P. and Piao, S.L. (2001), The METER corpus: a corpus for analysing journalistic text reuse, In Proceedings of Corpus Linguistics 2001, Lancaster, UK, pp.214-223.

5.4.6.2 SHORT PAPERS, DEMOS AND POSTERS J S Paramita, M.L., Clough, P., and Gaizauskas, R.J. (2017) Using Section Headings to Compute Cross-

Lingual Similarity of Wikipedia Articles. In Proceedings of 39th European Conference on IR Research ECIR’17, pp. 633-639.

J S Alvi, F., Stevenson, M. and Clough, P. (2017) Plagiarism Detection in Texts Obfuscated with

Homoglyphs. In Proceedings of 39th European Conference on IR Research ECIR’17, pp. 669-675.

J Carterette, B., Clough, P., Hall, M., Kanoulas, E., and Sanderson, M. (2016) Evaluating Retrieval over

Sessions: The TREC Session Track 2011-2014, In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’16). ACM, New York, NY, USA, pp 685-688.

J S Grech, D., and Clough, P. (2016) Investigating Cluster Stability when Analyzing Transaction Logs, In

Proceedings of the 16th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL’16), ACM, New York, NY, USA, pp. 115-118.

J S Wakeling S. and Clough, P. (2016) Determining the Optimal Session Interval for Transaction Log Analysis

of an Online Library Catalogue, In Proceedings of the 38th European Conference on IR Research (ECIR’16), pp. 703-708.

J S Wakeling S. and Clough, P. (2015) Integrating Mixed-Methods for Evaluating Information Access Systems,

In Proceedings of CLEF 2015, pp. 313-318. [Awarded Best Short Paper] P J Clough, P., Willett, P. and Lim, J. (2015) Unfair Means: Use Cases beyond Plagiarism, In Proceedings of

CLEF 2015, pp. 201-206. J Hall, M., Clough, P., Fernando, S., Goodale, P., Stevenson, M., Agirre, E., Otegi, A., Soroa, A., Fernie, K.,

and Griffiths, J.(2013) Information Seeking in Digital Cultural Heritage with PATHS, In Proceedings of the 36th Annual conference on Research and development in Information (SIGIR'13). ACM, New York, NY, USA, pp. 1105-1106.

J Agirre, E., Aletras, N., Clough, P., Fernando, S., Goodale, P., Hall, M., Soroa, A., and Stevenson, M.,

(2013) PATHS: A System for Accessing Cultural Heritage Collections, In Proceedings of 51st Annual Meeting of the Association for Computational Linguistics (ACL'13), Sofia, Bulgaria, August 4-9 2013, pp. 151-156.

JS Jesper, S., Clough, P. and Hall, M. (2013) Regional Effects on Query Reformulation Patterns, In

Proceedings of The International Conference on Theory and Practice of Digital Libraries (TPDL 2013), pp. 382-385. [Awarded Best Poster]

JS Nawab, R.M.A., Stevenson, M. and Clough, P. (2012) Detecting Text Reuse with Modified and Weighted

N-grams, In Proceedings of First Joint Conference on Lexical and Computational Semantics (STARSEM 2012), pp. 54-58.

J S Bothin, A. and Clough, P. (2010) Quantitative Analysis of Individual Differences in Note-Taking and Talking Behaviour in Meetings, In Proceedings of IADIS Multi Conference on Computer Science and Information Systems 2010, Freiberg, Germany, 26-31 July. Available on CD-ROM.


P S Clough, P., Sanderson, M., Abouammoh, M., Navarro, S. and Paramita, M. (2009) Multiple approaches to

Analysing Query Diversity, In Proceedings of the 32nd Annual ACM SIGIR Conference, Boston, Massachusetts, pp. 734-735.

J Sanderson, M., Tang, J., Arni, T. and Clough, P. (2009) What else is there? Search Diversity Examined, In Proceedings of the European Conference on Information Retrieval (ECIR'09), Toulouse, France, pp. 562-569.

J S Al-Maskari, A., Sanderson, M. and Clough, P. (2008), Relevance Judgments between TREC and Non-TREC Assessors, In Proceedings of the 31st Annual International ACM SIGIR Conference (SIGIR2008), 20-24 July 2008, Singapore, pp. 683-684.

J Carmichael, J., Larson, M., Marlow, J., Newman, E., Clough, P., Oomen, O., and Sav, S. (2008), Multimodal Indexing of Digital Audio-visual Documents: A Case Study for Cultural Heritage Data, In Proceedings of the Sixth International Workshop on Content-Based Multimedia Indexing (CBMI2008), London, UK, 18-20th June, pp. 93-100.

P S Clough, P. and Read, S. (2008), Key Design Issues with Visualising Images using Google Earth, In Proceedings of the 30th European Conference on IR Research (ECIR'08), Glasgow, UK, April 2008, LNCS4956, pp. 570-574.

J S Al-Maskari, A., Sanderson, M., and Clough, P.D. (2007), The Relationship between IR Effectiveness Measures and Users’ Satisfaction, In Proceedings of the ACM SIGIR2007 Conference, Amsterdam, Netherlands, pp. 773-774.

J Purves, R. and Clough, P. (2006), Judging spatial relevance and document location for Geographic Information Retrieval, extended abstract, In Proceedings of 4th International Conference on Geographic Information Science (GIScience 2006), Münster, Germany, September 2006, pp. 159-164.

P Clough, P., Sanderson, M. and Müller, H. (2004), A proposal for the CLEF Cross Language Image Retrieval Task 2004, In Proceedings of the 2004 CIVR conference, Dublin, Ireland, 2004, Springer-Verlag LNCS 3115, pp. 243-251.

J Sanderson, M. and Clough, P. (2004), Measuring Pseudo Relevance Feedback and CLIR, In Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'04), pp. 484-485.

J Levin, S., Clough, P.D., and Sanderson, M. (2003), Assessing the effectiveness of pen-based input queries. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

5.4.7 ARTICLES IN PROFESSIONAL PUBLICATIONS P Clough, P. (2015) Supporting Exploration and Use of Digital Cultural Heritage Materials, EuropeanaTech

Insight, Issue 4.

J Cappellato, L., Clough, P., Ferro, N., Hall, M., Halvey, M., Hanbury, A., Kanoulas, E., Kraaij, W., Lupu, M., Sanderson, M., Toms, E. and Robert Villa (2014) CLEF 2014: Information Access Evaluation meets Multilinguality, Multimodality, and Interaction, SIGIR Forum, Volume 48(2), pp. 56-62.

J Lawless, S., Conlan, O., Agosti, M., and Clough, O. (2013) ENRICH 2013: The First Workshop on the

Exploration, Navigation and Retrieval of Information in Cultural Heritage, SIGIR Forum, Volume 47(2), pp. 68-73.

J P Clough, P. and Sanderson, M. (2013) Evaluating the performance of information retrieval systems using

test collections, Information Research, Vol. 18(2), paper 582. J P Clough, P., Ferro, N., Forner, P., Gonzalo, J., Huurnink, B., Kekäläinen, J., Lalmas, M., Petras, V. and de

Rijke, M. (2011) CLEF 2011 Conference on Multilingual and Multimodal Information Access Evaluation, ACM SIGIR Forum, Volume 45(2), pp. 32-37.


J Purves, R., Clough, P. and Jones, C. (2010) Highlights from GIR'10, ACM SIGSPATIAL Special, Vol. 2 (1), March 2010, pp. 17-23.

P Clough, P. and Berendt, B. (2009) Report on the TrebleCLEF Query Log Analysis Workshop 2009, ACM SIGIR Forum, pp. 71-77.

P Clough, P. (2007), Large-scale evaluation of cross-language image retrieval systems, ASIST Bulletin, Feb-Mar 2007.

J Grubinger, M., Clough, P., and Leung, C. (2006), IAPR TC-12 Benchmark for visual information search, International Association for Pattern Recognition Newsletter, Vol. 28(2), pp. 10-12.

J Müller, H. and Clough, P. (2006), The ImageCLEF Benchmark on Multimodal, Multilingual Visual Images, International Association for Pattern Recognition Newsletter, Vol. 28(2), pp. 13-17.

J Karlgren, Jussi and Clough, Paul and Gonzalo, Julio (2006), Multilingual Interactive Experiments with Flickr, ERCIM News, 66, July 2006.

P Clough, P., Sanderson, M., and Reid, N. (2006), The Eurovision St Andrews Collection of Photographs, ACM SIGIR Forum, 40(1) (June 2006), pp. 21-30.

P Clough, P. (2003), Old and new challenges in automatic plagiarism detection, National UK Plagiarism Advisory Service (Online).

5.4.8 REFEREED WORKSHOP PAPERS J P Clough, P., Goodale, P., Agosti, M., and Lawless, S. (2016) ACHS’16: First International Workshop on

Accessing Cultural Heritage at Scale, In Proceedings of JCDL 2016, pp. 289-290. J S Walsh, D., Clough, P., and Foster, J. (2016) User Categories for Digital Cultural Heritage, In Proceedings

of the First International Workshop on Accessing Cultural Heritage at Scale (ACHS’16). Available online: http://ceur-ws.org/Vol-1611/paper6.pdf

J S Webster, P., Clough, P., Demartini, G., Storrar, T., Ranade, S., Seaman, G. (2016) Exploring Entity-Centric

Methods in the UK Government Web Archive, In Proceedings of the First International Workshop on Accessing Cultural Heritage at Scale (ACHS’16). Available online: http://ceur-ws.org/Vol-1611/paper5.pdf

J Halvey, M., Villa, R. and Clough, P. (2014) SIGIR 2014 workshop on gathering efficient assessments of

relevance (GEAR), In Proceedings of the 37th international ACM SIGIR conference on Research and development in information retrieval (SIGIR 2014), ACM, New York, NY, USA, pp. 1293-1293.

J Goodale, P., Clough, P., Hall, M., and Stevenson, M. (2014) Supporting Information Access and Sensemaking in Digital Cultural Heritage Environments, In Proceedings of 2nd Workshop on Supporting User's Exploration of Digital Libraries (SUEDL 2013), pp. 143-154.

J P Clough, P., Otegi, A., Agirre, E., and Hall, M. (2013) Implementing Recommendations in the PATHS

System, In Proceedings of 2nd Workshop on Supporting User's Exploration of Digital Libraries (SUEDL 2013), pp. 169-173.

J Gupta, P., Clough, P., Rosso, P., Stevenson, M. and Banchs, R.E. (2013) PAN@FIRE: Overview of the

Cross-Language !ndian News Story Search (CL!NSS) Track, In Proceedings of the 5th 2013 Forum on Information Retrieval Evaluation (FIRE 2013), Prasenjit Majumder, Mandar Mitra, Madhulika Agrawal, and Parth Mehta (Eds.). ACM, New York, NY, USA, Article 6.

J Fernando, S., Goodale, P., Clough, Hall, M., Stevenson, M., and Agirre, E. (2013) Generating Paths

through Cultural Heritage Collections, In Proceedings of the 7th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities (LaTeCH 2013), pp. 1-10.

J S Goodale, P., Clough, P., Ford, N., Hall, M., Stevenson, M., Fernando, S., Aletras, N., Fernie, K., Archer, P., de Polo, A. (2012) User-Centred Design to Support Exploration and Path Creation in Cultural Heritage Collections, In Proceedings of the 2nd European Workshop on Human Computer Interaction and Information Retrieval (EuroHCIR 2012), pp. 75-78.


J Hall, M., Clough, P., Lopez de Lacalle, O., Soroa, A. and Agirre, E. (2012) Enabling the Discovery of Digital Cultural Heritage Objects through Wikipedia, In Proceedings of the 6th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities (LaTeCH 2012), April 24 2012, April 24 2012, Avignon, France.

J Barron-Cedeno, A., Rosso, P., Lalitha Devi, S., Clough, P., and Stevenson, M. (2011) PAN@FIRE:

Overview of the Cross-Language !ndian Text Re-Use Detection Competition , In Proceedings of Forum for Information Retrieval Evaluation (FIRE 2011), LNCS 7536, pp. 59-70.

J Petras, V., Forner, P., Clough, P. (2011) CLEF 2011 Labs and Workshop, Notebook Papers, 19-22

September 2011, Amsterdam, The Netherlands, ISBN 978-88-904810-1-7.

P Clough, P., Stevenson, M. and Ford, N. (2011) Personalizing Access to Cultural Heritage Collections using Pathways, In Proceedings of 3rd Workshop on Personalised Access to Cultural Heritage (PATCH 2011). In conjunction with IUI2011 Conference, Stanford University 13 Feb 2011, pp. 12-19.

P Clough, P., Gonzalo, J. and Karlgren, J. (2010) Creating Re-useable Log Files for Interactive CLIR, In

SIGIR 2010 Workshop on the Simulation of Interaction (SimInt), Geneva 23 July 2010.

J Kanoulas, E., Clough, P., Carterette, B. and Sanderson, M. (2010) Session Track at TREC2010, In SIGIR 2010 Workshop on the Simulation of Interaction (SimInt), Geneva 23 July 2010.

P S Clough, P. and Pasley, R. (2010) Images and Perceptions of Neighbourhood Extents, In Proceedings of 6th Workshop on Geographic Information Retrieval (GIR'10), Zurich 18-19 February 2010.

J Warner, A. and Clough, P. (2009) A Proposal for Space Exploration at The National Archives, In Proceedings of Workshop: The Cultural Heritage of Historic European Cities and Public Participatory GIS, York (UK), September 2009.

J Lestari Paramita, M., Sanderson, M. and Clough, P. (2009) Diversity in Photo Retrieval: Overview of the ImageCLEFPhoto Task 2009, In Borri, F., Nardi, A., and Peters, C., editors, Working Notes for the CLEF 2009 Workshop.

J Gonzalo, J., Peinado, V., Clough, P. and Karlgren, J. (2009) Overview of iCLEF 2009: Exploring Search Behaviour in a Multilingual Folksonomy Environment, In Borri, F., Nardi, A., and Peters, C., editors, Working Notes for the CLEF 2009 Workshop.

J Lestari Paramita, M., Sanderson, M. and Clough, P. (2009) Developing a Test Collection to Support Diversity Analysis, In Proceedings of Redundancy, Diversity, and Interdependence Document Relevance workshop held at ACM SIGIR, pp. 39-45.

J S Easingwood, A. and Clough, P. (2009) An Evaluation of Publicly Accessible Geographic Information Websites, In Proceedings of the ECIR 2009 Workshop Geographic Information on the Internet, Toulouse, France, April 6, 2009, pp. 61-66.

J T. Arni, P. Clough, M. Sanderson, M. Grubinger (2009), Overview of the ImageCLEFphoto 2008 Photographic Retrieval Task, In Proceedings of 9th Workshop of the Cross-Language Evaluation Forum (CLEF'08), September 17-19 2008, LNCS 5706, pp. 500-511.

J Gonzalo, J., Clough, P. and Karlgren, J. (2009), Overview of iCLEF2008: Search Log Analysis for Multilingual Image Retrieval, In Proceedings of 9th Workshop of the Cross-Language Evaluation Forum (CLEF'08), September 17-19 2008, LNCS 5706, pp. 227-235.

J Tang, J., Arni, T., Sanderson, M. and Clough, P. (2009), Building a Diversity Featured Search System by Fusing Existing Tools, In Proceedings of 9th Workshop of the Cross-Language Evaluation Forum (CLEF'08), September 17-19 2008, LNCS 5706, pp. 560-567.

P Clough, P., Marlow, J. and Ireson, N. (2008), Enabling Semantic Access to Cultural Heritage: A Case Study of Tate Online, Larson, M., K. Fernie, J. Oomen and J. Cigarran (eds.) Proceedings of the ECDL 2008 Workshop on Information Access to Cultural Heritage, Aarhus, Denmark, September 18, 2008. ISBN 978-90-813489-1-1 [Online]


J Arni, T., Tang, J., Sanderson, M. and Clough, P. (2008), Creating a test collection to evaluate diversity in image retrieval, In Proceedings of the Workshop on Beyond Binary Relevance: Preferences, Diversity, and Set-Level Judgments, held at SIGIR2008.

P Clough, P., Gonzalo, J., Karlgren, J., Barker, E., Artiles, J. and Peinado, V. (2008), Large-Scale Interactive Evaluation of Multilingual Information Access Systems - the iCLEF Flickr Challenge , In Proceedings of Workshop on novel methodologies for evaluation in information retrieval, 30th European Conference on Information Retrieval, Glasgow, 30th March-3rd April, pp. 33-38.

J Grubinger, M., Clough, P., Hanbury, A., Mueller, H. (2008), Overview of the ImageCLEFphoto 2007 Photographic Retrieval Task, In Proceedings of 8th Workshop of the Cross-Language Evaluation Forum (CLEF'07), Budapest, September 2007, LNCS 5152, pp.433-444.

J Siersdorfer, S., Sizov, S. and Clough, P. (2007) Know the Right People? Recommender Systems for Web 2.0, Proceedings of Workshop on Knowledge and Experience Management, FGWM'07, pp. 330-337.

P S Clough, P., Pasley, R., Siersdorfer, S., San Pedro J. and Sanderson, M. (2007), Visualising the South Yorkshire Floods of '07, Proceedings of Workshop on Geographic Information Retrieval GIR'07.

J S Pasley, R., Clough, P. and Sanderson, M. (2007), Geo-Tagging for Imprecise Regions of Different Sizes, Proceedings of Workshop on Geographic Information Retrieval GIR'07.

J Minelli, S. H., Marlow, J., Clough, P., Cigarran Recuero, J.M., Gonzalo, J., Oomen, J. and Loschiavo, D. (2007), Gathering requirements for multilingual search of audiovisual material in cultural heritage, In Proceedings of Workshop on User Centricity - state of the art (16th IST Mobile and Wireless Communications Summit), Budapest, Hungary, 1-5 July, 2007.

P Clough, P., Grubinger, M., Deselaers, T., Hanbury, A. and Müller, H. (2007), Overview of the ImageCLEF 2006 Photographic Retrieval and Object Annotation Tasks, Evaluation of Multilingual and Multi-modal Information Retrieval: 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers, Peters, C., Clough, P., Gey, F.C., Karlgren, J., Magnini, B., Oard, D.W., de Rijke, M., Stempfhuber, M. (Eds.), LNCS Vol. 4730, 2007, ISBN 978-3-540-74998-1, Softcover, pp. 579-594.

J Müller, H., Deselaers, T., Grubinger, M., Clough, P., Hanbury, A. and Hersh, W. (2007) Problems with Running a Successful Multimedia Retrieval Benchmark, In Proceedings of the third MUSCLE / ImageCLEF workshop on image and video retrieval evaluation, Budapest, Hungary, 19-21 September 2007, [online].

J Grubinger, M. and Clough, P. (2007) On the Creation of Query Topics for ImageCLEFphoto, In Proceedings of the third MUSCLE / ImageCLEF workshop on image and video retrieval evaluation, Budapest, Hungary, 19-21 September 2007, [online].

P S Clough, P., Al-Maskari, A. and Darwish, K. (2007), Providing Multilingual Access to Flickr for Arabic Users, Evaluation of Multilingual and Multi-modal Information Retrieval: 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers, Peters, C., Clough, P., Gey, F.C., Karlgren, J., Magnini, B., Oard, D.W., de Rijke, M., Stempfhuber, M. (Eds.), LNCS Vol. 4730, 2007, ISBN 978-3-540-74998-1, Softcover, pp. 205-216.

J Gonzalo, J., Karlgren, J. and Clough, P. (2007), iCLEF2006 Overview: Searching the Flickr WWW Photo-Sharing Repository, Evaluation of Multilingual and Multi-modal Information Retrieval: 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers, Peters, C., Clough, P., Gey, F.C., Karlgren, J., Magnini, B., Oard, D.W., de Rijke, M., Stempfhuber, M. (Eds.), LNCS Vol. 4730, 2007, ISBN 978-3-540-74998-1, Softcover, pp.

J S Al-Maskari, A., Clough, P., and Sanderson, M. (2006), Users' Effectiveness and Satisfaction for Image Retrieval, Workshop Information Retrieval 2006, University of Hildesheim, Germany, 9.-11. October 2006. pp. 83-87.

P S Clough, P., Marlow, J. and Sanderson, M. (2006), Designing Multilingual Information Access to Tate Online, Workshop held at the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Workshop: New Directions in Multilingual Access, Seattle, August 2006.


P Clough, P., and Müller, H. (2006) Building and Evaluating Systems for Cross-Language Image Retrieval,

DELOS Network of Excellence on Digital Libraries Demo Day, Bibliothèque Nationale de France, Francois-Mitterand site Paris, France, 1st Feb.

J Grubinger, M., Clough, P., Müller, H. and Deselaers, T. (2006), The IAPR TC-12 Benchmark: A New Evaluation Resource for Visual Information Systems, In Proceedings of International Workshop OntoImage’2006 Language Resources for Content-Based Image Retrieval, held in conjuction with LREC'06, Genoa, Italy, pp. 13-23.

P Clough, P., and Petrelli, D. (2006) Using Concept Hierarchies in Text-Based Image Retrieval: A User Evaluation, In Accessing Multilingual Information Repositories, Eds (Paul Clough, Julio Gonzalo, Thomas Mandl, Thomas Deselaers, Henning Müller, Horacio Rodríguez, Sven Hartrumpf, Felisa Verdejo, Alicia Ageno, Víctor Peinado), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 4022/2006, Softcover, pp. 297-306.

J Gey, F., Larson, R., Sanderson, M., Joho, H., Clough, P., and Petras, V. (2006) GeoCLEF: The CLEF 2005 Cross-Language Geographic Information Retrieval Track Overview, In Accessing Multilingual Information Repositories, Eds (Paul Clough, Julio Gonzalo, Thomas Mandl, Thomas Deselaers, Henning Müller, Horacio Rodríguez, Sven Hartrumpf, Felisa Verdejo, Alicia Ageno, Víctor Peinado), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 4022/2006, Softcover, pp. 908-919.

J Grubinger, M., Leung, C., and Clough, P. (2006) Linguistic Estimation of Topic Difficulty in Cross-Language Image Retrieval, In Accessing Multilingual Information Repositories, Eds (Paul Clough, Julio Gonzalo, Thomas Mandl, Thomas Deselaers, Henning Müller, Horacio Rodríguez, Sven Hartrumpf, Felisa Verdejo, Alicia Ageno, Víctor Peinado), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 4022/2006, Softcover, pp. 558-566.

J Gonzalo, J., Clough, P., and Vallin, A. (2006) Overview of the CLEF 2005 Interactive Track, In Accessing Multilingual Information Repositories, Eds (Paul Clough, Julio Gonzalo, Thomas Mandl, Thomas Deselaers, Henning Müller, Horacio Rodríguez, Sven Hartrumpf, Felisa Verdejo, Alicia Ageno, Víctor Peinado), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 4022/2006, Softcover, pp. 251-262.

P Clough, P., Müller, H., Deselaers, T., Grubinger, M., Lehmann, T., Jensen, J., and Hersh, W. (2006) The CLEF 2005 Cross–Language Image Retrieval Track, In Accessing Multilingual Information Repositories, Eds (Paul Clough, Julio Gonzalo, Thomas Mandl, Thomas Deselaers, Henning Müller, Horacio Rodríguez, Sven Hartrumpf, Felisa Verdejo, Alicia Ageno, Víctor Peinado), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 4022/2006, Softcover, pp. 535-557.

J S Sanderson, M., Tian, J. and Clough, P. (2006), Testing an automatic organisation of retrieved images into a hierarchy, In Proceedings of International Workshop OntoImage’2006 Language Resources for Content-Based Image Retrieval, held in conjunction with LREC'06, Genoa, Italy, pp. 44-49.

J Müller, H., Clough, P., Hersh, W. and Geissbuhler, A. (2006) Variation of Relevance Assessments for Medical Image Retrieval, In Proceedings of 4th International Workshop on Adaptive Multimedia Retrieval, University of Geneva, Switzerland (in print - to appear in LNCS Volume 3877).

P Clough, P., Gonzalo, J. and Karlgren, J. (2006) Multilingual interactive experiments with Flickr, In Proceedings of Workshop on New Texts - Wikis and blogs and other dynamic text sources, held in conjunction with the 11th Conference of the European Chapter of the Association for Computational Linguistics (EACL2006), Trento, Italy.

P Clough, P., Sanderson, M., and Shou, X.M. (2005) Searching and Organizing Images across Languages, In Proceedings of EVA (Electronic Imaging, the Visual Arts & Beyond), Moscow.

P Clough, P. (2005), Extracting Metadata for Spatially-Aware Information Retrieval on the Internet, In Proceedings of Workshop on Geographic Information Retrieval (GIR'05), held in conjunction with CIKM2005, Bremen, Germany, pp. 25-30.

P Clough, P., Joho, H. and Sanderson, M. (2005), Automatically Organising Images using Concept Hierarchies, Workshop held at the 28th Annual International ACM SIGIR Conference on Research and


Development in Information Retrieval, Workshop: Multimedia Information Retrieval, August 15-19, 2005, in Salvador, Brazil.

J Müller, H., Clough, P., Geissbuhler, A. and Hersh, W. (2005) ImageCLEF 2004-2005: results, experiences and new ideas for image retrieval evaluation. In Proceedings of the Fourth International Workshop on Content-Based Multimedia Indexing (CBMI2005), Riga, Latvia, CD-ROM.

J Grubinger, M., Leung, C. and Clough, P. (2005) The IAPR Benchmark for Assessing Image Retrieval Performance in Cross Language Evaluation Tasks, In Proceedings of the first MUSCLE / ImageCLEF workshop on image and video retrieval evaluation, Vienna, Austria, 20th September 2005, pp. 33-50.

P Clough, P., Müller, H. and Sanderson, M. (2005), The CLEF 2004 Cross Language Image Retrieval Track, In Multilingual Information Access for Text, Speech and Images: Results of the Fifth CLEF Evaluation Campaign, Eds (Peters, C., Clough, P., Gonzalo, J., Jones, G., Kluck, M. and Magnini, B.), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 3491/2005, pp. 597-613.

P Clough, P. (2005), Caption vs. Query Translation for Cross-Language Image Retrieval, In Multilingual Information Access for Text, Speech and Images: Results of the Fifth CLEF Evaluation Campaign, Eds (Peters, C., Clough, P., Gonzalo, J., Jones, G., Kluck, M. and Magnini, B.), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 3491/2005, pp. 614-625.

P Clough, P. and Sanderson, M. (2004), A proposal for comparative evaluation of automatic annotation for geo-referenced documents, Workshop held at the 27th Annual International ACM SIGIR Conference on Geographic Information Retrieval, University of Sheffield, UK, July 29th 2004.

P Clough, P. and Sanderson, M. (2004), Assessing Translation Quality for Cross Language Image Retrieval, In Comparative Evaluation of Multilingual Information Access Systems, Eds (Peters, C., Gonzalo, Braschler, M. and Kluck, M.), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 3237/2004, pp. 594-610.

J Arampatzis et al. (2004), Web-based delineation of imprecise regions, Workshop held at the 27th Annual International ACM SIGIR Conference on Geographic Information Retrieval, University of Sheffield, UK, July 29th 2004.

J Müller, H., Geissbuhler, G., Marchand-Maillet, S., and Clough, P. (2004) Benchmarking Image Retrieval Applications, In Proceedings of The Tenth International Conference on Distributed Multimedia Systems (DMS'2004), Workshop on Visual Information Systems (VIS 2004), San Francisco, CA, USA, 2004, pp. 334-337.

J Karlgren, J., Eriksson, G., Franzén, K., Clough, P., Hansen, P., Mizzarro, S., and Sanderson, M. (2004), Reading between the lines: attitudinal expressions in text, In proceedings of the AAAI Spring Symposium Workshop on Exploring Attitude and Affect in Text: Theories and Applications, 2004.

J Sanderson, M. and Clough, P. (2002), Eurovision - an image-based CLIR system, Workshop held at the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Workshop 1: Cross-Language Information Retrieval: A Research Roadmap, University of Tampere, Finland, August 15th 2002, pp. 56-59.

P Clough, P. (2001), Measuring text reuse in a journalistic domain, In Proceedings of the 4th Annual CLUK Colloquium, University of Sheffield, Sheffield, UK, pp.53-63.

Clough PD - Sheffield · Clough PD CURRICULM VITAE Paul David Clough SUMMARY 1. General Paul Clough...

Documents

Transcript of Clough PD - Sheffield · Clough PD CURRICULM VITAE Paul David Clough SUMMARY 1. General Paul Clough...