Haas, Stephanie

Nelson, Monica

Summer 2013

Assignment 2: Subject Analysis & Evaluation

Parts A3 to A5, B, and C

Contents Page

A3. Statement of Purpose, 02

Data Structure 03

Rules 04

A4. Postco Vocabulary List 05

A5. Database Records 07

B. Retrieval Analysis 21

C. Evaluation & Reflection 22

1

Part A – Database, Vocabulary & Documentation

Statement of Purpose

The Document Information Retrieval Database (DIRD) is intended for students in the

Masters of Library and Information Science (MLIS) program at San Jose State University. It is

intended to make available to students, articles on various aspects of information retrieval that

may contain information that relevant to their studies. The DIRD includes articles about database

design, information organization, and information retrieval including, but not limited to, topics

on: information seeking, problem solving and cognition, data structures, relevance, satisfaction

and performance, user interfaces and information visualization.

Regardless of which career path students choose to take within the program, many of the

relevant area-specific concepts will be addressed in the articles within the database. The purpose

of this database is to assist the searcher in locating all (aggregating) and only (discriminating)

pertinent articles. For example if a student needs to find information about co-linked descriptors,

they will be able to query the database for co-linked descriptors and those records with related

information will be displayed. In addition to the subject matter, the user will also be able to

search records based on document title, author, source, publication date and words from the

abstract.

2

Data Structure

Textbase Structure

Textbase Information

Textbase: C:\Users\Stephanie\Assign 2 test textbase\DIRDdbCreated: 7/31/2013 10:03:55 AMModified: 7/31/2013 10:23:34 AM

Field Summary: 1. Doc_No: Automatic Number(next avail=48, increm=1), Term 2. Author: Text, Term & Word 3. Title: Text, Word 4. Source: Text, Term & Word 5. Abstract: Text, Word 6. Postco: Text, Term Validation: required, valid-list

Log file enabled, showing 'Doc_No'Leading articles: a an the Stop words: a an and by for from in of the to XML Match Fields: 1. Doc_No

Textbase Defaults: Default indexing mode: SHARED IMMEDIATE Default sort order: <none>Textbase passwords: Master password = '' 0 Access passwords: No Silent password

3

Rules: **Note: When in doubt of how to enter an item, use APA style citation rules.

Field RuleDoc No Automatic Number, Term Indexed

Record Number is automatically assigned to each entry.Author Text, Term & Word Indexed, Repeatable

Use the author’s names as listed on the document.Last Name, First Name, Initial, Other necessary information.List names in the order they appear on the document if there is more than one author.List vertically, each on a separate line.If the author cannot be determined, put Author Undetermined

Title Text, Word IndexedCapitalize only the first word of the title and of the subtitle if needed.Capitalize any proper nouns.Finish with a period.If indexer cannot determine a title, put Title Undetermined

Source Text, Term & Word Indexed, RepeatableGive the title of the source in full in upper and lower case letters, followed by the volume number, v#, if exists, followed by the issue number n#, then page number p#-#, followed by year of publication in parenthesis.For Example: Journal of the American Society of Information Science, v45 n3 p186-200 (1994)If the document is accessed online, add the doi number if available or the URL of the home page.Place additional sources if exist by year in ascending order on separate lines.If the source cannot be determined – place explanation in the field.

Abstract Text, Word IndexedEnter the text of the abstract exactly as the author has written it.If there is no abstract, paraphrase the article with 2-3 sentences best describing the article.If the indexer has paraphrased or modified the abstract for any reason, note it in last line of field.

Postco Text, Term Indexed, Repeatable, Validation List,RequiredSelect 3-8 terms from the controlled vocabulary list that identify the information described in the article.To view the list, Right Click on the Postco FieldBase the words on the significant terms and meanings in the abstract/title.Place each word on a separate line in the field.

4

Postco Vocabulary List

Term index for field 'Postco', textbase 'DIRDdb', 7/31/2013 8:56:24 PM:

1 abstracting3 behaviors2 bibliometrics1 cataloguing1 co linked descriptors5 cognitive models4 cognitive processes1 communication processes1 comprehension1 conceptual organization1 content selection2 cost1 data interoperability1 descriptive standards4 design principles1 digital content2 disadvantages1 document retrieval system1 Dogpile com2 full text1 heuristic model3 indexing1 information access3 information needs8 information retrieval5 information search processes1 information technologies3 information users3 interfaces1 knowledge1 lawyers1 learning2 librarians1 library service3 memory1 meta disciplines2 metadata1 metasearch engines1 neutral questioning2 organization5 performance1 probabilistic design2 queries2 relevance5 retrieval systems2 search performance1 search terms1 selection behavior

5

1 sharing1 students1 technology1 teenagers2 text comprehension3 text retrieval2 thesauri1 training1 underlying structure1 user interface1 vocabulary selection

Total number of keys: 59

6

Database Records

Doc_No 27Author Bates, Marcia J.Title The invisible substrate of information science.Source Journal of the American Society for Information Science v50 1043-1050, (1999)Abstract The explicit, above-the-water-line paradigm of information science is well known and widely discussed. Every disciplinary paradigm, however, contains elements that are less conscious and explicit in the thinking of its practitioners. The purpose of this article is to elucidate key elements of the below-the-water-line portion of the information science paradigm. Particular emphasis is given to information science's role as a meta-science - conducting research and developing theory around the documentary products of other disciplines and activities. The mental activities of the professional practice of the field are seen to center around representation and organization of information rather than knowing information. It is argued that such representation engages fundamentally different talents and skills from those required in other professions and intellectual disciplines. Methodological approaches and values of information science are also considered.Postco underlying structure bibliometrics cognitive processes information retrieval meta disciplines text comprehensionDoc_No 28Author Maron, M. E.Title Probabalistic design principles for conventional and full-text retrieval systems.Source Information Processing & Management, v24 n3 p249-255 (1988)Abstract In order for conventionally designed commercial document retrieval systems to perform perfectly, the following two (logical) conditions must be satisfied for every search: (1) There exists a document property (or combination of properties) that belongs to those (and only those) documents that are relevant. (2) That property (or combination of properties) can be correctly guessed by the searcher. In general, the first assumption is false, and the second is

7

impossible to satisfy; hence no conventional IR system can perform at a maximum level of effectiveness. (We are painfully aware of the current poor performance values for Recall and Precision. Furthermore, Recall deteriorates rapidly as document corpora continue to grow in size.) However, different design principles can lead to improved performance. This article presents a view of the document retrieval problem that shows that since the relationship between document properties (whether they be humanly assigned index terms or words that occur in the running text) and relevance is a best probabilistic, one should approach the design problem using probabilistic principles. It turns out that a front end designed to permit searchers to attach probabilistically interpreted weights to their query terms could be adapted for conventional IR systems. Such an enhancement could lead to improve performance.Postco retrieval systems information retrieval probabilistic design design principles document retrieval system full-text performanceDoc_No 29Author Harter, Stephen P. Yung-Rang, ChengTitle Co-linked descriptors: Improving vocabulary selection for end-user searching.Source Journal of the American Society for Information Science, v47 n4 p311-325 (1996)Abstract This article introduces a new concept and technique for information retrieval called co- linked descriptors. Borrowed from an analogous idea in bibliometrics – co-cited references co-linked descriptors provide a theory and method for identifying search terms that , by hypothesis, will be superior to those entered initially by a searcher. The theory suggests a means of moving automatically from two or more initial search terms, to other terms that should be superior in retrieval performance to the two original terms. A research project designed to test this co-linked descriptor hypothesis is reported. The results suggest that the approach is effective, although methodological problems in testing the idea are reported. Algorithms to generate co-

8

linked descriptors can be incorporated easily into system interfaces, front-end or pre- search systems, or help software, in any database that employs a thesaurus. The potential use of co-linked descriptors is a strong argument for building richer and more complex thesauri that reflect as many legitimate links among descriptors as possible.Postco interfaces co-linked descriptors retrieval systems vocabulary selection bibliometrics search performance thesauriDoc_No 30Author Wang, Peiling Soergel, DagobertTitle Beyond topical relevance: Document selection behavior of real users of IR systems.Source Proceedings of the 56th ASIS Annual Meeting: Integrating Technologies; Converging Professions, v30 p4-28 (1993) Columbus, OH. Medford, NJ: Learned Information, p87-92

Abstract This paper reports on part of a study of real users' behavior in selecting documents from a list of citation resulting from a search of an information retrieval (IR) system. Document selection involves value judgments and decision making. Understanding how users evaluate documents and make decisions provides a basis for designing intelligent IR systems that can do a better job of predicting usefulness. ... Analysis of the verbal protocol data identified the criteria, the sources of information and the patterns of document selection behavior. Among the factors identified are topical relevance, field relevance (field is broader than topic), novelty, expected usefulness (from previous experience of the author or journal), orientation, recency, availability, special requisites and time constrains. The design of an intelligent IR system requires an enormous knowledge base including not only the domain knowledge, but also the individual user's preferences and document selection behavior. Such a system could better anticipate the user's decisions and present it's output accordingly.

9

(Abstract shortened by indexer)

Postco relevance selection behavior cognitive processes retrieval systems design principles information usersDoc_No 31Author Elings, Mary W Waibel, GunterTitle Metadata for all: Descriptive standards and metadata sharing across libraries, archives and museums.Source First Monday, 12. Retrieved April 30, 2012 from http://www.firstmondayorg/htbin/cgiwrap/bin/ojs /index.php/fm/articl/view/1628/1543Abstract Integrating digital content from libraries, archives and museums represents a persistent challenge. While the history of standards development is rife with examples of cross- community experimentation, in the end, libraries, archives and museums have developed parallel descriptive strategies for cataloguing the materials in their custody. Applying in particular data content standards by material type, and not by community affiliation, could lead to greater data interoperability within the cultural heritage community. In making this argument, the article demystifies metadata by defining and categorizing types of standards, provides a brief historical overview of the rise of descriptive standards in museums, libraries and archives, and considers the current tensions and ambitions in making descriptive practice more economic.

Postco memory metadata digital content data interoperability descriptive standards sharing cataloguingDoc_No 32Author Bates, Marcia J.Title Subject access in online catalogs: A design model.Source Journal of the American Society for Information Science, v37 n6 p357-375 (1986)Abstract A model based on strikingly different

10

philosophical assumptions from those currently popular is proposed for the design of online subject catalog access. Three design principles are presented and discussed: uncertainty (subject indexing is indeterminate and probabilistic beyond a certain point), variety (by Ashby's law of requisite variety, variety of searcher query must equal variety of document indexing), and complexity (the search process, particularly during the entry and orientation phases, it subtler and more complex, on several grounds, than current models assume). Design features presented are an access phase, including entry and orientation, a hunting phase, and a selection phase. An end-user thesaurus and a front-end system mind are presented as examples of online catalog system components to improve searcher success during entry and orientation. The proposed model is "wrapped around" existing Library of Congress subject-heading indexing in such a way as to enhance access greatly without requiring re-indexing. It is argued that both for cost reasons and in principle this is a superior approach to other design philosophies.Postco information search processes information access search performance organization indexing design principles cost thesauriDoc_No 33Author Blair, David C. Maron, M. E.Title An evaluation of retrieval effectiveness for a full-text document retrieval system.Source Communications of the ACM, v28 n3 p289-299 (1985)Abstract Document retrieval is the problem of finding stored documents that contain useful information...In each instance in which an individual seeks information, he or she will find some documents of the set useful and the other not. useful = relevant. Automatic full-text retrieval is how a collection of documents could be organized so that a person can find all and only the relevant documents. Store the full-text of all docs in the collection on a computer so that every character of every word in every

11

sentence of every document can be located by the machine. Then when a person wants information from that stored collection, the computer is instructed to search for all documents containing certain specified words and word combinations which the user has specified. Two elements make the idea of automatic full- text retrieval even more attractive. On the one hand, digital technology continues to provide computers that are larger, faster, cheaper, more reliable, and easier to use; and, on the other hand, full-text retrieval avoids the need for human indexers whose employment is increasingly costly and whose work often appears inconsistent and less than fully effective.Postco text retrieval relevance information retrieval cost disadvantages performance retrieval systems full-textDoc_No 34Author Marchionini, GaryTitle Interfaces for end-user information seekingSource Journal of the American Society for Information Science, v43 n2 p156-163 (1992)Abstract Essential features of interfaces to support end user information seeking are discussed and illustrated. Examples of interfaces to support the following basic information seeking functions are presented: problem definition, source selection, problem articulation, examination of results, and information extraction. It is argued that present interfaces focus on problem articulation and examination of results functions, and research and development are needed to support the problem definition and information extraction functions. General recommendations for research on interfaces to support end user information seeking include: attention to multimedia information sources, development of interfaces that integrate information seeking functions, support for collaborative information seeking, use of multiple input/output devices in parallel, integration of advanced information retrieval techniques in systems for end users, and development of adaptable interfaces to meet individual difference and multicultural needs.

12

Postco interfaces information retrieval information technologies performance information users user interfaceDoc_No 35Author Swanson, Don R.Title Historical note: Information retrieval and the future of an illusion.Source Journal of the American Society for Information Science, v39 n2 p92-98 (1988)Abstract More than thirty years ago there was good evidence to suggest that information retrieval involved conceptual problems of greater subtlety than is generally recognized. The dramatic development and growth of online services since then seems not to have been accompanied by much interest in these conceptual problems, the limits they appear to impose or the potential for transcending such limits through more creative use of the new services. This article offers perspective on automatic indexing and information retrieval focusing on what led to the view stated above. (Abstract Modified)Postco indexing information retrieval performance indexing performance search termsDoc_No 36Author Voorhees, Ellen M.Title TREC: Improving information access through evaluation.Source Bulletin of the American Society for Information Science and Technology, v32 p16-21Abstract Evaluation is a fundamental component of the scientific method...... Evaluating competing technologies on a common problem set is a powerful way to improve the state of the art and hasten technology transfer. TREC has been able to build on the text retrieval field's tradition of experimentation to significantly improve retrieval effectiveness and extend the experimentation to new sub-problems (Abstract Modified)Postco text retrieval performanceDoc_No 37Author Agosto, Denise, E.

13

Hughes-Hassell, SandraTitle People, places and questions: An investigation of the everyday life information-seeking behaviors of urban young adults.Source Library & Information Science Research, v27 p141-163 (2005)Abstract This article presents preliminary findings from a research grant on the everyday life information-seeking (ELIS) behaviors of urban young adults. Twenty-seven teens aged 14 through 17 participated in the study. Qualitative data were gathered using written activity logs and semi-structured group interviews. A typology of urban teens' preferred ELIS sources, media types, and query topics is presented. The typology shows friends and family as preferred ELIS sources, cell phones as the preferred method of mediated communication, and schoolwork, time- related queries, and social life as the most common and most significant areas of ELIS. The results indicate a heavy preference for people as information sources and that urban teens hold generally unfavorable views of libraries and librarians. The conclusion lists questions that information practitioners should consider when designing programs and services for urban teens and calls for researchers to consider this often- ignored segment of the population as potential study participants.Postco behaviors teenagers librarians library service information search processesDoc_No 38Author Dervin, Brenda Dewdney, PatriciaTitle Neutral questioning: A new approach to the reference interview.Source RQ, vSummer p506-513 (1986)Abstract Neutral questioning is a strategy for conducting the reference interview in a way that allows the librarian to understand the query from the user's viewpoint. Neutral questions are open in form, avoid premature diagnosis of the problem, and structure the interview along dimensions important to the users. Derived from extensive studies into information-seeking behavior, this strategy has now been taught to over a thousand practitioners through workshops developed in

14

1981. Empirically based research to test the effects of neutral questioning is in progress. Informal evaluation indicates that neutral questioning may become a useful component of in-service training for librarians.Postco behaviors queries neutral questioning librarians trainingDoc_No 39Author Farrow, JohnTitle A cognitive process model of document indexingSource Journal of Documentation, v47 n2 p149-166 (1991)Abstract Classification, indexing and abstracting can all be regarded as summarizations of the content of a document. A model of text comprehension by indexers (including classifiers and abstractors) is presented, based on task descriptions which indicate that the comprehension of text for indexing differs from normal fluent reading in respect of: operational time constraints, which lead to text being scanned rapidly for perceptual cues to aid gist comprehension; comprehension being task oriented rather than learning oriented, and being followed immediately by the production of an abstract, index, or classification; and the automaticity of processing of text by experienced indexers working within a restricted range of text types. The evidence for the interplay of perceptual and conceptual processing of text under conditions of rapid scanning is reviewed. The allocation of mental resources to text processing is discussed, and a cognitive process model of abstracting, indexing and classification is described.Postco cognitive models comprehension abstracting text comprehension indexingDoc_No 40Author Huston, Mary, M.Title Windows into the search process: An inquiry into dimensions of online information retrievalSource Online Review, vJune-August p227-243 (1991)Abstract From diverse users' point of view, contextual frameworks are elaborated for the nature of the information technology, the information

15

universe, and the information search. Within these conceptual parameters, established theories on search strategy are reviewed and cognitive models and information-seeking are highlighted. Future directions for research on users' search processes are discussed in terms of the role for online retrieval in the future information environment.Postco cognitive models information search processes text retrieval technologyDoc_No 41Author Ingwersen, PeterTitle Cognitive perspectives of information retrieval interaction: Elements of a cognitive IR theorySource Journal of Documentation, v52 n1 p3-50 (1996)Abstract The objective of the paper is to amalgamate theories of text retrieval from various traditions into a cognitive theory for information retrieval interaction. Set in a cognitive framework, the paper outlines the concept of polyrepresentation applied to both the user's cognitive space and the information space of IR systems. The concept seeks to represent the correct user's information need, problem state, and domain work task or interest in a structure of causality. Further, it implies that we should apply different methods of representation and a variety of IR techniques of different cognitive and functional origin simultaneously to each semantic full-text entity in the information space. The cognitive differences imply that by applying cognitive overlaps of information objects, originating from different interpretations of such objects through time and by type, the degree of uncertainty inherent in IR is decreased.

(Abstract Modified)Postco cognitive models communication processes information needs information retrievalDoc_No 42Author Jansen, Bernard, J. Spink, Amanda Koshman, SherryTitle Web searcher interaction with Dogpile.com metasearch engineSource Journal of the American Society for Information and Technology, v589 p744-755

16

(2007)Abstract Metasearch engines are an intuitive method for improving the performance of Web search by increasing coverage, returning large numbers of results with a focus on relevance, and presenting alternative views of information needs. However, the use of metasearch engines in an operational environment is not well understood. In this study, we investigate the usage of Dogpile.com, a major Web metasearch engine, with the aim of discovering how Web searchers interact with metasearch engines. We report results examining 2,465,145 interactions from 534,507 users of Dogpile.com on May 6, 2005 and compare these results with findings from other Web searching studies. We collection data on geographical location of searchers, use of system feedback, content selection, sessions, queries, and term usage.

(Abstract Modified)Postco content selection Dogpile.com information needs metasearch engines queriesDoc_No 43Author Kuhlthau, Carol, C. Tama, S. L.Title Information search process of lawyers: A call for 'just for me' information servicesSource Journal of Documentation, v57 p25-43 (2001)Abstract The study reported in this paper is part of a programme of ongoing research based on the model of the Information Search Process (ISP) developed in a series of prior studies by Kuhlthau. This study sought to gain a better understanding of the variety of tasks that involve lawyers as a particular group of information workers, how they use information to accomplish their work, and the role mediators play in their process of information seeking and use. Findings revealed that these lawyers frequently were involved in complex tasks that required a constructive process of interpreting, learning and creating. To accomplish these complex tasks, they preferred printed texts over computer databases primarily because computer databases required well-specified requests and did not offer an option for examining a wide range of information at one time. These lawyers called for an active potential role for mediators in 'just for me'

17

services. 'Just for me' services would encompass designing systems to provide a wider range of access more compatible with the process of construction, applying and developing principles of classification that would offer a more uniform system for organising and accessing files, and providing direction in filtering the overwhelming amount of information available on electronic services.Postco information search processes information users lawyers learningDoc_No 44Author Najarian, Suzanne, E.Title Organizatinal factors in human memory: Implications for library organization and access systemsSource The Library Quarterly, v51 n3 p269-291 (1981)Abstract Psychological studies on memory and learning are examined for what they might reveal about human categorizing processes and the organizing principles and limitations of human memory. Particular attention is given to evidence for a model which represents the organization of knowledge in memory in terms of a hierarchical type of structure. The experimental findings suggest several considerations for the design of library systems of organization and access that would take into account characteristics of conceptual organization of knowledge. Such systems are likely to be particularly effective in aiding the user in his search for information since they would (1) employ organizational schemes that are familiar to the individual, (2) permit a strategy for the exploration of a subject area similar to the type of search procedure which seems to facilitate the retrieval of items from memory, and (3) take into consideration the apparent limits on the amount of information that the individual can successfully attend to at one time.Postco cognitive models conceptual organization knowledge memory organizationDoc_No 45Author Simon, Herbert, A.Title Information-processing models of cognitionSource Journal of the American Society for

18

Information Science, v5 p364-377 (1981)Abstract This article reviews recent progress in modeling human cognitive processes. Particular attention is paid to the use of computer programming languages as a fromalism for modeling, and to computer simulation of the behavior of the systems modeled. Theories of human cognitive processes can be attempted at several levels: at the level of neural processes, at the level of elementary information processes (e.g., retrieval from memory, scanning down lists in memory, comparing simple symbols, etc.), or at the level of higher mental processes (e.g., problem solving, concept attainment). This article will not deal at all with neural models; it focuses mainly upon higher mental processes, but not without some attention to modeling the elementary processes and especially tot he relationships between elementary and complex processes.Postco cognitive models cognitive processes behaviors memoryDoc_No 46Author Ury, Connie Jo Johnson, Carolyn, V. Meldrem, Joyce, A.

Title Teaching a heuristic approach to information retrievalSource Research Strategies, v15 n1 p39-47 (1997)Abstract To become life-long learners, students must acquire information retrieval skills for future as well as current information needs. This article describes how the Library Use Instruction Program at Northwest Missouri State University incorporates a heuristic model in which students continually evaluate and refine their information seeking practices while progressing through all levels of courses in diverse disciplines. Collegial partnerships with departmental faculty and ongoing instructional assessment are essential to the success of the program.Postco information needs heuristic model information retrieval studentsDoc_No 47Author Belkin, N.J. Marchetti, P.G. Cool, C.

19

Title Braque: Design of an interface to support user interaction in information retrieval.Source Information Processing and Management, v29 n3 p325-344 (1993)Abstract We suggest that information retrieval is most appropriately considered as an inherently interactive process, and describe the design of an interface to a bibliographic information retrieval system that supports user interaction in an integrated fashion. A significant aspect of the interface design is its dependence upon a two-level hypertext model of information retrieval system databases, and the seamless support of a variety of information seeking strategies through the use of this model, and of a model of dimensions of information seeking behaviorsPostco information retrieval retrieval systems design principles interfaces information search processes metadata cognitive processes disadvantages

20

Part B - Retrieval Analysis

Information need #1: I’m interested in the role of expertise in information seeking.Pre-determined relevant documents: 30, 34, 35, 39

Field Query Documents retrieved?

Precision Recall Effectiveness

Title information & (seek*/search*)

34, 37, 40, 43 0.25 0.25 0.2500

Abstract (information & (seek*/search*)) & user*

30, 33, 34, 38, 40, 41, 42, 44, 47

0.22 0.50 0.3449

Post-co =user interface /=comprehension

34, 39 1.00 0.50 0.6464

Information need #2: I’m interested in how studies of human cognition have informed IR research.Pre-determined relevant documents: 39, 40, 41, 44, 45

Field Query Documents retrieved?

Precision Recall Effectiveness

Title cogniti*/IR 30, 39, 41, 45 0.75 0.60 0.6665Abstract (cogniti*/

concept*) & information*

29, 35, 40, 41, 44, 45

0.67 0.80 0.7271

Post-co =cognitive models 39, 40, 41, 44, 45 1.00 1.00 1.0000

Information need #3: I would like to know how to design a more user friendly interface.Pre-determined relevant documents: 28, 29, 30, 32, 34, 47

Field Query Documents retrieved?

Precision Recall Effectiveness

Title interface* & user* 34, 47 1.00 .33 .5262Abstract Interface* &

(user*/design*)29, 34, 47 1.00 .60 .7172

Post-co =design principles & =user interface

28, 30, 32, 34, 47 1.00 .83 .8798

Information need #4: I’m looking for articles on the problems of full-text retrieval systems.Pre-determined relevant documents: 28, 30, 33

Field Query Documents retrieved?

Precision Recall Effectiveness

Title full-text & retriev* 28,33 1.00 .67 .7667Abstract (problem*/disadvantage*)

& full-text & retrieval*33, 41 .50 .34 .4145

Post-co full-text & =retrieval systems & =disadvantages

33 1.00 .34 .5333

21

Part C – Evaluation & Reflection

After a very positive experience with our first group project, we decided it would be nice

to pair up for this one. Just as had been the case with our first project, the division of labor was

quite flexible, with each of us contributing to most parts of the assignment, (excluding the

individual needs testing). Stephanie assembled and wrote the first rough draft of SOP, created the

database, and wrote the Rules. Monica wrote the final draft of the SOP, and the initial drafts of

the Evaluation and Reflection. We then sent our work, via email, to one another for editing,

revision, and discussion. We each took it upon ourselves to locate ten records, as per the

assignment instructions, and then systematically worked through each section of the assignment.

We each performed our own individual tests of our information needs, including determining the

questions relating to our information needs and choosing which documents were relevant to

those needs. We each performed our own queries, and performed our individual analysis

calculations. After the final draft of the Evaluation and Reflection was completed, we each took

turns reviewing and editing until we were satisfied with the end result.

Creating the subject term vocabulary required a fair bit of back and forth for us, as it was

not initially clear how to distinguish postco terms from preco terms. It was also a bit difficult to

determine just how much paring down was necessary. As such, our initial draft was bit

cumbersome, with a number of redundant terms, and our second draft was a bit too streamlined,

resulting in the need to restore some of the original terms to the list during the database testing

phase. We were focusing on different areas of information and consequentially some of the

terms had different meanings based on the context of the reader, so some discussion was required

22

in order to make sure that terms were not redundant, misinterpreted, and needed to be included in

the vocabulary list.

During the testing phase, we were able to determine where any errors had occurred in the

input of the records, as well as where additional subject terms were necessary for effective

searching. One obstacle in the testing phase stemmed from trouble working with the database

software. DBTextworks did not always perform as it was supposed to. On a positive note, the

constant need to accommodate technological problems did give us an opportunity to become

very familiar with both the software and the indexing process.

When evaluating the success of the queries, it was difficult to judge the effectiveness.

The database of relevant articles was small, we knew and defined the content so it was not clear

if the results were skewed or not. Different queries often returned the same results, leading us to

believe that the documents retrieved were not being discriminative as much as might be needed.

To help with this issue a couple of things we could have done differently to increase the

effectiveness would be: 1) choose one or two very article-specific terms for each item, in order to

help discriminate between documents and 2) choose terms that are both discipline-specific and

appear in several places in the literature, for the purpose of aggregation.

In addition to the technical, and technological, lessons learned in doing this assignment, a

number of things about the general field of information science were learned. The difficulties

inherent in trying to ascertain out the most meaningful bits of information from a document, so

that others may locate that item, is no small task. Differences in literacy, cognitive skills, and

even just garden-variety library experience make determining the best way to represent, or index,

information quite challenging. Determining the “aboutness” of things is a very subjective

process, which in the case of cataloging, is intended to yield an objective way to locate an item.

23

The process of creating a system wherein others can find both all and only the documents they’re

looking for requires the system designer to be both judge and jury, as well the presenter and

audience.

In conclusion, this assignment was very effective in demonstrating how important

surrogate records are for summarizing an article, and how important proper analysis of document

subject matter is in distilling the meaning of said document down to a few relative terms. It

demonstrated the difficulties searchers face in determining which terms to use in a query when

trying to get their information needs met. This project helped us understand more about how

people process information and how people look for information through querying and searching

databases. This learning experience will, undoubtedly, prove extremely beneficial in our future

careers.

24