Evaluating library support for a new graduate program: Finding harmony with a mixed method approach
description
Transcript of Evaluating library support for a new graduate program: Finding harmony with a mixed method approach
![Page 1: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/1.jpg)
Evaluating Library Support for a New Graduate
Program: Finding Harmony with a Mixed Method
Approach
Philip OrrDistance Learning LibrarianDavid L. Rice LibraryUniversity of Southern Indiana [email protected]
Peter WhitingSerials Technical Services Librarian
David L. Rice LibraryUniversity of Southern Indiana
![Page 2: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/2.jpg)
Background / Significance of Research
![Page 3: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/3.jpg)
USI Doctor of Nursing Practice (DNP) Program
• Begun in August 2008
• University’s first doctoral program
• Program requires a minimum of 36 hours beyond the MSN and involves both coursework and clinical practice
• Courses use a hybrid method involving on-campus intensives and distance education delivery
• Curriculum designed to be completed within 2 (full-time) or 3 (part-time) years
![Page 4: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/4.jpg)
The DNP Student
• Enrolled 64 students, 2008-2010
• 78% lived more than 50 miles from campus
• 49% lived outside Indiana
![Page 5: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/5.jpg)
The DNP Student
Based on student satisfaction survey (35 responses):
• Majority are more than 40 years old
• Last educational degree program:< 5 Years – 145-10 Years – 8> 10 Years -- 13
• Employed as:Nurse professional – 15 Nurse educator –
16 Nurse administrator – 2 Other – 2
![Page 6: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/6.jpg)
DNP Student Participation in Research ProjectSummary
2008 Cohort
2009 Cohort
2010 Cohort
Total
Number of Students Enrolled 19 21 24 64
Number of Students Participating in Citation Analysis
10 5 15 30
Number of Students Surveyed 16 13 20 49
Number of Students Responding to Survey
14 10 11 35
Number of Students Graduating 15 15 18 (proj.) 48
![Page 7: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/7.jpg)
Library Collaboration with DNP Program
• Provided access to nine online journals – “Nursing Nine”
• Provided access to two open access journal collections:
PubMed CentralBentham Open Access Journals
• Expanded interlibrary loan (ILL) service to include trial article delivery (AD) service
• Provided an intensive face-to-face orientation to Rice Library’s resources and services
• Maintained a “Library Support” section within the Doctoral Student Virtual Center (Blackboard Site)
![Page 8: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/8.jpg)
Health care professionals are users of information
AccurateCurrentUnderstandableTimely
![Page 9: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/9.jpg)
Research QuestionThis study sought to answer the following question:
How well do Rice Library’s resources and services support the information needs (study and research) of students enrolled in the University of Southern Indiana’s DNP program?
![Page 10: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/10.jpg)
Research Methods
![Page 11: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/11.jpg)
Four Methods Used To Evaluate the Library’s Performance:
1. Examination of Database Usage Statistics
2. Survey of Student Satisfaction
3. Examination of Interlibrary Loan and Article Delivery Usage
4. Analysis of Reference Citations in Student Research Papers
![Page 12: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/12.jpg)
Findings
![Page 13: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/13.jpg)
Use of Nursing DatabasesAll Users
2006 - 2011
Database2006/2007 2007/2008 2008/2009 2009/2010 2010/2011
TOTALSearches Searches Searches Searches Searches
CINAHL with Full Text 37,763 68,672 57,141 62,665 85,606 311,847
Health Source: Nursing 25,946 37,531 35,526 45,858 48,080 192,941
MEDLINE 17,912 22,430 22,461 28,103 34,415 125,321
ProQuest Health and Medical 48,839 61,952 60,500 69,203 78,694 319,188
PubMed Central
Statistics
Not Available
Bentham Open Access Journals
Statistics
Not Available
Total per year 130,460 190,585 175,628 205,829 246,795
![Page 14: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/14.jpg)
2007 2008 2009 20100
500
1,000
1,500
2,000
2,500
1,7431,832
1,968
2,218
285 317
357 410
19 31 48
Undergraduates
Masters
Doctorate
College of Nursing and Health Professions Enrollment
Source: USI Fact Book -- http://www.usi.edu/opra/factbook/
![Page 15: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/15.jpg)
Use of Nursing DatabasesAll Users
2006 - 2011
2006/2007 2007/2008 2008/2009 2009/2010 2010/2011 -
10,000
20,000
30,000
40,000
50,000
60,000
70,000
80,000
90,000
CINAHL with Full-Text
Health Source: Nursing
MEDLINE
ProQuest Health & Med-ical Complete
![Page 16: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/16.jpg)
Use of Nursing DatabasesPercent of Change
2006 - 2011
Database2006/2007 2007/2008 2008/2009 2009/2010 2010/2011
Searches Searches Searches Searches Searches
CINAHL with Full Text 37,763 68,672 57,141 62,665 85,606
Percent Change 82% -17% 10% 37%
Health Source: Nursing 25,946 37,531 35,526 45,858 48,080
Percent Change 45% -5% 29% 5%
MEDLINE 17,912 22,430 22,461 28,103 34,415
Percent Change 25% 0% 25% 22%
ProQuest Health & Medical 48,839 61,952 60,500 69,203 78,694
Percent Change 27% -2% 14% 14%
![Page 17: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/17.jpg)
Use of “Nursing Nine” JournalsRanked by Usage
All Users2008 - 2011
Journal Title
7/08 – 7/11Usage
1 Journal of Nursing Administration (JONA) 1,8632 Nursing Research 5313 Nurse Educator 4564 Evidence Based Nursing 4435 Applied Nursing Research 3856 Journal of Professional Nursing 3497 Nursing Outlook 2668 Western Journal of Nursing Research 184
9 Clinical Scholars Review: The Journal of Doctoral Nursing 29
TOTAL 4,506
![Page 18: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/18.jpg)
Use of “Nursing Nine” JournalsAll Users
2008 - 2011
7/08 - 7/09 8/09-7/10 8/10-7/11
1,056
1,570
1,876
![Page 19: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/19.jpg)
Student Satisfaction Survey
• Distributed electronically by university’s Office of Planning, Research, and Assessment
• Distributed at the end of the students’ second semester in the program
• 49 students received survey / 35 students responded (Response rate: 71%)
• Included 28 questions – 23 content questions + 5 demographic questions
![Page 20: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/20.jpg)
Overall DNP Student Satisfaction
ServiceSatisfied /
Very Satisfied
Reference Services (Ex: Library orientation, e-mail reference, etc.)
96%
Interlibrary Loan / Article Delivery Services 100%
Online Services (Ex: Library web pages, Journal Finder, etc.)
97%
Resources (Ex: Electronic course reserves, e-books, etc.)
94%
![Page 21: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/21.jpg)
Q18: Databases Used
Database No. of Responses
Most Frequently Used:
CINAHL w/FT / CINAHL+ w/FT 34
ProQuest Health and Medical Complete 34
MEDLINE 33
Health Source: Nursing/Academic Edition 31
Least Frequently Used:
Health Business FullTEXT 12
WorldCat 8
Health Source: Consumer Edition 6
![Page 22: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/22.jpg)
Q19: Most Useful Databases
Database No. of Responses
CINAHL w/FT / CINAHL+ w/FT 15
Health Source: Nursing/Academic Edition 10
ProQuest Health and Medical Complete 6
ProQuest Research Library 1
PsycINFO 1
![Page 23: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/23.jpg)
Q20: Least Useful Databases
Database No. of Responses
MEDLINE 7
PsycINFO 5
Health Source: Nursing/Academic Edition 4
ProQuest Health and Medical Complete 4
WorldCat 4
ProQuest Research Library 3
Health Source: Consumer Edition 3
Academic Search Premier 2
Health Business Full Text 2
CINAHL w/FT, CINAHL+ w/FT 1
![Page 24: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/24.jpg)
Q21: Information Providers Used
Information Provider No. of Responses
Internet 30
Rice Library 28
Journal Articles from Publishers’ Websites 21
Other Academic Libraries 15
Workplace Library 15
Other Corporate/Special Libraries 10
Other Information Providers 5
Public Libraries 4
Commercial Document Delivery Services 4
![Page 25: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/25.jpg)
Q22: Action Taken When Article Was Not Available in Full Text
Action No. of Responses
Requested it through Rice Library’s interlibrary loan service
19
Did not use the article / Chose another article
19
Checked on its availability in / used from another library
15
Used a copy from personal journal collection 8
Did something else 7
Requested it from a publisher’s Website 5
Borrowed a copy from a colleague’s personal journal collection
2
Requested it from a commercial document delivery service
0
Did not have this problem 0
![Page 26: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/26.jpg)
Q5: Interlibrary Loan / Article Delivery Use
Used Have Not Used
Not Aware Of
Interlibrary Loan 22 (63%) 13 (37%) 0 (0%)
Article Delivery 12 (34%) 23 (66%) 0 (0%)
Q6: Interlibrary Loan / Article Delivery Usefulness
Very Useful Somewhat Useful
Not at all Useful
Interlibrary Loan 19 (86%) 2 (9%) 1 (5%)
Article Delivery 12 (100%) 0 (0%) 0 (0%)
![Page 27: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/27.jpg)
Interlibrary Loan / Article Delivery Usage
Submitted Cancelled Filled
Interlibrary Loan Requests
746 183 563 (75%)
Article Delivery Requests
17 2 15 (88%)
![Page 28: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/28.jpg)
Citation AnalysisOverview
• Thirty students participated, 2008-201110 2008 cohort 5 2009 cohort15 2010 cohort
• Examined a total of 229 papers involving 4,399 citations
![Page 29: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/29.jpg)
Number and Percentage of Cited Sources by Format
Percentage
Articles 67%
Web sites 18%
Books 13%
Other 1%
![Page 30: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/30.jpg)
Number and Percentage of Cited Sources by Date Range
Number and Percentage of Articles Cited byDate Range
N=4,391 Number Percentage
0 – 5 Years 2,895 66%
6 – 10 Years 1,020 23%
11+ Years 476 11%
N=2,954 Number Percentage
0 – 5 Years 1,824 62%
6 – 10 Years 793 27%
11+ Years 337 11%
![Page 31: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/31.jpg)
Number and Percentage of Cited Sources Which Rice Library Made Available
(Excluding Web Sites)
Number Available /
Number Cited
Percentage
Articles 2,390 / 2,954 81%
Books 232 / 672 35%
Other 4 / 54 7%
TOTAL 2,626 / 3,680
71%
![Page 32: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/32.jpg)
Number and Percentage of Cited Sources Freely Available on the Web
Percentage
Articles 24%
TOTAL 25%
![Page 33: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/33.jpg)
Journals Most Frequently Cited
Ulrich’s Document Type Codes: A/S = Academic/Scholarly; J = Journal; T = Trade
Journal Title Citation Freq.
Avail. in RL
Some Content Free on
Web
Ulrich’s Doc. Type
Ulrich’s Subject Classification
1 JONA (Journal of Nursing Administration) 171 1986-
present N J, A/S Med. Sci- Nurses and Nursing
2 Nursing Economic$ 124 1983-present N J, A/S Med. Sci- Nurses
and Nursing
3 Journal of Advanced Nursing 931981 to 1 year
agoY J, A/S Med. Sci- Nurses
and Nursing
4 Online Journal of Issues in Nursing 61 2002-
present Y A/S Med. Sci- Nurses and Nursing
5 Nursing Administration Quarterly 50 1986-
2005 N J, A/S Med. Sci- Nurses and Nursing
![Page 34: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/34.jpg)
Journals Most Frequently Cited
Ulrich’s Document Type Codes: A/S = Academic/Scholarly; J = Journal; T = Trade
Journal Title Citation Freq.
Avail. in RL
Some Content Free on
Web
Ulrich’s Doc. Type
Ulrich’s Subject Classification
6 Nursing Management 44 1993-2007 N J, A/S Med. Sci.- Nurses
and Nursing
7 Journal for Nurses in Staff Development 44 n/a N J, A/S Med. Sci.- Nurses
and Nursing
8 New England Journal of Medicine 39 1961-
present Y J, A/S Medical Science
9 Critical Care Nurse 38 1986-present Y J, A/S Med. Sci.- Nurses
and Nursing
10 Journal of the American Geriatrics Society 37 1986-
present N J, A/S Gerontology and Geriatrics
![Page 35: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/35.jpg)
Journals Most Frequently Cited
Ulrich’s Document Type Codes: A/S = Academic/Scholarly; J = Journal; T = Trade
Journal Title Citation Freq.
Avail. in RL
Some Content Free on
Web
Ulrich’s Doc. Type
Ulrich’s Subject Classification
11Journal of Continuing Education in the Health Professions
351997-
one year ago
N J, A/S Medical Sciences
12 American Journal of Critical Care 33 1998-
present Y J, A/S Medical Sci.-Nurses and Nursing
13 Journal of Gerontological Nursing 32 1986-
present N J, A/S Gerontology and Geriatrics
14 Nursing Research 30 1986-present N A/S Med. Sci.- Nurses
and Nursing
15 Health Affairs 29 1994-present N J, A/S Public Health and
Safety
![Page 36: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/36.jpg)
Frequency of Citation“Nursing Nine”
Journal TitleCitation
Frequency
1 Journal of Nursing Administration (JONA) 171
2 Nursing Research 30
3 Nursing Outlook 17
4 Journal of Professional Nursing 16
5 Applied Nursing Research 14
6 Western Journal of Nursing Research 8
7 Nurse Educator 1
8 Evidence Based Nursing 0
9 Clinical Scholars Review: The Journal of Doctoral Nursing 0
TOTAL 257
![Page 37: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/37.jpg)
Discussion / Implications
![Page 38: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/38.jpg)
Evaluation of Library Performance
![Page 39: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/39.jpg)
Library Orientation
![Page 40: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/40.jpg)
Promote the Use of Interlibrary Loan and Article Delivery Services
![Page 41: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/41.jpg)
Emphasize Proper Use of APA Citation Style
![Page 42: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/42.jpg)
Promote the Use of “Nursing Nine” Electronic Journals
![Page 43: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/43.jpg)
Adjust Journal Offerings Supporting the Program
![Page 44: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/44.jpg)
Expand the Nursing Databases Available
![Page 45: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/45.jpg)
Extend Article Delivery Services to Other Graduate Programs
![Page 46: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/46.jpg)
Philip OrrDistance Learning LibrarianRice Library, [email protected]
Peter WhitingSerials Technical Services Librarian
Rice Library, [email protected]
Thank You For Attending Today’s Session
Questions?
![Page 47: Evaluating library support for a new graduate program: Finding harmony with a mixed method approach](https://reader035.fdocuments.net/reader035/viewer/2022062513/5562adbad8b42a6e4f8b52b1/html5/thumbnails/47.jpg)