Evaluating Library Support for a New Graduate Program: Finding Harmony with a Mixed Method Approach Philip Orr Distance Learning Librarian David L. Rice Library University of Southern Indiana [email protected] Peter Whiting Serials Technical Services Librarian David L. Rice Library University of Southern Indiana [email protected]
Evaluating library support for a new graduate program: Finding harmony with a mixed method approach
May 25, 2015
In 2008, the University of Southern Indiana began a new Doctor of Nursing Practice (DNP) program offered via distance education. Prior to its beginning, USI librarians collaborated with nursing faculty to identify ways to support the program. As a result of these discussions and using grant funding provided by the nursing department, the library added relevant electronic journals and open access journal collections Providing electronic access to the journals would enable distance education students to easily use these materials. In addition to existing full-text databases, the library also made available two open access journal collections, including Bentham Open Access Journals and PubMed Central Open Access Journals. The library also expanded its interlibrary loan (ILL) services by providing an article delivery (AD) service on a trial basis to all students enrolled in the program living more than 50 miles from campus. This three-year study sought to answer the question, “How well do the library’s new and existing resources and services support DNP student research?” The methods used by this study included a citation analysis of references listed in formal papers, an examination of usage statistics generated by the electronic resources supporting the program, a student satisfaction survey, and a review of students’ use of ILL and AD services. The citation analysis provided data indicating the sources used (number, type, currency, etc.) by the students and the library’s ability to supply them. Reviews of the usage statistics for the online journals and databases provided a comparison of how the use of these resources has been affected by the DNP enrollment. The student satisfaction surveys have given feedback on the students’ opinions and behaviors regarding the resources and services made available by the library.
Presenters: Peter Whiting and Philip Orr, David L. Rice Library, University of Southern Indiana
Presenters: Peter Whiting and Philip Orr, David L. Rice Library, University of Southern Indiana
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Evaluating Library Support for a New Graduate
Program: Finding Harmony with a Mixed Method
Approach
Philip OrrDistance Learning LibrarianDavid L. Rice LibraryUniversity of Southern Indiana [email protected]
Peter WhitingSerials Technical Services Librarian
David L. Rice LibraryUniversity of Southern Indiana
Background / Significance of Research
USI Doctor of Nursing Practice (DNP) Program
• Begun in August 2008
• University’s first doctoral program
• Program requires a minimum of 36 hours beyond the MSN and involves both coursework and clinical practice
• Courses use a hybrid method involving on-campus intensives and distance education delivery
• Curriculum designed to be completed within 2 (full-time) or 3 (part-time) years
The DNP Student
• Enrolled 64 students, 2008-2010
• 78% lived more than 50 miles from campus
• 49% lived outside Indiana
The DNP Student
Based on student satisfaction survey (35 responses):
• Majority are more than 40 years old
• Last educational degree program:< 5 Years – 145-10 Years – 8> 10 Years -- 13
• Employed as:Nurse professional – 15 Nurse educator –
16 Nurse administrator – 2 Other – 2
DNP Student Participation in Research ProjectSummary
2008 Cohort
2009 Cohort
2010 Cohort
Total
Number of Students Enrolled 19 21 24 64
Number of Students Participating in Citation Analysis
10 5 15 30
Number of Students Surveyed 16 13 20 49
Number of Students Responding to Survey
14 10 11 35
Number of Students Graduating 15 15 18 (proj.) 48
Library Collaboration with DNP Program
• Provided access to nine online journals – “Nursing Nine”
• Provided access to two open access journal collections:
PubMed CentralBentham Open Access Journals
• Expanded interlibrary loan (ILL) service to include trial article delivery (AD) service
• Provided an intensive face-to-face orientation to Rice Library’s resources and services
• Maintained a “Library Support” section within the Doctoral Student Virtual Center (Blackboard Site)
Health care professionals are users of information
AccurateCurrentUnderstandableTimely
Research QuestionThis study sought to answer the following question:
How well do Rice Library’s resources and services support the information needs (study and research) of students enrolled in the University of Southern Indiana’s DNP program?
Research Methods
Four Methods Used To Evaluate the Library’s Performance:
1. Examination of Database Usage Statistics
2. Survey of Student Satisfaction
3. Examination of Interlibrary Loan and Article Delivery Usage
4. Analysis of Reference Citations in Student Research Papers
Findings
Use of Nursing DatabasesAll Users
2006 - 2011
Database2006/2007 2007/2008 2008/2009 2009/2010 2010/2011
TOTALSearches Searches Searches Searches Searches
CINAHL with Full Text 37,763 68,672 57,141 62,665 85,606 311,847
Health Source: Nursing 25,946 37,531 35,526 45,858 48,080 192,941
MEDLINE 17,912 22,430 22,461 28,103 34,415 125,321
ProQuest Health and Medical 48,839 61,952 60,500 69,203 78,694 319,188
PubMed Central
Statistics
Not Available
Bentham Open Access Journals
Statistics
Not Available
Total per year 130,460 190,585 175,628 205,829 246,795
2007 2008 2009 20100
500
1,000
1,500
2,000
2,500
1,7431,832
1,968
2,218
285 317
357 410
19 31 48
Undergraduates
Masters
Doctorate
College of Nursing and Health Professions Enrollment
Source: USI Fact Book -- http://www.usi.edu/opra/factbook/
Use of Nursing DatabasesAll Users
2006 - 2011
2006/2007 2007/2008 2008/2009 2009/2010 2010/2011 -
10,000
20,000
30,000
40,000
50,000
60,000
70,000
80,000
90,000
CINAHL with Full-Text
Health Source: Nursing
MEDLINE
ProQuest Health & Med-ical Complete
Use of Nursing DatabasesPercent of Change
2006 - 2011
Database2006/2007 2007/2008 2008/2009 2009/2010 2010/2011
Searches Searches Searches Searches Searches
CINAHL with Full Text 37,763 68,672 57,141 62,665 85,606
Percent Change 82% -17% 10% 37%
Health Source: Nursing 25,946 37,531 35,526 45,858 48,080
Percent Change 45% -5% 29% 5%
MEDLINE 17,912 22,430 22,461 28,103 34,415
Percent Change 25% 0% 25% 22%
ProQuest Health & Medical 48,839 61,952 60,500 69,203 78,694
Percent Change 27% -2% 14% 14%
Use of “Nursing Nine” JournalsRanked by Usage
All Users2008 - 2011
Journal Title
7/08 – 7/11Usage
1 Journal of Nursing Administration (JONA) 1,8632 Nursing Research 5313 Nurse Educator 4564 Evidence Based Nursing 4435 Applied Nursing Research 3856 Journal of Professional Nursing 3497 Nursing Outlook 2668 Western Journal of Nursing Research 184
9 Clinical Scholars Review: The Journal of Doctoral Nursing 29
TOTAL 4,506
Use of “Nursing Nine” JournalsAll Users
2008 - 2011
7/08 - 7/09 8/09-7/10 8/10-7/11
1,056
1,570
1,876
Student Satisfaction Survey
• Distributed electronically by university’s Office of Planning, Research, and Assessment
• Distributed at the end of the students’ second semester in the program
• 49 students received survey / 35 students responded (Response rate: 71%)
• Included 28 questions – 23 content questions + 5 demographic questions
Overall DNP Student Satisfaction
ServiceSatisfied /
Very Satisfied
Reference Services (Ex: Library orientation, e-mail reference, etc.)
96%
Interlibrary Loan / Article Delivery Services 100%
Online Services (Ex: Library web pages, Journal Finder, etc.)
97%
Resources (Ex: Electronic course reserves, e-books, etc.)
94%
Q18: Databases Used
Database No. of Responses
Most Frequently Used:
CINAHL w/FT / CINAHL+ w/FT 34
ProQuest Health and Medical Complete 34
MEDLINE 33
Health Source: Nursing/Academic Edition 31
Least Frequently Used:
Health Business FullTEXT 12
WorldCat 8
Health Source: Consumer Edition 6
Q19: Most Useful Databases
Database No. of Responses
CINAHL w/FT / CINAHL+ w/FT 15
Health Source: Nursing/Academic Edition 10
ProQuest Health and Medical Complete 6
ProQuest Research Library 1
PsycINFO 1
Q20: Least Useful Databases
Database No. of Responses
MEDLINE 7
PsycINFO 5
Health Source: Nursing/Academic Edition 4
ProQuest Health and Medical Complete 4
WorldCat 4
ProQuest Research Library 3
Health Source: Consumer Edition 3
Academic Search Premier 2
Health Business Full Text 2
CINAHL w/FT, CINAHL+ w/FT 1
Q21: Information Providers Used
Information Provider No. of Responses
Internet 30
Rice Library 28
Journal Articles from Publishers’ Websites 21
Other Academic Libraries 15
Workplace Library 15
Other Corporate/Special Libraries 10
Other Information Providers 5
Public Libraries 4
Commercial Document Delivery Services 4
Q22: Action Taken When Article Was Not Available in Full Text
Action No. of Responses
Requested it through Rice Library’s interlibrary loan service
19
Did not use the article / Chose another article
19
Checked on its availability in / used from another library
15
Used a copy from personal journal collection 8
Did something else 7
Requested it from a publisher’s Website 5
Borrowed a copy from a colleague’s personal journal collection
2
Requested it from a commercial document delivery service
0
Did not have this problem 0
Q5: Interlibrary Loan / Article Delivery Use
Used Have Not Used
Not Aware Of
Interlibrary Loan 22 (63%) 13 (37%) 0 (0%)
Article Delivery 12 (34%) 23 (66%) 0 (0%)
Q6: Interlibrary Loan / Article Delivery Usefulness
Very Useful Somewhat Useful
Not at all Useful
Interlibrary Loan 19 (86%) 2 (9%) 1 (5%)
Article Delivery 12 (100%) 0 (0%) 0 (0%)
Interlibrary Loan / Article Delivery Usage
Submitted Cancelled Filled
Interlibrary Loan Requests
746 183 563 (75%)
Article Delivery Requests
17 2 15 (88%)
Citation AnalysisOverview
• Thirty students participated, 2008-201110 2008 cohort 5 2009 cohort15 2010 cohort
• Examined a total of 229 papers involving 4,399 citations
Number and Percentage of Cited Sources by Format
Percentage
Articles 67%
Web sites 18%
Books 13%
Other 1%
Number and Percentage of Cited Sources by Date Range
Number and Percentage of Articles Cited byDate Range
N=4,391 Number Percentage
0 – 5 Years 2,895 66%
6 – 10 Years 1,020 23%
11+ Years 476 11%
N=2,954 Number Percentage
0 – 5 Years 1,824 62%
6 – 10 Years 793 27%
11+ Years 337 11%
Number and Percentage of Cited Sources Which Rice Library Made Available
(Excluding Web Sites)
Number Available /
Number Cited
Percentage
Articles 2,390 / 2,954 81%
Books 232 / 672 35%
Other 4 / 54 7%
TOTAL 2,626 / 3,680
71%
Number and Percentage of Cited Sources Freely Available on the Web
Percentage
Articles 24%
TOTAL 25%
Journals Most Frequently Cited
Ulrich’s Document Type Codes: A/S = Academic/Scholarly; J = Journal; T = Trade
Journal Title Citation Freq.
Avail. in RL
Some Content Free on
Web
Ulrich’s Doc. Type
Ulrich’s Subject Classification
1 JONA (Journal of Nursing Administration) 171 1986-
present N J, A/S Med. Sci- Nurses and Nursing
2 Nursing Economic$ 124 1983-present N J, A/S Med. Sci- Nurses
and Nursing
3 Journal of Advanced Nursing 931981 to 1 year
agoY J, A/S Med. Sci- Nurses
and Nursing
4 Online Journal of Issues in Nursing 61 2002-
present Y A/S Med. Sci- Nurses and Nursing
5 Nursing Administration Quarterly 50 1986-
2005 N J, A/S Med. Sci- Nurses and Nursing
Journals Most Frequently Cited
Ulrich’s Document Type Codes: A/S = Academic/Scholarly; J = Journal; T = Trade
Journal Title Citation Freq.
Avail. in RL
Some Content Free on
Web
Ulrich’s Doc. Type
Ulrich’s Subject Classification
6 Nursing Management 44 1993-2007 N J, A/S Med. Sci.- Nurses
and Nursing
7 Journal for Nurses in Staff Development 44 n/a N J, A/S Med. Sci.- Nurses
and Nursing
8 New England Journal of Medicine 39 1961-
present Y J, A/S Medical Science
9 Critical Care Nurse 38 1986-present Y J, A/S Med. Sci.- Nurses
and Nursing
10 Journal of the American Geriatrics Society 37 1986-
present N J, A/S Gerontology and Geriatrics
Journals Most Frequently Cited
Ulrich’s Document Type Codes: A/S = Academic/Scholarly; J = Journal; T = Trade
Journal Title Citation Freq.
Avail. in RL
Some Content Free on
Web
Ulrich’s Doc. Type
Ulrich’s Subject Classification
11Journal of Continuing Education in the Health Professions
351997-
one year ago
N J, A/S Medical Sciences
12 American Journal of Critical Care 33 1998-
present Y J, A/S Medical Sci.-Nurses and Nursing
13 Journal of Gerontological Nursing 32 1986-
present N J, A/S Gerontology and Geriatrics
14 Nursing Research 30 1986-present N A/S Med. Sci.- Nurses
and Nursing
15 Health Affairs 29 1994-present N J, A/S Public Health and
Safety
Frequency of Citation“Nursing Nine”
Journal TitleCitation
Frequency
1 Journal of Nursing Administration (JONA) 171
2 Nursing Research 30
3 Nursing Outlook 17
4 Journal of Professional Nursing 16
5 Applied Nursing Research 14
6 Western Journal of Nursing Research 8
7 Nurse Educator 1
8 Evidence Based Nursing 0
9 Clinical Scholars Review: The Journal of Doctoral Nursing 0
TOTAL 257
Discussion / Implications
Evaluation of Library Performance
Library Orientation
Promote the Use of Interlibrary Loan and Article Delivery Services
Emphasize Proper Use of APA Citation Style
Promote the Use of “Nursing Nine” Electronic Journals
Adjust Journal Offerings Supporting the Program
Expand the Nursing Databases Available
Extend Article Delivery Services to Other Graduate Programs
Philip OrrDistance Learning LibrarianRice Library, [email protected]
Peter WhitingSerials Technical Services Librarian
Rice Library, [email protected]
Thank You For Attending Today’s Session
Questions?
Related Documents
