Changing Landscape of Discovery: Content, …events.iitgn.ac.in/2017/CLSTL/wp-content/uploads/2017/04/AthenaHoe...Changing Landscape of Discovery: Content, Linking, ... •Publication

Changing Landscape of Discovery: Content, Linking,

and User Experience Athena Hoeppner

eResources Librarian

University of Central Florida. Orlando, FL, USA.

CLSTL 2017 2-4 March 2017. ITT Gandinagar.

International Conference on Changing Landscape of Science and Technology Libraries

/

eResources Librarian I apply library technologies to help connect

users to content.

Technologies: • SFX, EBSCO Discovery Services, EZproxy, etc….

Users: • University of Central Florida students and employees faculty

(64,000 people)

Content: • Subscription databases, eBooks, eJournals, media & other online

content • Selected open access • Anything describable with metadata that researchers might seek

@cybrgrl

Oversimplified timeline

Online Databases

1990s

Google

1998

OpenURL &

MetaSearch

2000

Google Scholar

2004

Resource Discovery Services (Summon, EDS)

2009 / 2010

EDS: UCF’s Discovery Index Contents

http://maxpixel.freegreatpicture.com/Hay-Straw-Harvest-Agriculture-Haystack-1947829

• 129 Metadata Sources turned on in EDS admin

• MARC loads for catalog

• Digitized collections loaded

• Hundreds of A/I indexes

• Publisher provided indexing: • JSTOR, ScienceDirect, Springer, IoP,

Wiley… … …

690,626,504 Records!

Student Information Ecosystem

Content

eJounals Resolver

Discovery Library Sites

Login ILL

Scientists Information Ecosystem • Colleagues

(e-mail, word of mouth, etc.)

• Social networks (Twitter, Medley, Blogs, etc.)

• Known journals/TOCs • Cited references • Google Scholar • Library tools

• RDS • Index/Abstract databases • Journal lists

Innate v. Active

Known Item v. Exploratory Albert Edelfelt [Public domain], <a href="https://commons.wikimedia.org/wiki/File%3AAlbert_Edelfelt_-_Louis_Pasteur_-_1885.jpg">via Wikimedia Commons</a>

Connectivity and Devices

http://jeshoots.com/detail-of-smart-phone/

Recent Articles on Research Behaviours Nicholas, D., Boukacem‐Zeghmouri, C., Rodríguez‐Bravo, B., Xu, J., Watkinson, A., Abrizah, A., Herman, E. and Świgoń, M., 2017.

Where and how early career researchers find scholarly information. Learned Publishing. https://www.researchgate.net/profile/David_Nicholas5/publication/312040929_Where_and_how_early_career_researchers_find_scholarly_information/

Johnson, P.C. and Simonsen, J.E., 2015. Do engineering master’s students know what they don’t know? Exploring abstracting & indexing service use and non-use. Library Review, 64(1/2), pp.36-57. https://www.researchgate.net/profile/Paula_Johnson12/publication/272388061_Do_engineering_master's_students_know_what_they_don't_know

Thelwall, M. and Kousha, K., 2015. ResearchGate: Disseminating, communicating, and measuring Scholarship?. Journal of the Association for Information Science and Technology, 66(5), pp.876-889. https://www.researchgate.net/profile/Kayvan_Kousha/publication/259583165_ResearchGate_Disseminating_communicating_and_measuring_scholarship/

Sapa, Remigiusz, Monika Krakowska, and Malgorzta Janiak. Information seeking behaviour of mathematicians: scientists and students. Information Research: An International Electronic Journal 19.4 (2014). http://files.eric.ed.gov/fulltext/EJ1050474.pdf

Haglund, L. and Olsson, P., 2008. The impact on university libraries of changes in information behavior among academic researchers: a multiple case study. The journal of academic librarianship, 34(1), pp.52-59. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.453.6484

Resource Discovery Services Vendors

WorldCat Local

Summon Primo

Central Index

EBSCO Discovery

Service

Encore Duet

OCLC Serials

Solutions

ExLibris EBSCO Innovative

Google’s Robots Crawls: • University Repositories • Journal Publishers • Journal papers • Conference papers • Technical report • Dissertations • Pre- and post-prints • Abstracts.

To be included, your website must make either the full text of the

articles or their complete author-written abstracts freely available

and easy to see.

By Wendy Mann from Warrington, UK (DSC01423) [CC BY 2.0 (http://creativecommons.org/licenses/by/2.0)], via Wikimedia Commons

RDS Pre-harvested Metadata Publisher Provided Metadata

• University Repositories

• Journal Publishers

• Journal papers

• Conference papers

• Technical report

• Dissertations

• Pre- and post-prints

• Abstracts

Subscription Metadata • Abstract and indexing databases • Aggregator hosted full text • Magazines • Current ebooks • Images and media

https://www.flickr.com/photos/x-ray_delta_one/16897057936/in/photolist-sc6SCM-nndP3r-9jRctm-DaNnER-9iBv6j-rK8QD7-9GLfDm/

RDS Content Details

Provider / Product Sources Included

Back- files Searchable Metadata

American Chemical Society All journals No

Author Supplied Abstracts and Author Keywords for All Journals including all available Subject

Headings

American Mathematical Society

All journals Yes Full Text Searching for All Titles including all

available Subject Headings

Web of Science and Citation Indexes* Web of Science

/ Citation Indexes

Records added from

1989 to present

All Content Available through Web of Science, including:

• A&H • Science

• Soc Sciences…

Directory of Open Access Journals (DOAJ) All journals Yes

All available metadata for all journals covered by the directory

Springer Science & Business Media B.V.

All journals and all books &

reference works Yes

Full Text Searching for All Journals & Books including all available Subject Headings

RDS INDEX

Discovery Index Metadata Sources

Publisher Metadata

Subscription Resources

Free / Open Access

Library Metadata

arXiv

DOAJ

OIAster

MEDLINE

PsycInfo

WoS

Gale OneFile

MARC

IRs

Digitized INSPEC

ISI

CINAHL

BIOSIS

Springer Wiley

T&F OUP

ebrary

Elsevier

Content for Scientists

By Center for Scientific Review [2] [Public domain], <a href="https://commons.wikimedia.org/wiki/File%3AScientificReview.jpg">via Wikimedia Commons</a>

Do RDS and Google Scholar include content scientists cite?

Time for a Bibliometric Study! Methodology: • Web of Science, Science Citation

Index • Organization Search “India” • Arbitrarily picked 5 papers • Exported cited references and parsed

into Excel • Searched Google Scholar • Searched UCF’s EBSCO Discovery • Recording findings in Excel • Analyzed data

http://works.bepress.com/Athena-Hoeppner/1/

5 Papers by Indian Scientists Das, R., Kumar, A., et al. 2017. Biomechanical

characterization of spider webs. Journal of the Mechanical Behavior of Biomedical Materials, 67, pp.101-109.

Venkatramani, J., Nair, V., et al. 2017. Multi-fractality in aeroelastic response as a precursor to flutter. Journal of Sound and Vibration, 386, pp.390-406.

Chakraborty, K., Sarkar, S., et al. 2017. Redefining the transparency order. Designs, Codes and Cryptography, 82(1-2), pp.95-115.

Remigius, W.D. and Sarkar, S., 2017. Fluid Structure Interaction of a flexible plate in a compressible medium. In Fluid Mechanics and Fluid Power–Contemporary Research pp. 1273-1282.

Singh, M., Kumar, I., et al. 2016. Third order optical nonlinear studies on highly conducting vertically aligned carbon nanoflakes. Materials Research Express, 3(12), p.125005.

187 Cited References

“ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ 21

“ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ 43

“ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ 67

“ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ “ 49

“ “ “ “ “ “ “ 7

96%

4%

Indian Author Cited References Found in GS (187 Citations)

84%

16%

Nursing Student Cited References Found in GS (520 citations)

Cited References Discoverable in Google Scholar

Found Not Found

Cited References Discoverable in UCF’s EDS

88%

12%

NURSING STUDENT PAPERS

(520 CITATIONS)

94%

6%

UCF FACULTY PAPERS (239 CITATIONS)

89%

11%

REFERENCES FOUND IN EDS (187 CITATIONS)

Found Not Found

167 180

4

Indian Authors (187 citations)

UCF EDS Google Scholar NotFound

459

439

Nursing Students' 520 citations)

Citations Available in RDS v Google Scholar

2017 2013

Not Found v Found

Neither discover 100% • Found in Google Scholar (no UCF):

• 8 conferences

• 3 articles from not subscribed journals

• 1 each book, dissertation, government publication

• Found in UCF’s EDS (no GS): • 3 books

• Not Found in Either: • 3 books

• 1 bad citation

Articles Win!

EDS

Google Scholar

…of cited articles

The Future: More of these

Future: Opening Up the Past

Primary Source Collections largely missing from RDS and Google

Scholar

How can we help?

https://www.flickr.com/photos/saaste/13541955144

• Keep our eyes open • What content do users seek

• How do they *want* to look for it?

• Create standards for metadata and metadata exchange

• Advocate for standards

• Enhance and correct metadata (crowd source)

New kinds of content will keep coming.

Search Behaviors & Relevancy

Resource Discovery Service: Alive and Well

2,580,191

3,491,524

2,168,122

SEARCHES

RESULT CLICKS

RECORD VIEWS

UCF's EDS Platform Use 2016 (64,000 Students)

Search Refinement Tools for Users

• Effective and easy Basic Search

• Fielded Search

• Facets, Limitors, Refining

• End User Accounts and Personalization

• Widgets, Recommenders, and Additional services

http://www.instructables.com/id/Storing-garden-tools-with-style-aka-Zombiewall/

What are these things?

750,000 Hits Full Text Peer Reviewed Dates 1859 <-> 2014 Pub Type Article (590,000) Book (40,000) News (30,000) …more Subject Finance Genetics Brothers …more Library Main Library Super Science Lib

Sort: Relevancy How venture capital works.

Author: Christian Science Monitor (1908-Current f i le) ISSN: 0145-8027 Date: 03/11/1985 Description: 17

The Venture cloning method.

Author: -Thadius S. Venture ISBN: 01-0045-802 Date: 2008

Super Science Library Print Library QH 442 V7 2008

Due: 31 Oct. 2015

Full Text

Search: Venture GO

Ignored and Unused

Relevancy Ranking: Typical Factors for RDS

• Weighted fields (subject, abstract, etc.)

• Exact match of term with field

• Density of terms

• Publication date/currency

• Document type

• Document length

• Locally owned (MARC load)

EDS: Amount of metadata • OA sources less frequently included

in A/I databases

• Thin metadata

https://www.flickr.com/photos/23258385@N04/2235793476

Google Scholar Relevancy Ranking

Google uses PageRank + User info • Over 200 characteristics

Google Scholar uses number of citations, keywords in title, and…?

https://commons.wikimedia.org/wiki/File:PageRank-byFML.gif

? ? ? ? ?

? ?

? Google Scholar‘s Ranking Algorithm. https://blogs.cornell.edu/info2040/2016/10/22/the-ranking-algorithm-of-google-scholar/

Future Relevancy: Private, Personalized

User attributes via Federated ID • Shibboleth and Open Athens

• Domain of study

• Current course enrollment

• Academic level

User Behavior • Prior research activity by

individual?

• Prior research activity by everyone? (Like Amazon recommendations)

By SummerWithMorons (Own work) [GFDL (http://www.gnu.org/copyleft/fdl.html) or CC BY-SA 4.0-3.0-2.5-2.0-1.0 (http://creativecommons.org/licenses/by-sa/4.0-3.0-2.5-2.0-1.0)], via Wikimedia Commons

Future Relevancy: Precise

Item Use

• Altmetrics (PlumPrint)

• Record views, result click, times cited

Improved Known Item Searching • Citation search (EDS)

• ORCID

• DOIs

Das, R., Kumar, A., et al. 2017. Biomechanical

characterization of spider webs. Journal of the Mechanical Behavior of Biomedical Materials, 67, pp.101-109.

Linking and Access Ability to link depends on:

• Online content • Subscriptions • OA repositories

• OpenURLs and Link resolver • Good metadata • CustomLinks

• DOI and oaDOI • https://www.doi.org/ • https://oadoi.org/

It’s not about the finding.

It’s about the having.

https://www.reddit.com/r/aww/comments/4gay11/i_need_dis/

i need dis

More Bibliometrics! Full Text Found EDS v GS

159

142

Indian Authors Links to Semi-vetted Full Text

(187 citations)

GS EDS

Google Scholar Link Types: • Title of article: Links to

publisher/content owner site. • OA/Repository link • OpenURL (pre filtered to owned) if

user has tuned on Library Links

Discovery Service Link Types: • Hosted PDF or HTML • OpenURL (pre filtered to owned) • OpenURL (not filtered to owned) • CustomLinks • MARC 856 • Embedded in record

Google for OA Discovery

37%

63%

OA Host Shown in GS Indian Authors (187 citations)

Found Not Found

Access Gone Wrong

Why?

Things fall apart Missing from discovery systems

Bad metadata

Variant title, ISSN or other data searched/indexed

Expired access license

Incorrect holdings in resolver

Incorrect authentication used

Bad EZproxy configuration

Broken URLs

Linking Failures: Preposterous!

I am an Associate Professor in the Biology Department. Web of Science is failing to connect to the Wiley Online Library. I am essentially blocked from access to a massive amount of material necessary to conduct my research. Note: the problem is a serious one: a page not found error. I replicated this in 3 different web browsers, cleared cookies. All the usual possible problems. This error apparently would indicate that UCF is not subscribed to Wiley Online. That would be preposterous and I can’t imagine somebody would let that happen. I can’t write a grant proposal. Hundreds of thousands of dollars are at stake with things like this.

Looking for “Phenotypic plascticity…”

The source of the problem: Metadata

ICVM-8 abstracts

Authentication Conundrum

• IP

• EZproxy (and some WAM)

• Federated ID (SSO and WAYF) • Shibboleth

• OpenAthens

• Google OAuth 2.0

https://www.flickr.com/photos/dimmerswitch/5786102606

There must be an easier way…

http://www.ibtimes.co.uk/i-can-haz-pdf-academics-tweet-secret-code-word-get-expensive-research-papers-free-1525241

Sci-Hub Use

http://www.sciencemag.org/news/2016/04/whos-downloading-pirated-papers-everyone

Improved Linking in the Near Future

Better Metadata • Open Discovery Initiative: More and

better metadata • Metadata to indicate OA and type

• Library-specific KBART loads into link resolver knowledge bases

• APIs for publishers to populate IRs with manuscripts when embargos end

• Registered IDs • DOIs for everything • ORCID searching in place of author

name • ID crosswalks (ISSN to DOI, please!)

The Future is Now: oaDOI API { "results": [ { "doi": "10.1242/jeb.01597", "doi_resolver": "crossref", "evidence": "oa repository (via base-search.net oa url)", "free_fulltext_url": "http://jeb.biologists.org/cgi/content/short/208/10/1937", "is_boai_license": false, "is_free_to_read": true, "is_subscription_journal": true, "license": null, "match_simple_norm_distance": 1.0, "match_title_score": 1.0, "match_type": "title subset", "match_uses_first_author": true, "oa_color": "green", "url": "http://doi.org/10.1242/jeb.01597" } ] } https://api.oadoi.org/

10.1242/jeb.01597

Need More DOIs. Need More Open Access.

15%

4%

50%

31%

oaDOI API Indian Authors

(187 citations, 129 DOIs)

Green

Gold

Closed

No DOI

The Future is the Past: Long Forgotten LibX

One Click to Authentication. Uses Link Resolver knowledge base. Login prompt only shows if access active.

Authentication: A Little Help From Our Friends

• Publishers could:

• Add links to oaDOI on the paywall

• Allow access to anyone with edu email address. • Look up subscription library

authentication method and connect to it

• Link to known hosted manuscript

• Use oaDOI

https://pixabay.com/en/key-gold-lock-unlock-metallic-387273/

Content, Relevancy, Linking: Everything is UX

User Behaviors • When do they seek information and

why?

• Which tool fits their need?

• What do they have to do to get access?

• How do they communicate about findings?

Predictability v Features

Simplicity v Specialization

Ubiquity v Licensed Access

By 14 Mostafa&zeyad (Own work) [CC BY-SA 4.0 (http://creativecommons.org/licenses/by-sa/4.0)], via Wikimedia Commons

Thanks for the analogy, Rick Anderson!

Thank You! Athena Hoeppner

eResources Librarian

University of Central Florida. Orlando, FL, USA.

CLSTL 2017 2-4 March 2017. ITT Gandinagar.

International Conference on Changing Landscape of Science and Technology Libraries

/