16th International Seminar CASLIN 2009 1 Open Access and Institutional Repositories from local initiatives to global strategies Friedrich Summann...

16th International Seminar CASLIN 2009

1

Open Access and Institutional

Repositories from local initiatives to global strategies

Friedrich Summann([email protected])

Bielefeld University Library

16Th International Seminar CASLIN 2009


2

Overview

Local initiatives - Open Access strategy and implementationNational Projects- Funded projects (DFG, German Science Foundation)International Projects- BASE, DRIVER, PEER


3

Open Access in Bielefeld University

• Archiving Electronic Dissertations (1996 -)

• First Repository System (2004)

• University Resolution for Open Access Publishing (2005)

• Establishing Postprint Server (2006 -)

• CIO for Scientific Publishing (2006 -)


4

UNIBI repositories:

• BieSON (Dissertations, 2004)

(1121 docs)

• BieTAS (Distributed material, 2005)

(330 docs)

• BieColl (Proceedings, 2007) (2530)

• BiPrints (Scientific Output, 2008) (2367)


5

BieSOn


6

BieTAS (Bielefeld Text Archiv Server)


7

BieColl (Bielefeld eCollections)


8

BiPrints


9

Visibility of Repositories


10

Current Library and University Activities

• BioMed Central Contract• DINI partner• Electronic Journal Publishing

– DIPP NRW– OJS installation

• Cooperation Research Database - Repository


11

DIPP journal frontpage for UNIBI journal


12

University Research Database (FODA)


13

National Projects• Open-Access.net• OPUS4• PubLister• Automatic Classification Extraction

Funded by the DFG (Deutsche Forschungsgemeinschaft,German Science Foundation)


14

Open-Access.net


15

PubLister

DFG Project (18 months)Goals:• Integration of scientists personal publications

lists into the university publishing process • Extracting metadata• Storing the postprint (repository)• Producing a university bibliography• Organizational and technical framework for the

creation of publication lists


16

Automatic Enrichment of OAI Metadata

DFG-Project (German Science Foundation)Duration: 24 months

Partners:• Bielefeld University Library (coordination)• Bielefeld University, Computer Linguistics Department• Leipzig University, Institute for Computer Science


17

Automatic Enrichment of OAI-Metadata

Current status of Classification Information in OAI metadata:

• Only 1 % with classification codes• Different classification systems• Depth is not sufficient


18


Work packages

• Extraction of Classification codes and related information from OAI metadata

• Building a knowledge base • Structured text mining• Delivering DDC codes for documents• Designing an open interface• Integrating into Services (BASE, DRIVER)


19

Extraction of Classification codes and related information from OAI metadata<record> <ddc>370</ddc> <subject>Fremdsprachenlernen</subject> <subject>Deutschunterricht</subject> <subject>Ausl<E4>nder</subject> <subject>Lerner-Uptake</subject> <subject>Kurzzeitiger Fremdsprachenerwerb</subject> <subject>Education</subject> <language>ger</language> <link>http://bieson.ub.uni-bielefeld.de/volltexte/2002/97/pdf/0_titel.pdf</link> <link>http://bieson.ub.uni-bielefeld.de/volltexte/2002/97/pdf/1_inhalt.pdf</link> <link>http://bieson.ub.uni-bielefeld.de/volltexte/2002/97/pdf/2_diss.pdf</link> <link>http://bieson.ub.uni- bielefeld.de/volltexte/2002/97/pdf/3_versicherung.pdf </link></record>


20


Work packages

• Extraction of Classification codes and related information from OAI metadata

• Building a knowledge base • Structured text mining• Delivering DDC codes for documents• Designing an open interface• Integrating into Services (BASE, DRIVER)


21

OPUS4

• 8 Partners (libraries and library networks)• DFG project (1.7.08 – 30.6.09)• Modernized and enhanced software release

Bielefeld UL work packages• DRIVER Interoperability• Collections• CRIS – IR integration


22

International Projects

• BASE (Bielefeld Academic Search Engine)

• DRIVER

• PEER


23

BASE (Bielefeld Academic Search Engine)

• Commercial software (FAST backend)

• Local server farm

• PHP frontend (Bielefeld UL)

• OAI Harvesting / Web Crawling

• Few library people

• Content worldwide

• OA-focused


24

1921 Repositories –> 22,000,000 metadata records Harvested/analyzed

1260 Repositories –>19,700,000 aggregated/indexed

BASE (Bielefeld Academic Search Engine)


25

BASE – Advanced Search


26

BASE – Search features

• Truncation• Search History• Drilldown• Linguistic Search Features

– Thesauri– Lemmatizing

• DDC Browsing• Sorting• Google Scholar Link


27

BASE – Result Display


28

BASE – Common interface

Currently used by

• Metager (German meta search engine)

• KVK (Karlsruhe Virtual Catalogue)

• Digital Library NRW (metasearch portal)

• Local Library Catalogue


29

BASE – OPAC integration


30

DRIVER - the Project (1)

DRIVERI: 1.6.2006 – 30.11.2007

• Building a Testbed for a Future Knowledge Infrastructure in Europe based on Scientific Publications in Repositories

DRIVER =Digital Repository Infrastructure Vision for European Research


31

DRIVER - the Project (2)

DRIVERII: 1.12.2007- 30.11.2009

• Establishing a Productive Infrastructure

• Expansion of Geographic Coverage

• Extension of Metadata and Data Formats

• Extension of Services


32

DRIVER – Partners

Phase 1• 10 Partners from 8 Countries • (D, GB, IT, F, NL, B, PL, GR)

Phase 2• 3 additional project partners (PT, DK, SI)• Additional partners (S, N, FI, LT, ES, IRL)

• Co-ordination: Univ. Athens, SUB Göttingen


33

DRIVER – Bielefeld UL

• Technical Activities (Technical Group)– Harvesting/Aggregation– Storing– Indexing

• Network Activities– Guidelines Definition– Harvesting/Aggregation (Feedback)

• OPUS4 Project (DRIVER Interoperability)


34

DRIVER: Repository Infrastructure • Phase 1:

– 51-Testbed Repositories (DINI, DARE, SHERPA, CNRS, Univ. Gent)

• Phase 2: – Plus further DRIVERI countries– DRIVERII countries– Other European Countries


35

DRIVER – Core aspects

• Open source software• SOA structure• Based on OAI harvesting• Network of partners• Academic content from Europe• OA documents only


36

DRIVER Repository Workflow

• Registration of Repository Managers

• Proposals from Country Correspondents

• Observing Registries

• Analysis/Validation

• Harvesting/Aggregating/Indexierung

• Activation


37

DRIVER: OAI AggregationGoal: Data Quality Improvement

• Normalisation (Vocabulary-based)– dc:type– dc:date– dc:language

• Language Detection• Extraction of Document Link• Rules Definition• Scripting


38

Data Quality (Example dc:type)

Text - 2597764text - 2540080TEXT - 1128327Dataset - 580448Image - 522643image - 514585Electronic Thesis or Dissertation -

366783Tese ou Dissertacao Eletronica -

357567article - 345093Article - 337314Artikel - 310858Other - 219331still image - 212178Rezension - 198773preprint - 191784NonPeerReviewed - 173643

NULL - 8082Clippings<br>Text<br> - 5004 This record contains content - 1473Dark Item - 1145

Photographs; Mosaics; - 11 photographic print mounted on cardboard: b&w; 22 x 16 in. - 180534 - 1Section V Flow Control - 1Acrylic on board: 63 x 114 cm. - 179508 - 1Colored graphite on paper: 47 x 63 cm. - 1texts, vocabulary ('stories, monologues, word list' - 115121 - 1

15,542,177 Entries - 15214 Values


39

DRIVER - Aggregator (1)


40

DRIVER – Aggregator (2)


41

DRIVER – Aggregator (3)


42

DRIVER Guidelineshttp://www.driver-support.eu/documents/DRIVER_Guidelines_v2_Final_2008-11-13.pdf


43

DRIVER Guidelines and OAI usage

• OAI-PMH : Protocol Requirements– Stability, Protocol compliance, XML validity– Incremental Harvesting

• OAI-PMH: Additional Requirements– Deleting strategy – Set für OA-Dokumente, Fulltext link– Batch size

• DRIVER DC Metadata Requirements– Content Recommendations (creator, subject,

source)– Standardized Contents (type, language, date)


44

DRIVER – Validator tool


45

DRIVER – Aggregational Results


46

DRIVER network of academic repositories

…


47

DRIVER – Support Network


48

http://www.driver-repository.eu/


49

PEER =

Publishing and the Ecology of European Research

Focus: relationship between publishers, repositories and the research community

evaluate the bi-directional influence of the different strategies of publications

(publishers journal, open access publication)


50

PEER (2)

• More than 50,000 European acceptedmanuscripts from up to 300 journals will become available for archiving within repositories

• BiPrints will serve as OA repository

• Comparing access log files


51

Conclusion

• All these listed activities are related to open access publishing

• There are strong bi-directional impactsbetween each other

• It makes no difference on which level• Integration will produce benefit for

scientists and end-users


52

• Thank You !

16th International Seminar CASLIN 2009 1 Open Access and Institutional Repositories from local initiatives to global strategies Friedrich Summann...

Documents