1 Discovery-ing Symphony MARC records Who • Gary Steele Library Systems Manager, Glasgow Caledonian University • Bernard Scaife Head of Technical Services, UCL Institute of Education • Kathy Sadler Systems Librarian, Cranfield University What • Each use a different discovery layer; Summon, Primo, EDS • Get bib records from Symphony to the discover layer • Enable real time availability in the discover layer Why • All discovery layers rely on MARC records and holdings details but there’s more than one way to get this data out of Symphony…
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Discovery-ing Symphony MARC records
Who• Gary Steele Library Systems Manager, Glasgow Caledonian University• Bernard Scaife Head of Technical Services, UCL Institute of Education• Kathy Sadler Systems Librarian, Cranfield University
What• Each use a different discovery layer; Summon, Primo, EDS• Get bib records from Symphony to the discover layer• Enable real time availability in the discover layer
Why• All discovery layers rely on MARC records and holdings details but
there’s more than one way to get this data out of Symphony…
Part A:Getting bib records from
Symphony to the discover layer
Getting bib records from Symphony to Summon
• Summon 2.0• Getting bib records from Symphony to Summon• New/Updated records report• Deleted records report
4
Summon 2.0
5
Getting bib records from Symphony to Summon
• Content type, field and location mapping for Summon import• Update and correct LDR, 007, and 008 fields in MARC records
• Do not export equipment records (e.g. laptops) or eJournal records• Do export all books, ebooks, journal, ejournals, statutes, law reports,
theses, etheses, dissertations, archive items, DVDs, software, and databases.
• Schedule– Deleted records report: Every night at 23:00– New/Updated records report: Every night at 23:10– Full Catalogue dump: Every four
months
6
New/Updated records report
• Use customised report created by Anne called gcalsummon.pl
• Selection:– Item type: Exclude (~) items type (equipment and ejournals)– Date modified: Day report is run (D0:D0)
• Process:– Select catkeys of records based on criteria above– Extract MARC records for selected catkeys– Rename file to gcal-catalog-updates-YYYY-MM-DD-HH-MM-
SS.mrc– FTP file to Summon “Updates” folder
7
Export record
8
Deleted records report
• Use customised report I created under the guidance of Anne
• Selection:– Records deleted on the day the report is run
• Process:– Parse history logs – Lookup catalogue keys– Compare files to find deleted keys– FTP flat file of deleted keys to Summon
• Lookup catalogue keys extracted from history logs•Catalogue keys for deleted records will return as errors •Sort results and remove duplicates •Write keys returned to new file (presentkeys)
**error number 111 on catalog start, key=18622 flex=i9780406237002**error number 111 on catalog start, key=198847 flex=i9780406237002**error number 111 on catalog start, key=237053 flex=i9780406237002**error number 111 on catalog start, key=237143 flex=i9780406237002**error number 111 on catalog start, key=237145 flex=i9780406237002**error number 111 on catalog start, key=237147 flex=i9780406237002**error number 111 on catalog start, key=237148 flex=i9780406237002**error number 111 on catalog start, key=505999 flex=a505863**error number 111 on catalog start, key=506002 flex=a506000
11
3. Compare files to find deleted keys
• comm command compares two files
• -3 suppresses keys in both files
• -1 suppresses keys unique to presentkeys
• Leaves keys that are unique to allkeys, and these keys are the deleted keys
comm -31 presentkeys allkeys >deletedkeys
12
4. FTP flat file of deleted keys to Summon
tr -d '|' < deletedkeys >summonkeys
• File “translated” up to remove “|”• Renamed to “gcal-catalog-YYYY-MM-DD-HH-MM-SS.deletes”• FTP file to Summon “Deletes” folder
Symphony: Run same export.pl report – no date filter
Primo: Special “Prime” pipe (drops/recreates index)
When do we need to do this?
Timing: Symphony export (10m)
File management…Reports save to /Xfer folder in Symphony
FTP is run as a part of the import routine from Primo, so we had to configure a Sirsi unix account and tell Primo where to pick up the file from and its name
File format and processingPrimo consumers Marc exchange format (.mrc)
Classmark and location information is exported in the 926 field for further processing
Primo runs the following functions on the imported file: Normalisation, Enrichment, FRBR, Deduplication
What about deletions?More tricky…
getdeleteds.pl custom report compares today’s catkeys with yesterday’s:
Complex logic rules which can draw upon multiple marc fields in order to create new fields.
Flagged the source as “IOE Library Catalogue”
Created a backlink to the full record using catkey
Symphony and EBSCO Discovery
Kathy Sadler, Systems Librarian@tatielane
Getting bib records from Symphony to EDS
Getting bib records from Symphony to EDS
Before my time at Cranfield:
• Started with Summon
• Commissioned a SirsiDynix custom report to export to Summon
• Never really implemented Summon fully
• Did a market review, moved to EDS
Full data extraction custom report
I copied the Summon custom report and tweaked it for EDS
• It catalogdumps selected records and makes an export file in /tmp
• It FTPs the file to EBSCO into the “full” directory
We run it weekly on a Sunday at 05:00
• It takes about 23 minutes (292,000 records)
• The finished report is emailed to my libsysadmin inbox
Item selections
Exclude any locations that are shadowed
Title selections
Exclude interlibrary loans and anything else that we don’t want “discovered”
When indexing is complete
• EBSCO sends a confirmation email – usually same day, else next day
Daily adds/updates
Custom report ebscoftp-upd is a copy of the full data extraction report
• Only difference in script is that it FTPs into the “update” directory
diff ebscoftp-full.pl ebscoftp-upd.pl< my $ftp_dir = "full";---> my $ftp_dir = "update";
• Runs daily except Sunday, after midnight
• Takes 6 minutes
When the update has been indexed
• EBSCO sends a confirmation email, usually later same day
What about deletions?
• We keep it simple and don’t do anything special for EDS
• Items for deletion get checked out to one of three shadowed locations[Auditors required us to adopt this practice many years ago]
– WITHDRAWN [deliberately decided to withdraw]– GONE4GOOD [lost or missing, gave up searching]
– DUFFITEM [test items and catalogue errors]
• Cvtdiscard and Remdiscard run weekly before EBSCO Full Extract
• This works fine for us and we haven’t experienced any issues
Our other catalogue does things differently
• Koha catalogue at Cranfield Defence and Security in Shrivenham
• EBSCO harvests the catalogue directly via OAI-PMH
• Weekly full harvest, daily updates
• No data extraction required, it’s all done for us!
Part B:Real time availability in the
discover layer
Real time availability in Summon
• Availability in OPAC • Availability in Summon• Web Services• Availability in Web Services• Web services xml• Current location mapping• Xml mapping
35
Availability in OPAC
36
Availability in Summon
37
Web Services
• Provide simplified remote access to features of Symphony• Download available from Support Center• Free to install and use for “standard” services• Setup guide explains how to install Web Services• SDK explains how to use Web Services• https://support.sirsidynix.com/zh-hans/node/55009
38
Web Services xml
Base URL: http://193.62.224.60:8080/symws/Protocol: rest/Service: standard/Request: lookupTitleInfo?Client: clientID=SummonTireeItem ID: &titleID=201554Parameter: &includeItemInfo=true