10/09/2019 1 Delivered and supported by a variety of teams across The National Archives Facilitator - Katie Kinkead Heads of Knowledge and Information Management and Departmental Record Officers Training 2019 Welcome to the Learning Room
10/09/2019
1
Delivered and supported by a variety of teams across The National ArchivesFacilitator - Katie Kinkead
Heads of Knowledge and Information Management and Departmental Record Officers Training 2019
Welcome to the Learning Room
10/09/2019
2
Objectives
By the end of the training you will be able to:
• Explain how your role and TNA roles and responsibilities are affected by PRA and Information Rights Legislation.
• Recognise how to further and better collaborate with TNA.
• Understand and clarify TNA’s key functions that affect your role.
10/09/2019
3
Public Records Act 1958
The National Archives
Public Record Bodies
Responsibilities under Public Records Act:
The National Archives
Provide guidance and supervision to public record bodies on the safekeeping and selection of public records.
Preserve transferred records. Provide facilities for the public to see and obtain
copies of transferred records, unless the records are closed or retained because an exemption in the Freedom of Information Act applies.
Oversee the place of deposit system on behalf of the Secretary of State for Digital, Culture, Media and Sport.
Return records temporarily at the request of the transferring organisation.
Care and preserve records.
10/09/2019
4
Responsibilities under Public Records Act:
Public Record Bodies
Selection of records for permanent preservation under the guidance and supervision of the Keeper of Public Records.
Safe-keeping of records. Transfer of records to The National Archives or an
approved place of deposit by the due date unless they need to be retained, in which case the Secretary of State for Digital, Culture, Media and Sport’s approval must be obtained.
Carry out formal applications for retention and closure through The National Archives which are then reviewed by The Advisory Council on National Archives and Records.
Disposal of records not selected for preservation, by destruction or presentation to another institution.
Department for Digital, Culture, Media and Sport
DCMS – Secretary of State
The National Archives
Jeff James - Chief Executive and Keeper
Lucy Fletcher - Director for Government
John Sheridan - Digital Director
Government Audience
Digital Archiving
Public Record Bodies
How we all fit together…
Cabinet Office (CO)
10/09/2019
5
Department for Digital, Culture, Media and Sport
DCMS – Secretary of State
The National Archives
Public Record Bodies
• Information Management Report (IMR)
• Information Management Assessment (IMA)
• Training• Advice and Guidance• Events/User-groups
How we all fit together…
Department for Digital, Culture, Media and Sport
DCMS – Secretary of State
The National Archives
Public Record Bodies
The Advisory Council on National Records
and Archives (ACNRA)
Places of Deposit (POD)
Information Commissioner’s Office
(ICO)
GKIM Professions
10/09/2019
6
What can support you
Office 365 GKIM user group - [email protected] Google GKIM user group – [email protected] ADRO - [email protected] KIM Leaders - [email protected] IRMS – irms.org.uk ARA – archives.org.uk CILIP – cilip.org.uk Civil Service Learning - https://civilservicelearning.civilservice.gov.uk/ Crown Commercial Service -
https://www.crowncommercial.gov.uk/agreements/rm3781 The National Archives Training and Events -
http://www.nationalarchives.gov.uk/information-management/training/
10/09/2019
7
FOI - Responding to historical information requests (Access to Public Records)
Facilitated by Helen Potter, Head of FOI Centre, The National Archives
10/09/2019
8
Howard Davies, Policy Manager
Intellectual Property
10/09/2019
9
Only one thing is
impossible to God - to
find any sense in any
copyright law on the
planet.
What do you know about…
CopyrightLicensing
Re-use
10/09/2019
10
Copyright
Crown copyright
Non-crown copyright
Third party copyright
DRO responsibilities
Understand your organisation’s copyright situation, including any delegation
Maintain information about 3rd party copyright that you hold
If you have one, make contact with your organisation’s commercial licensing team
Familiarise yourself with available guidance from TNA and IPO
Copyright 2TNA responsibilities
The Keeper manages Crown copyright and database right under Letters Patent from the Queen
Authorises all licensing under Open Government Licence terms
In rare circumstances, can appove assignment of Crown copyright to a non-Crown body, or assignment to the Crown
Will give a Delegation of Authority to a Crown body if it is able to license its own material
Advice and guidance on copyright and licensing
10/09/2019
11
Re-use of Public Sector Information
Re-use of PSI Regulations 2015
Managing Public Money
DRO Responsibilities
Generally, comply with the Regulations
Understand what material you hold that is available for re-use, & how it is being re-used
Have in place a complaints handling process
Understand your department’s public task
If you have one, make contact with your organisation’s commercial licensing team
Re-use of Public Sector Information 2
TNA responsibilities
Lead department for re-use – source of guidance on re-use for public sector bodies
Guidance on defining your public task
Advice from the policy team
10/09/2019
12
Licensing
Open Government Licence – default for Crown bodies, recommended for all UK public sector bodies
Crown bodies can only vary from OGL if they have a delegation
Other government licences are available if you have a delegation or are a non-Crown body
But remember, Government policy remains that wherever possible, public sector information should be made available for re-use under OGL terms; and the Regulations allow relatively little scope for restrictive licensing
Licensing 2
DRO responsibilities
If you have one, make contact with your organisation’s commercial licensing team
Ensure that your information is available for re-use under OGL terms wherever possible
TNA responsibilities
Maintaining the UK Government Licensing Framework
Advice and guidance
10/09/2019
13
Any Questions?
Mark Twain image by skeeze from PixabayAll other images © Crown copyright
Tom Storrar
Head of Web Archiving
UK Government Web Archive
10/09/2019
14
Who has heard of web archiving?
Who has heard of UK Government Web Archive?
1996…
…2019
Collecting the government
web estate…
10/09/2019
15
…including socialmedia
The National Archives and Web Archiving
10/09/2019
16
Comprises more than 25,000 crawls of over 4,500 websites (1996-present)
Is approximately 150tb in size, over 5 billion resources
Has a powerful full text search tool
Is fully open online and accessed by millions of users.
It is a vehicle for Collection, Preservation and for Access for digital records.
It is also a tool for contextualisation of records past, present and future.
The UK Government Web Archive
10/09/2019
17
What do we capture?
More than 800 distinct websites and social media accounts are regularly archived: those of central government public bodies, delivery channels (e.g. GOV.UK) national NHS, public inquiries, some inquests.
On these, we take everything we can on the target website: Publications, datasets, other documents Images Video, animations And all other files that make up the website
…but, web archiving operates within technical constraints. Content must be: Publicly-available Reachable by robots / crawlers
For more information, see our guidance at http://www.nationalarchives.gov.uk/webarchive/guidance/
Finding content in the web archive
Search (https://webarchive.nationalarchives.gov.uk/search/)
- Search across the full text of UKGWA, with features such as
restrict to website, date range, format
A to Z (http://www.nationalarchives.gov.uk/webarchive/atoz/)
- Most of the websites we have archived are listed here
Know the URL? Use the /*/ index
- e.g. https://webarchive.nationalarchives.gov.uk/*/https://www.gov.uk/
- Shows all the dates at which a resource was captured.
Discovery (https://discovery.nationalarchives.gov.uk/)
- Most websites are catalogued at series level
10/09/2019
18
How do you think we can work together?
Consider the web archive as a vehicle for digital transfer.
Make sure that the content is “crawlable”! Check our guidance and, if in doubt, ask our advice.
Copyright: ensure that the website copyright statement is clear. This supports future reuse and we need to know of any 3rd party content.
Review our Takedown Policy:
nationalarchives.gov.uk/legal/takedown-and-reclosure-policy/
Tell us about any new websites/web platforms/social media.
Leave content available on the web for at least six months and consider archiving timescales – it is not an instantaneous process!
Check capture before removing it from the live web.
How we can work together
10/09/2019
19
Linda Stewart
Data Protection Officer
GDPR from the archival perspective
A long tradition of making data available
10/09/2019
20
1981,1984, 1998, 2018
Research, history 33.—(1) In this section—
and statistics. “research purposes” includes statistical or historical purposes;
“the relevant conditions”, in relation to any processing of personal
data, means the conditions—
(a) that the data are not processed to support measures or
decisions with respect to particular individuals, and (b) that the data are not processed in such a
way that
substantial damage or substantial distress is, or is likely to be,
caused to any data subject….19Processing for archiving, research and statistical purposes: safeguards
This section has no associated Explanatory Notes
(1)This section makes provision about—
(a)processing of personal data that is necessary for archiving purposes in the public interest,
(b)processing of personal data that is necessary for scientific or historical research purposes, and
(c)processing of personal data that is necessary for statistical purposes.
(2)Such processing does not satisfy the requirement in Article 89(1) of the GDPR for the processing to be subject
to appropriate safeguards for the rights and freedoms of the data subject if it is likely to cause substantial damage
or substantial distress to a data subject.
2005: Access under
PRA becomes access
under FOIA = access
via DPA 1998
European
Convention
108 1981
Data Protection Act 1984
Mention Archiving in Privacy Notice
The GDPR has extra and more granular requirements to inform data subjects of the processing undertaken.
Departments are encouraged to mention transfer to the National Archives in their privacy notices, and to provide a link to the National Archives’ website.
Why has this not happened?
10/09/2019
21
John Smith
Note that the name of a person may not in itself be enough to make the person identifiable and it usually depends on the context in which it appears or the presence of supplementary information enabling a person to be identified.
However if the record is being made available online and will be exposed to search engines, the name will enable linking to other information that could identify the person, and should therefore be redacted.
John Smith’s Agricultural Census Return
Any records (paper or digital) that are indexed by name or other identifier - generally case files , should be closed until DPA no longer applies.
10/09/2019
22
Life expectancyremainsat 100 years…
…or earlier if events intervene
The hundred year ‘rule’
How do you approach sensitivity review?
Closed or redacted
Generally for 100 years
Finding aids, generally open, with caveats:
10/09/2019
23
Where ?
Who?
Why?
Locating personal data in digital
archives can be very challenging
How do you approach sensitivity review?
What happens to personal data in your records once they are here?
Archival records can still be used to take decisions about people
Data subject’s information rights
Sharing with other government departments
Digitisation and online access
10/09/2019
24
GDPR, AIPI, and BAU
Qualifications -
- Evidence of status
Rights – Subject Access Requests
Open records - we have to supply if we’re given enough information to locate –not just everything about me in the archives
Closed records – no obligation to supply but we usually do; we were set up to provide evidence.
10/09/2019
25
Right to be forgotten
Erasure
Never destroy
Remove from access under our takedown and reclosure policy
Most people just don’t want their name to come up in search engine returns out of context.
If we decide not to remove online content we advise people of their right to make a separate erasure request to the search engines.
Right to Rectification
Corrections
The National Archives cannot alter an archived public record
S 9 of the PRA 1958 – record is what it is
Evidence that a government department had wrong information about them is of value to the data subject.
We will consider annotating the record, leaving the original unchanged - if it is technically possible
10/09/2019
26
Disclosing to police
Can see open archival documents - just like anyone else
Can see who has accessed records if we are satisfied it is necessary
If they wish to see a closed record, we ask them to ask their DRO to contact you. If you’re satisfied, you request the closed record back in the normal way.
s. 29 DPA 1998 is now Sch 2. part 1. para 2.(1) DPA 2018
The Crown is not indivisible
10/09/2019
27
Personal Data Online - The privacy deathstar
Personal Data in the Archives
Engage with government
Transfer to TNA
Online
10/09/2019
28
‘Personal Data’ Online
Records about living people
not publically available online
Known to be
deceased
100 year
‘rule’
Limited access
– academic
paywall
Researchers’ DP responsibilities
Researchers are Data Controllers for any personal data they access – we have notices in reading rooms and in our rules this effect.
Although the data they see is open, they still have a duty not to use it in a manner that would cause substantial damage or substantial distress
The National Archives does not give privileged access to closed personal data (permitted under DP but not allowed under FOI)
10/09/2019
29
Recap
GDPR mostly BAU for transferring personal data to TNA
It is still transferring dept’s responsibility to locate and review personal data that could identify living individuals
Data subjects have limited rights: redaction not erasure; annotation not correction
‘Crown Indivisibility’ does not apply to data protection: TNA will not share details of people who have accessed archival records without statutory authority or a specific court order.
Police must access closed records via transferring department
Availability of personal data impacts likelihood of distress
Researchers responsible as Data Controllers for any use they make of personal data
10/09/2019
30
10/09/2019
31
Digital TransferTransfer Digital Records Project (TDR)
Paul Young: Digital Selection and Transfer
Sarra Hamdi: User Research
David Clipsham: Technical Architect
September 2019
Digital Archiving
Digital Archiving sits within the Digital Directorate.The main services within Digital Archiving:
• Digital Selection and Transfer• Digital Infrastructure and Preservation• Digital Presentation and Access
10/09/2019
32
What do we do in Digital Selection and Transfer? (DST)
DST works closely with Government Audience to carry out engagement with government departments and offers guidance, advice and support in the transfer of government’s selected born digital records into TNA’s preservation system.
We also oversee and aid with the current service for the transfer of these records and look at innovative and sustainable solutions for improvement.
Current Digital Transfer journey
Formed of a number of steps:
• Appraisal and Selection• Digital Sensitivity Review• Transfer• Ingest• Preservation and access on TNA Discovery website
10/09/2019
33
Transfer steps
We currently ask the transferring department to:
1. Complete a digital transfer form
2. Install and utilise three software tools
3. Generate a number of reports and files including a metadata schema, which is bespoke to each transferring department
4. Place a copy of their files and reports on an encrypted hard drive and deliver to TNA
WHY DO WE NEED TO IMPROVE ON WHAT WE’RE CURRENTLY
OFFERING?
10/09/2019
34
Transfer Needs
• TDR has identified a need to reduce manual intervention in the current transfer process.
• This includes the repeated exchange of Excel spreadsheets and creating bespoke metadata schemas.
• In addition to also remove the installation of client side software and transfer to a cloud platform.
Transfer Digital Records (TDR) is a TNA service for Government.
Departments who have selected their born digital records for transfer.
TDR is a cloud-based collection, preparation and transfer service that will enable the upload of these records and facilitate a more streamlined transfer, unlike the current manual process.
10/09/2019
35
TDR focuses on automating operational transfer actions.
It does not include appraisal, selection, sensitivity review or any aspects related to ‘pre’ transfer.
• No more tools to download
• Cloud-based (AWS)
• Automated metadata creation
• Automated ‘sanitisation’ – antivirus, file format identification
• Interactive, guided ‘fix-up’ to finalise your transfers
10/09/2019
36
Help us to meet your needs!
Prototype testing, wireframes, interaction design, opinions and feedback, pilot transfers
User Research
Transfer Digital Records• We are keen to continue to engage with departments through
conducting user interviews.• Have developed wireframes
Access System• Starting to think about how digital records will be displayed and
accessed by transferring bodies.• Co-design workshop on 22 October.
10/09/2019
37
Thank you for attending the training
Explain how your role and TNA roles and responsibilities are affected by PRA and Information Rights Legislation.
Recognise how to further and better collaborate with TNA.
Understand and clarify some of TNA’s key functions that affect your role.
By the end of the training you will be able to:
[email protected] [email protected]
Behind the Scenes Tour