Diego Gonzalez [email protected] Angela Hernández [email protected] GRIN-Global Pilot Data Migration for in vitro Cassava Collection GRIN-Global Workshop 8,12 February Praha, Czech Republic
Diego [email protected]
Angela Herná[email protected]
GRIN-Global Pilot Data Migration for in vitro Cassava Collection
GRIN-Global Workshop8,12 February
Praha, Czech Republic
Plan
• Rationale behind• Data Migration Plan• Achievements and challenges• Synchronization between app for tablet and GRIN-Global using web services• Outputs• Conclusions• Issues for a successful adoption• Workplan phase II
CIAT –Genetic Resources ProgramGermplasm registered into Multilateral System of the Treaty
Crop Conservation Rank No. of Taxa No. of origin country
No of Accessions
Bean(Phaseolus)
Seeds 1 46 110 37.560
TropicalForages
Seeds 1 734 75 23.140
Cassava(Manihot)
in vitro 1 33 28 6.643
813 67.343Germplasm accessions as International Public Goods
Rationale behind
Over the last 15 years CIAT has developed an "in house" genetic resources information system, which makes data about the collections available on the web, and supports the genebank workflows.
Software (data entries, reports) technology is becoming outdated Poor scalability and problems with the new versions of operating systems and web
applications.
Evaluate an alternative for adoption: GRIN-Global• Pilot data migration for in vitro Cassava collection• To capitalize on possible community of practice
GRIN-Global Pilot Data Migration for in vitro Cassava Collection
Duration: 1 Year (2015)The objective of this Project is to develop a plan of data migration from the CIAT-GRP information system to GRIN-Global and integrate one of our mobile applications with this system in view of the possible adoption
Work team:• in vitro Cassava Genebank Staff (2): Coordinator, Assistance• documentation & databases Genebank Staff (2): Coordinator, Systems Analyst
Achievements and Challenges
Data migrated and validated
Genebank processes
Introduction/Acquisition Indexation Conservation Regeneration Safety duplication Characterization / EvaluationsDistribution
Data Mapping /Migration
requirements
CIAT GRP Cassava
Database
GRIN-
Global
data dictionar
y
Genebank documentation need
s
Source DBStaging tables
GG DB
Transform
LoadExtract
Cleansing
Tool developed with the rules of migration Curation data
• Disaggregate tables
• Duplicate data• Data with special
characters, misspelled
• Data consistency• Integrity
• Definition of Inventory Maintenance Policies for in vitro Cassava Collection• Changes in the names of the dataviews according with the genebank handling• Inventory definitions• Definition of code values (actions names)• Translation to Spanish the field names• Added trigger to GG Database to enable automatic indexation availability• Modifying SQL in some Dataviews
Add the third administration in geography, adapt the format of genebank accessions and correction the cooperator site on the website
• Add unique indexes in GG Database: many records from source database are composed of more than one attribute that makes them unique, because in bringing them to GG there were duplication problems
Achievements and Challenges
• Process selected• Requirements• Evaluate the
connectivity GRIN-Global
• GG schema
Analysis
• Mobile app
• Web services app
Design / Develop
Test and validations
Test User validationImplementation
Mobile Synchronization with GG
Mobile data capture and barcode/QR codes in order to support the data quality
GRIN-Global Mobile TabletMobile application allows users to capture data related to genebank
actions such as monitoring, subculture evaluations, etc.
GG Database
Invitro_Tablet
Outputs
Pilot data migration• Document Plan data migration • Tool for data migration (Java application stand
alone)• Mapping rules• Extraction• Transformation• Load
• Document Data Mapping• Document Migration validations• Document recommendations
Mobile synchronization with GRIN-Global• Mobile application for Android Tablet
• Register inventory actions• For one selected process for this pilot
• Web services for Synchronization (Java RestFul)• Technical documentation• Source code
Conclusions
• Migration all available data was successfully achieved and valid in GRIN-Global• Establish a plan and lessons learned for possible adoption • GG offers more and useful attributes for collections documentation
• Usability of search tool is very low, therefore it needs to be improved• As commonly observed by users, the usability of GG to manage Cassava
collection has an acceptable rating although there are many observations and recommendations to get an optimal management of clonal collections• Users perceive the adoption has a high learning curve
Issues for a successful adoption
GRIN-Global should improve in usability:• Dataviews names that are defined in the Curator Tool also reflected in the tabs or views of the
Search Tool• All labels must be customizable• The pseudo SQL search tool should keep the names of the label dataviews and not the
attributes• All labels in wizards meet the appropriate sizes for your text is fully visible• Admin tool should allow to create and update indexes• All codes values share customizable, in case of any default this should be documented
• E.g.: low inventory is by default. Auto deduction is performed in inventory as well• Expand the number of characters in the acronym (acronym for institution in Cooperators)• Search tool should allow to hide columns.
Issues for a successful adoption
CIAT side should meet the needs of usability for the in vitro genebank :The concepts of GRIN-Global are clearly oriented to the management of seed collections which requires the completion of certain adaptations for the management of in vitro collection for the adoption of this system.• Improve usability and make adjustments necessary to facilitate data
management for in vitro collection• Make adjustments to the dataviews, triggers• Tablets and web services• Using tablets to facilitate the identification of management QR codes
Issues for a successful adoption
• Expose to the GRIN-Global community the needs of tool improvement• Management requirements in terms of functionality should be clear (that I
like) -> Community GRIN-Global, Trust, USDA• Avoid changing the source code of GRIN-Global• Maintaining an "organic" scheme that allows for growth with the use of web
services to meet the needs of data collection with mobile solutions (Tablet applications)
• High demand for Training and Support (at the beginning)• Licensing costs for GG server are not assumed by CIAT; they are borne by the
Genetic Resources Program.
Interfaces with existing systems
Pilot Data MigrationPhase II
Continuity with the pilot of the GRIN-Global cassava collection in vitroWe need to fill gaps in GRIN-Global in order to meet the needs of usability in vitro bank• Improve usability and make adjustments necessary to facilitate data
management for in vitro collection• Make adjustments to the dataviews, triggers• Data entry using tablets and web services• Using tablets facilitate the identification of management QR codes
Activity Timeline Output
User Practical sessions February 2016 User feedback
Analysis and planning of usability requirements
March 2016 Document of analysis requirementsPlan of implementation
Design and develop interfaces (web services, app mobile) and adaptations (dataviews, triggers) according to the requirements
April – September 2016 Interfaces developedAdaptations developedTechnical documentation
Tests October-December 2016 Tests and correctionsTechnical documentation
Transition planning & maintains parallel systems
November –December 2016 Ensure resources (Licensing costs, server)Document of transition plan
Review and analyze the processes of management of seed collections
October –December 2016 Document of analysis requirements
Phase II