ELRA/ELDA ELRA/ELDA EU Enlargement and Integration Workshop Arona, September 2005 Victoria Arranz 1 opean Language Resources Association ELRA/ELDA: The Importance of Sharing Linguistic Resources Victoria Arranz ELRA/ELDA 55-57 Rue Brillat-Savarin, 75013 Paris, France Tel. +33 1 43 13 33 33 -- Fax. +33 1 43 13 33 30 Email: [email protected]http://www.elda.org/ or http://www.elra.info/
31
Embed
ELRA/ELDA EU Enlargement and Integration Workshop Arona, September 2005 Victoria Arranz 1 European Language Resources Association ELRA/ELDA: The Importance.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
– Establishment of a Validation Committee (VCom)• SPEX (for speech resources): http://www.spex.nl/validationcentre/• CST (for written resources): http://cst.dk/validation/index.html
– Cooperation with key players with relevant expertise to act as validation units
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
Victoria Arranz 18
ELRA’s Production of LRs
• Spoken Language Resources:
– CHIL
– C-ORAL-ROM
– OrienTel
– Neologos
– Speecon
– TC-STAR
– ESTER
– MEDIA
• Written LRs:
– Technolangue projects:
• Lexitec
• Euradic
– Technolangue/Evalda platform projects:
• Equer
• EASy
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
Victoria Arranz 19
Administrative and Legal Issues Regarding Language Resources
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
Victoria Arranz 20
Handling of Legal Issues Regarding LRs
• Support of lawyers for basic principles on LRs licensing• One of ELRA’s priorities: simplify rel. between providers & users• Drafting of generic contracts (with responsibilities & obligations) to
encourage producers/providers to distribute• Establish what usage is allowed for LRs: R&D or Research only?• Protect providers and their LRs• Are available on ELDA’s web site: http://www.elda.org/article69.html
• ELRA:– not owner of LRs & sets fair price with owner, based on:
• Production costs• Expected revenues• ELRA’s distribution policy: try to offer discounted price for members• ELRA’s effort to obtain low prices for R&D
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
Victoria Arranz 21
Involvement in the Evaluation of Human Language Technologies
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
Victoria Arranz 22
Levels of Evaluation (ELSE)
-Basic Research Evaluation (validate research direction)
-Technology Evaluation (assessment of solution for well defined problem)
-Usage Evaluation (end-users in the field)
-Impact Evaluation (socio-economic consequences)
-Programme Evaluation (funding agencies)
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
Victoria Arranz 23
Reusability of Resources
Producer/Consumer BNT CLIR TTS SUMZ LM
Broadcast News Reuse Reuse Reuse Reuse
Cross-Lingual Information Retrieval / Extraction
Reuse
Text To Speech Synthesis Reuse
Text Summarisation Reuse Reuse Reuse Reuse
Language Model Evaluation Reuse Reuse Reuse Reuse
ELSE: Reusability of resources from one campaign to another
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
Victoria Arranz 24
ELRA’s Activity on Evaluation
• Carrying out evaluation campaigns: further involvement at:– French (Technolangue/Evalda) and – European (CLEF, TC-STAR, CHIL, etc.) levels.
• Distributing evaluation packages
• Producing or commissioning the production of needed LRs for evaluation
• Conducted with the support of an Evaluation Committee: ECom
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
Victoria Arranz 25
Evaluation Projects within ELDA
• CLEF 2004 campaign: http://clef.isti.cnr.it/
• TC-STAR: http://www.tc-star.org/
• CHIL: http://chil.server.de/servlet/is/101/
• Technolangue/Evalda: ARCADE II, CESART, CESTA, EASY, ESTER, EQUER, EVASY, MEDIA
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
Victoria Arranz 26
Promotion of the Language Technology Field
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
Victoria Arranz 27
Information Dissemination, Promotion and Awareness, Market Watch and Analysis
• Considerable effort on the promotion and dissemination of the LT field & its activities:– Partner/coordinator in several conferences,
meetings, workshops:• LREC Conference series (~900 participants)
• SCALLA 2004
• International Conference on Arabic Language Resources and Tools 2004
• Speech and Language System for Human Communication Conference 2004
• LangTech Conferences
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
Victoria Arranz 28
Information Dissemination, Promotion and Awareness, Market Watch and Analysis
• Elaboration and distribution of the ELRA Newsletter, quarterly publication dedicated to inform readers about HLT events, projects, new LRs, etc.
• Maintenance and/or setting up of a number of web sites:– ELRA: www.elra.info– ELDA: www.elda.org– LREC: www.lrec-conf.org– COCOSDA: www.cocosda.org– NEMLAR conference: www.nemlar-conf.org– LangTech conferences: http://www.lang-tech.org/– Technolangue: www.technolangue.net
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
Victoria Arranz 29
Information Dissemination, Promotion and Awareness, Market Watch and Analysis
• Public announcements posted to mailing lists
• Sponsorship activities
• Carrying out of market analysis and survey
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005
Victoria Arranz 30
Concluding Remarks
• Overview on major activities at ELRA and ELDA• Aim of ELRA/ELDA continue active role in
support of HLT community:– Supporting researchers and developers in their needs of
LRs
– Evaluation guidelines
– Validation guidelines
– Development of standards
– Working on the legal, distribution or pricing issues
– We believe: we’re moving towards the future needs of LT in an organised and productive manner
ELRA/ELDAELRA/ELDAEU Enlargement and Integration WorkshopArona, September 2005