© 2006 Open Grid Forum Build, Test and Certification of Grid and distributed software Community Group Current practices and short term plans in Building,

© 2006 Open Grid Forum

Build, Test and Certification of Grid and distributed software Community Group

Current practices and short term plans in Building, Testing and Certifying Grid software

Marc-Elian BéginETICS Project

CERN

2© 2006 Open Grid Forum

Content

• Agenda• Charter and Group definition• State-of-the-art in Build, Test and

Certification

3© 2006 Open Grid Forum

Agenda

• Title: Current practices and short term plans in build, testing and certifying Grid software

• Introduction• VDT/Condor (Becky Gietzel – UoW)• Globus (Charles Bacon – University of

Chicago)• gLite (Laurence Field – CERN)• Discussion

4© 2006 Open Grid Forum

Presentation topics

Here are the topics proposed to the presenters:• Challenges in building and testing complex Grid

software• Overview of current release procedure, focusing on

how current Grid software is being built and tested• Does automation play a role in current build and test

procedures? If yes, what?• If we had more time and effort to invest, where

should we invest it?• Is there anything our community could do to help

improving participants build and test system and procedures?

5© 2006 Open Grid Forum

Charter definition

• Focus/Purpose• “provide a platform for exchange and

gather best practices on the topic of build, test and certification of Grid software”

• Co-chairs:• Peter Couvares: University of Wisconsin-

Madison, Condor/NMI• Marc-Elian Bégin: CERN, ETICS Project• Looking for a Co-chair from Industry

6© 2006 Open Grid Forum

Roadmap

7© 2006 Open Grid Forum

Milestones

Milestone Title Date

M1 Workshop on current practices and short term plans in building and testing Grid middleware and Grid applications

GGF19

M2 Presentation of summary of current practices and short term plans in building and testing Grid middleware and Grid applications – Draft Best practices in building and testing Grid middleware and Grid applications document

GGF20

M3 Workshop on current practices and short term plans in certifying Grid middleware and Grid applications

GGF21

M4 Presentation of summary of current practices and short term plans in certifying Grid middleware and Grid applications – Draft Best practices in building and testing Grid middleware and Grid applications document

GGF22

M5 Final document on best practices in building, testing and certifying Grid middleware and Grid application software

GGF23

This needs to be updated/reviewed!!

8© 2006 Open Grid Forum

Scope

• Focused on current practices and short term plans

• Discuss latest tools and techniques• This group is not there to mandate how

Grid middleware and application software should be built, tested and certified

• We hope that through its group member, the group will both represent academia and industry

9© 2006 Open Grid Forum

Deliverable

• Final output of the group will be a single document:• Best practices in building, testing and

certifying Grid middleware and Grid application software

10© 2006 Open Grid Forum

Exit Strategy

• The mission of this group is to report on current knowledge in the field of build, test and certification for Grid software

• Once the document is released and accepted, the goal of this group will have being reached

• At that point, the group will either be dissolved or a new charter will have to be defined

11© 2006 Open Grid Forum

State-of-the-art

• Different efforts are taking place regarding “Build, test and certification”:• ETICS• NMI• OMII-Europe/UK

Build, test and certification of Grid software - OGF19, Chapel Hill, USA INFSOM-RI-026753

ETICS in a nutshell

• ETICS stands forETICS stands foree-Infrastructure for -Infrastructure for TTesting, esting, IIntegration and ntegration and CConfiguration of onfiguration of SSoftwareoftware

• Project started on January 1Project started on January 1stst, 2006 and has a duration , 2006 and has a duration of two yearsof two years

• Goal is to provide efficient automated tools for building Goal is to provide efficient automated tools for building and testingand testing

• ETICS is born from the experience of developing, ETICS is born from the experience of developing, integrating and testing grid and distributed softwareintegrating and testing grid and distributed software

Build, test and certification of Grid software - OGF19, Chapel Hill, USA INFSOM-RI-026753

The ETICS partners

Build system, software

configuration, service infrastructure,

dissemination, EGEE, gLite, project coord.

Software configuration, service infrastructure, dissemination

Web portals and tools, quality process, dissemination, DILIGENT

Test methods and metrics, unit testing tools, EBIT

The Condor batch system, distributed testing tools, service infrastructure, NMI

Build, test and certification of Grid software - OGF19, Chapel Hill, USA INFSOM-RI-026753

Service Architecture

Build/TestArtefacts

Web Application

ReportDB

ProjectDB

NMI Execution Engine

Clients

Web Service

NMI ClientWrapper

Via browser

WNs ETICS Infrastructure

Build, test and certification of Grid software - OGF19, Chapel Hill, USA INFSOM-RI-026753

Features of the ETICS Service

• Out-of-the-box Out-of-the-box automatic build/testautomatic build/test system system• Multiplatform supportMultiplatform support for development and testing for development and testing• Powerful and flexible Powerful and flexible automatic dependency automatic dependency

managementmanagement (internal and external dependencies) (internal and external dependencies)• Trigger coding convention checks, unit test, documentation Trigger coding convention checks, unit test, documentation

tools and collect and publish the resultstools and collect and publish the results• Possible to build everything Possible to build everything from sourcefrom source or use pre-built or use pre-built

binary packagesbinary packages• Designed to Designed to support several Version Control Systemssupport several Version Control Systems• Possible to Possible to register artefacts on the repositoryregister artefacts on the repository• Publishes run-time configuration informationPublishes run-time configuration information such as such as

environment variables, runtime dependencies, etc …environment variables, runtime dependencies, etc …• Produce Produce different package formatsdifferent package formats (rpms, tar, msi, debs) (rpms, tar, msi, debs)• Produces Produces rich build and test reportsrich build and test reports

Build, test and certification of Grid software - OGF19, Chapel Hill, USA INFSOM-RI-026753

Reports

2006 OpenGridForum

OGF19 - Chapel Hill, NC

NMI execution engineNMI execution engine

● NMI is an execution engine internally used by ETICS to manage remote build and test jobs on different platforms

● NMI is a layer built on the top of Condor● Condor is a middleware distribution that “provides

mechanisms and policies supporting High Throughput Computing (HTC) on large collections of distributed computing resources”

● Both NMI and Condor are developed and supported by our partner, the University of Wisconsin in Madison, USA

2006 OpenGridForum

OGF19 - Chapel Hill, NC

NMI Web interfaceNMI Web interface

OMII-UK Mission…

OMII-UK aims to provide software and support to enable a sustained future for

the UK e-Science community and its international collaborators

•Promote the use of good-quality open-source software•Reduce the risk of moving to new e-infrastructure world•Recognise distinct user communities: by domain and function

Need A Support Infrastructure… Collaborative Open-Source Software

Developer focussed: Sourceforge, NeSCForge Community Repository (http://www.omii.ac.uk)

Software being used by the community Contributed software from community

May have variable quality (e.g. Freshmeat) May claim standards compliance Portability and dependencies key for Grid deployment

21

Metrics to aid software selection Portability:

Build on different platforms Deploy and run on dynamically deployed

infrastructure Standards Compliance: WSDL, XML, …

Jobs: OGSA-BES, JSDL, HPCP Accounting: RUS, UR Data Access: WS-DAI, WS-DAIX, WS-DAIR

Collaboration with OMII-Europe, ETICS & NMI