EGC2005 European Grid Conference,Amsterdam, 14-16 Feb 2005 (Semantic Grid) Services + Semantic (Grid Services) Professor Carole Goble The University of Manchester, UK e-Science North West Regional Centre my Grid, OntoGrid, Knowledge Web GGF Semantic Grid Research Group
44
Embed
EGC2005 European Grid Conference,Amsterdam, 14-16 Feb 2005 (Semantic Grid) Services + Semantic (Grid Services) Professor Carole Goble The University of.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
EGC2005 European Grid Conference,Amsterdam, 14-16 Feb 2005
Professor Carole Goble The University of Manchester, UK
e-Science North West Regional CentremyGrid, OntoGrid, Knowledge Web
GGF Semantic Grid Research Group
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
“The ongoing convergence between Grids, Web Services and the Semantic Web is a fundamental step towards the realisation of a common service-oriented architecture empowering people to create, provide, access and use a variety of intelligent services, anywhere, anytime, in a secure, cost-effective and trustworthy way.”
Next Generation Grids 2
Requirements and Options for
European Grids Research 2005-2010 and Beyond
EU Expert Group Report July 2004
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
“To realise the Next Generation Grid requires semantically rich information representation, the exploitation of knowledge, and co-ordination and orchestration that is aware of context and task”
David Snelling, NextGRID
Building Intelligent Grid Services
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Knowledge everywhere already…its called metadata
• State properties of a resource– Data in a purchase order– Current usage agreement for resources on a grid– Metrics associated with work load or performance on a Web server
• Declarative descriptions of data sets, codes, services, workflows– Typing and classifying service or workflow inputs, outputs, goals, …
– Access rights to resources
• Declarative descriptions for, and records of, service interactions– event notification topics, provenance trails, monitoring records
• Policy and profile encoding– personal profiles and security groupings
• Used in – job control; workflow composition, semantic dataset integration, resource brokering,
resource scheduling, problem solving selection, intelligent portals…
• GGF WG-CMM, CIM, GIS, MDS, ….
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Knowledge and the knowledge producing & consuming protocols & patterns are already in Grid
Middleware and Grid Applications.
Embedded in middleware code, in schemas, in catalogues, in applications and in practice.
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Bringing knowledge into the light
Managing and operating a Grid intelligently requires:1. Knowledge
– Knowledge about the state and properties of Grid components, and their configurations
– Mechanisms for interpreting that knowledge
2. Intelligently acquiring and refreshing knowledge
3. Use it practically in decision making.
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Convergence
• Semantic Web Technologies
• Semantic Web itself
Grid services
Sem
antic
Web
Ser
vice
s
Semantics for the Grid
Grid services for Semantic Web
Plum
bers
DevelopersWeb
Services
Grid Semantic
Weband Agents
Semantic Grid
Engineers
Aes
thet
ics
Theoreticians
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Semantic Web mechanisms
MetadataAnnotationRDF
OntologiesOWL/RDFS
WebXML, URI, UniCode
Deep webPHP, WS*
RulesSWRL
p -> a; p=a
p -> a; p=a
p -> a; p=a
p -> a; p=a
p -> a; p=a
Trust
Search engines and filters
Applications
• Uniform naming scheme.
• Metadata – descriptions of properties and content
• Metadata – glue linking resources together
• Ontologies – interpretation of metadata for people and processes.
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Making Knowledge Explicit
OWL Web Ontology Language
RDF Resource Description Framework
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Make knowledge explicit.
Make knowledge protocols explicit.
Describe some of these declaratively so they might be exchanged and machine processed.
Metadata data – here is what it is and/or how it relates to something else
Ontologies / controlled vocabularies – we understand each other
OntologyMetadataassertion
Object
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Knowledge Stakeholders
Com
puter
ScientistsScientific
Applications
Grid Middleware
Grid platform
and resources
Security policies
standards
Scientists
Ser
vice
Providers
Knowledge for Grid Applications
Knowledge for the operation of the Grid
Sources of Knowledge
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Upper domain generic services
Web Service Resource FrameworkWeb Service-Notification
WS-I+
Web Services
Grid Domain Applications
Collective services
Base services
System services“P
lum
bin
g”
Operational Knowledge
Application Knowledge
knowledge worker'sapplications and tools
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
The Semantic Grid is an extension of the current Grid in which information and services are given well-defined and explicitly represented meaning, better enabling computers and people to work in cooperation
Semantics in and on the Grid
EGC2005 European Grid Conference,Amsterdam, 14-16 Feb 2005
Time to move beyond slogans.
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Semantic Grid roadmap
• Exploit the languages from the Semantic Web and other.• Specifying and developing the architectural components and
tools forming the infrastructure of the Semantic Grid and define the architecture of the (Semantic) Grid.
• Prototyping applications using the languages, the components and defining the content necessary.
Developing in parallel, yet are interdependent. A maelstrom of research coupled concurrently with standards
activity, and early experiments and prototypes running alongside (some) commercial developments.
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
CombeChem
Semantic Grid trajectory
Time
Efforts
Implicit Semantics1st generation
SRB
Implicit SemanticsOGSA generation
GGF Semantic Grid Research Group
Many workshops
Systematic Investigation Phase
Specific experimentsPart of the Architecture
Dagstuhl Schloss Seminar
Grid Resource Ontology
Many projects
Pioneering PhaseAd-hoc experiments, early
pioneers
SDK
Demonstration Phase
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Knowledge Aware Grid Services
KAGS
Knowledge Aware Grid Services
KAGS
Grid CompliantKnowledge Services
GCKS
Grid CompliantKnowledge Services
GCKS
Grid Aware Knowledge Services
GAKS
Grid Aware Knowledge Services
GAKS
Three strands
(Semantic Grid) Services
Semantic (Grid Services)
And how all these services play togetherProfiles, Protocols, Patterns, Policies
P4P4
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Middleware
Functionality: Existing operations for interaction with a knowledge serviceMetadata: How fast? What language is supported?Lifetime Management: Factory methods, creation of resources
Knowledge: Additional port types relating to knowledge, for example discovery.
Use of Grid infrastructure within the implementation of the service.
Three strandsKnowledge Aware
Grid ServicesKAGS
Knowledge Aware Grid Services
KAGS
Grid CompliantKnowledge Services
GCKS
Grid CompliantKnowledge Services
GCKS
Grid Aware Knowledge Services
GAKS
Grid Aware Knowledge Services
GAKS
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Grid Compliant Knowledge Services
• Take today’s knowledge services from the Semantic web and other worlds
• What does it mean for them to be Grid Services?
• What are the state properties of an ontology grid service?
• What are the lifetime management properties of an ontology grid service?
• What is a virtualised and dynamically provisioned ontology service, (metadata store, metadata annotator, reasoner …) ?
• How will an ontology grid service and a metadata grid service play together?
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Grid Compliant OntologiesResource • A distinguishable unique identity and lifetime (usually static)• Maintains a specific state that can be materialized • May be accessed through one or more Web Services• Artifact - a file, XML document, database, usually real (could be virtual).
Could be compound.
Service• Base interface for inspecting and manipulating an ontology• A well defined “Ask-Tell” API: getSubConcepts(concept),
>gi|19747251|gb|AC005089.3| Homo sapiens BAC clone CTA-315H11 from 7, complete sequenceAAGCTTTTCTGGCACTGTTTCCTTCTTCCTGATAACCAGAGAAGGAAAAGATCTCCATTTTACAGATGAGGAAACAGGCTCAGAGAGGTCAAGGCTCTGGCTCAAGGTCACACAGCCTGGGAACGGCAAAGCTGATATTCAAACCCAAGCATCTTGGCTCCAAAGCCCTGGTTTCTGTTCCCACTACTGTCAGTGACCTTGGCAAGCCCTGTCCTCCTCCGGGCTTCACTCTGCACACCTGTAACCTGGGGTTAAATGGGCTCACCTGGACTGTTGAGCG
urn:lsid:taverna:datathing:15
..BLAST_Report
rdf:type
urn:lsid:taverna:datathing:13
..similar_sequences_to
.. nucleotide_sequence
rdf:type
service invocation
..created_by
workflow invocation
workflow definition
experiment definition
project
person
group
service description
organisation
..described_by
..run_during
..invocation_of
..part_of
..works_for
..part_of
..part_of
..author
..author
..run_for
A B
..masked_sequence_of
..filtered_version_of
Relationship BLAST report has with other
Other classes of information related to BLAST report
Keeping track
Jun Zhao, Chris Wroe, Carole Goble, Robert Stevens, Dennis Quan, Mark Greenwood, Using Semantic Web Technologies for Representing e-Science Provenance in Proc 3rd International Semantic Web Conference, Hiroshima, Japan, Nov 2004
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Grid Aware Knowledge Services
• What is the architecture of distributed knowledge services?• Can Grid platforms realistically provide a robust distributed
stateful computing platform for agent systems?• OGSA-DAIS for RDF repositories.• Replica location service for replicated knowledge services.• Secure file transfer for metadata.• Event notification for metadata or ontology updates.• Authentication and authorisation for updates.• Metadata updated by workflows; • Security and RDF! • Distributed reasoning !!
• Depends on the availability of these Grid services.
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
WS-Notification and Semantic Integrity
• Subscriber – an Annotation Service - indicates interest in a particular (semantic) topic – Ontology Version change - by issuing a subscribe request
• Subscriptions are WS-Resources– Various subscriptions are possible
• Notification may be triggered by:– WS Resource Property value changes– Other “situations”
• Broker examines current subscriptions • Brokers may
– “Transform” or “interpret” topics <- knowledge!
Broker
Subscriber
Publisher
subscribe
subscribe
S S S
notify
notify
notify
notify
Metadata service
Ontology Service
Adapted from Dr. Daniel Sabbah, IBM, Globus World 2004.
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Obstacles to Overcome• Semantic what?• Compelling use cases
– “Revolution is only possible when it becomes inevitable”– Niche activity.
• No content or hard to get the content!– Ontology acquisition. Pain-free metadata acquisition.
• Baggage of communities– Different agendas– Hendler Principle: “A little semantics goes a long way”.– Failure to mainstream – agents
• Instability of both platforms– Middleware hard to use and incomplete– Off putting to “the other side”– Deployment, research, development, applications and standardisation all happening
together
• Whither Grid Architecture?
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
MDA and the Grid• Where is grid?
– current grids are on a platform level
– grids compatible with service oriented architectures are on ASM level
• Challenge:– should grids do better than
SOA based on Web Services?– automatic transformation of
PIM models into a grid specific ASMs and PSMs
• Opportunity:– transform a business level
architectures to Web Services, Grid, whatever-comes-next platform
Computation Independent
Model
PlatformIndependent Model
ArchitectureSpecific Model
Platform Specific Model
working system
e.g. OGSA
e.g. GT4, gLite
manual
automatic
automatic
semi automatic
Prof.dr. Žiga Turk
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Map concepts between ontologies
• Unicore and GLUE have different philosophies for describing resources :-(• In Unicore, the resources are described in terms of resource requests • In GLUE, resources are described in terms of the availability of resources.
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Source of metadata and knowledge
• Grid Resource Ontology• Activation Energy• Metadata mining• The network effect – service providers rule• Return on investment for service providers and users• Applications keep it real: listen to users to take short cuts.
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
Semantic proportionsspeculation – no empirical foundation at all
Resource
Generic Grid
Application
EGC2005 European Grid Conference, Amsterdam, 14-16 Feb 2005
• Knowledge aware grid servicesGrid Knowledge,
Agents & the Semantic Web
Overcoming community divisionsGrowing pains of middleware
Make it easier not harder or more “interesting”A little semantics goes a long way