PerfSONAR developer meeting - in Ann Arbor 08 Ipê Network Monitoring Service MonIPÊ José Augusto Suruagy Monteiro [email protected] http://wiki.monipe.rnp.br/monipe
Dec 31, 2015
PerfSONAR developer meeting - in Ann Arbor 08
Ipê Network Monitoring ServiceMonIPÊ
José Augusto Suruagy [email protected]
http://wiki.monipe.rnp.br/monipe
PerfSONAR developer meeting - in Ann Arbor 08
MonIPÊ Experimental Service
• Main Objective:– Provide monitoring information to all kind of users
• Target audience:– RNP and NRENs users.
• Experimental phase:– Initial infrastructure being deployed throughout several Ipê
network nodes– January thru December 2008
PerfSONAR developer meeting - in Ann Arbor 08
Specific Objectives
1) Traffic characterization via flow measurements;2) High accuracy network performance measurements
(one way delay, jitter, losses, and available bandwidth);
3) Regular connectivity tests;4) Last/first mile performance measurements;5) Network performance verification and observation
environment.
PerfSONAR developer meeting - in Ann Arbor 08
User Categories
• Users in general:– Visualization of the results obtained from regular tests,– Use of recommendation tools, and– Access network tests.
• Advanced users:– Demand for customized performance tests, and– Observation for collaborative experiments
• High speed transfers, Overlay WG, Climate Information, EELA 2 (E-Science Grid Facility), LHC, etc.
• Network Management and Operators users
PerfSONAR developer meeting - in Ann Arbor 08
Activities
• Service deployment– Active monitoring infrastructure deployment– Passive monitoring infrastructure deployment– Service portal deployment– Measurement analysis service deployment– Support service deployment– Deployment evaluation
• Dissemination:– Kick off meeting (25/5/08)– Presentation at WRNP (27/05/08)– Workshop (20-24/10/08)
• AUP definition• Software development and improvement• Service continuity plan
PerfSONAR developer meeting - in Ann Arbor 08
Infrastructure being deployed
PerfSONAR developer meeting - in Ann Arbor 08
MPs Locations
PerfSONAR developer meeting - in Ann Arbor 08
Hardware at each location
{mp2 | owamp}.pop-XX.rnp.br
{mp1 | bwctl}.pop-XX.rnp.br
{mp3 | ndt}.pop-XX.rnp.br
GPS synchronization kit
PerfSONAR developer meeting - in Ann Arbor 08
Central Servers
SQL-MA, LS and AS
CactiSONAR and RRD-MA
Flows
PerfSONAR developer meeting - in Ann Arbor 08
• MPs:– CL-MP version 2.0– Bwctl version 1.2a
• Iperf version 2.0.4
– Owamp version 3.0c– NDT version 5.5.4a
• MAs:– RRD-MA– SQL-MA version 2.0
• LS version 1.2• CactiSONAR version
0.8.7b
• Flows:– NFDUMP version 1.5.7– NFSEN version 1.3– Flow Selection and
Aggregation MA– Flow Subscription MP
Software being Deployed
PerfSONAR developer meeting - in Ann Arbor 08
Deployment Process
• Collaborative effort with technical staff of each PoP• Installation process described on our Wiki• Videoconference as a kick off• Support via RT and mailing list• Centralized homologation• Current status:
– 11 locations already homologated– 2 in the process– 5 delayed
• We hope to finish deployment by next week
PerfSONAR developer meeting - in Ann Arbor 08
Active Measurements
• Tools:– Owamp and Bwctl (via CL-MP)– CactiSONAR: scheduling and visualization
• Proposed schedule for regular tests:– OWAMP: full mesh every 5 minutes– BWCTL - TCP: along the backbone links every hour
PerfSONAR developer meeting - in Ann Arbor 08
Passive Measurements
• Netflow data using NFDUMP and NFSEN• Coverage:
– 10 major routers (BA, CE, DF, MG, PE, PR, RJ, RS, SC, SP)
• URL: – http://flows.monipe.rnp.br/monipe/nfsen/nfsen.php
• Services currently under test:– Flow Selection and Aggregation MA– Flow Subscription MP
PerfSONAR developer meeting - in Ann Arbor 08
SERVICES IN DEVELOPMENT
PerfSONAR developer meeting - in Ann Arbor 08
CL-MP
• What’s new (expected for MDM 3.1 release):– Standard modifications for 3.1 (syslogging, self-test, new web
admin, new file structure)– SelfTest for CL-MP was implemented in a “Nagios check-like”
way. Shell scripts can be created to check whatever network operators of the domain think needs to be tested.
– OWAMP Summarized tests
• Status– Version 2.0 is being deployed on all RNP PoPs– We expect version 2.1 (with the new functionalities above) to
be deployed by the end of the month.
PerfSONAR developer meeting - in Ann Arbor 08
CactiSONAR integrated environment
Núcleo do CACTI
Arq. RRD Conf. MySQL
CACTI
CACTISonar
MP
MP
MP
Roteador
Switch
Servidor
GERÊNCIA
Interface
Admin
MARRD
perfSONAR-UI
Usuário
perfSONAR-UI
Usuário
PerfSONAR developer meeting - in Ann Arbor 08
CACTISonar
• What’s new (expected for 0.6 release):– Testing being scheduled in CL-MP version 3.0 or newer and
retrieving information from MA-SQL.– SelfTest is expected for further releases.
• Status– Version 0.5 is being deployed on RNP environment– Version 0.6 is expected to be deployed by the end of the
month.
• Goals (newer versions) – SelfTest– Authentication Service Integration in CL-MP and the built-in
RRD-MA– Lookup Service Integration
PerfSONAR developer meeting - in Ann Arbor 08
ICE (Internet computer network Eye)
• Description:– Developed since December 2005 to fulfill RNP’s Measurement
WG demands;– A dynamic visualization client for network measurement
services and data;– Developed using Java, Apache Axis, JFreeChart and OSGi.
• New functionalities:– Drag ‘n drop of network measurement access and
visualization bundles;– New Bundle functionalities;– Installation using IzPack;
http://wiki.nuperc.unifacs.br/ice
PerfSONAR developer meeting - in Ann Arbor 08
ICE (Internet computer network Eye)
• Status:– Access and Visualization Bundles can be installed and uninstalled
easily;– The development of new bundles can be made using the interfaces
provided by the FLAVOR framework;– Bundle live cycle management is provided by the Felix OSGi platform;– Visual Icons make the network bundles more attractive to the users.
• Goals:– Provide better bundles integration;– Provide better resources for the development of new network
measurement bundles;– Develop new end-user friendly bundles.
http://wiki.nuperc.unifacs.br/ice
PerfSONAR developer meeting - in Ann Arbor 08
ICE (Internet computer network Eye)
http://wiki.nuperc.unifacs.br/ice
PerfSONAR developer meeting - in Ann Arbor 08
Authentication Service
• CAFE (FEderated Academic Community)– Shibboleth 1.3 (and
simpleSAMLphp Shib 1.3 in RNP)– At the beginning only RNP’s IdP
will conform to eduGAIN.– RNP’s IdP will be a central
common Identity Provider for user’s without an AAI.
• ICPEDU (Brazilian Research and Education PKI)
– The certificates for the CAFE servers will be issued by a subordinate AC of ICPEDU root AC
PerfSONAR developer meeting - in Ann Arbor 08
Authentication Service (status)
• Authentication Service status at RNP– There is an interim AAI at UNIFACS
• Shibb IdP and SP with simpleSAMLphp conform to eduGAIN RC2• SASL CA
– Both services use certificates issued by eduGAINCA and eduGAINOCA
• There is an AS currently in test at RNP
PerfSONAR developer meeting - in Ann Arbor 08
Authentication Service (status)
• Tests– IdP RNP
• Test with https://kelimutu.switch.ch/aai • Test with BE of Ajay Daryanani • Is there a Web-based application that access a AS protected
pSR?
– SASL CA • can’t publish the metadata in http://mds.rediris.es:8080 and the
perfSONARUI show error with another MDS• But the deployment seems good
– perfSONAR AS (not yet tested)• Waiting for the metadata publication in the MDS accessible by
perfSONARUI (e.g. http://mds.rediris.es:8080).
PerfSONAR developer meeting - in Ann Arbor 08
Authentication Service
• Planned scenario (soon)– Move the services to RNP– Certificates Issued by the
ICP-EDU AC.– Integration of all services
• Desired scenario– All users federated through
their institutional AAI.– All AAI conforming to
eduGAIN.
PerfSONAR developer meeting - in Ann Arbor 08
Additional Activities
• MENTOR – Recommendation Tool• TopS – Topology Service• RP – Resource Protector (GigaIQoM)
PerfSONAR developer meeting - in Ann Arbor 08
Mentor Recommender Tool
http://tools.nuperc.unifacs.br/webmentor
PerfSONAR developer meeting - in Ann Arbor 08
Main concepts and current features
• Concepts– Provides recommendations to end-users
• Network manager, users in general– Suggests the network use based on:
• Users’ profiles (EduPerson’s Attributes), Application features, Network performance– Client-Server basis
• Server process recommendations, maintain user’s information• Client interacts with the users, present recommendation and get feedbacks
• Features– Performs last mile measurement tests
• NDT (Modified version of the NDT Client) and Ping– Incorporates “RNP-topology service”
• It finds the nearest PoP and perform NDT and Ping tests– Supports LDAP-based Authentication
• Presents different views based on EduPerson attributes– Ontology-base application classification– Support for internalization (versions in Portuguese and English)
PerfSONAR developer meeting - in Ann Arbor 08
General architecture
PerfSONAR MAs
MonONTO + Measurement
rules
LDAP-Based AA
MENTOR WEB
Besides Ps MAs requests also on last mile demand tests
Done
On going
Future
Web Services for others
applications
JColibri Framework for Case-Based
reasoning
EduPerson-Based Models of users
Identification
PerfSONAR developer meeting - in Ann Arbor 08
Screenshots of beta-version
PerfSONAR developer meeting - in Ann Arbor 08
Future directions
• AA through AS– Matches of: User x Application type x Network performance– Ontology classification– Case-based reasoning
• What the others in the same situation said?
• Reasoning considering– Definition of a case
• User’s profile and preferences.• Application’s features• Network Metrics
– Incorporating the Java-based Jcolibri framework for case reasoning
• Ping support • Recommendation based on the backbone measurements
• First release scheduled for October/08
PerfSONAR developer meeting - in Ann Arbor 08
Resource Protector Service
• Developed in a related project.• Proof of concept:
– Description (in Portuguese): http://wiki.nuperc.unifacs.br/gigaiqom/index.php/Test
– API: http://wiki.nuperc.unifacs.br/gigaiqom/index.php/API_do_Servi%C3%A7o_de_Prote%C3%A7%C3%A3o_de_Recursos
– Code: http://wiki.nuperc.unifacs.br/gigaiqom/uploads/9/9d/Perfsonar_RP.jar
PerfSONAR developer meeting - in Ann Arbor 08
International Testing
NREN NREN
RNPNREN
NREN
Géant 2Internet
2
ESNet
Clara
...
...
.
.
.
PerfSONAR developer meeting - in Ann Arbor 08
International Testing
• Regular tests from RNP (São Paulo), through Red Clara to:– Internet 2 (Atlanta?)– Géant 2 (Madrid)– ESnet (through Internet2?)
• How often?
PerfSONAR developer meeting - in Ann Arbor 08
• Deployment of gLS• Topology Service:
– Topology discovery– Defined services
• AS– eduGAIN x I2 solution
• MDM releases:– CL-MP– Testing
• International Testing– Planning– Metrics composition
• Flow services:– SURFnet’s testing– G3: packet capture
Next Steps or Pending Issues
PerfSONAR developer meeting - in Ann Arbor 08
UFSC:• Edison T. L. Melo• Guilherme E. Rhoden • Guilherme Fernandes• Murilo Vetter
UNIFACS:• Dimitri Anjos • Herbert M. Souza• Ivo Koga• Suruagy• Leobino Sampaio• Rafael Costa• Patrícia Dourado
• RNP:– Iara Machado– Ana Lucia de Moura– Alex Soares de Moura
(NOC)– Leonardo Carneiro (NOC)
Team
PerfSONAR developer meeting - in Ann Arbor 08
THANKS!