1 IEPM/PingER IEPM/PingER Internet End-to-end Performance Monitoring and the PingER project Internet End-to-end Performance Monitoring and the PingER project Warren Matthews and Les Cottrell (SLAC) National Collaboratory Middleware and Network Research Project Review, ANL, August 18-20, 2003.
48
Embed
IEPM/PingER Internet End-to-end Performance Monitoring and the PingER project
IEPM/PingER Internet End-to-end Performance Monitoring and the PingER project. Warren Matthews and Les Cottrell (SLAC) National Collaboratory Middleware and Network Research Project Review, ANL, August 18-20, 2003. Overview. A little History Evaluate the progress Assess the Value - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1
IEPM/PingERIEPM/PingER
Internet End-to-end Performance Monitoring and the PingER projectInternet End-to-end Performance Monitoring and the PingER project
IEPM/PingERIEPM/PingER
Internet End-to-end Performance Monitoring and the PingER projectInternet End-to-end Performance Monitoring and the PingER project
Warren Matthews and Les Cottrell (SLAC)
National Collaboratory Middleware and Network Research Project Review, ANL,
August 18-20, 2003.
04/19/23 20:43 2
OverviewOverviewOverviewOverview
• A little History• Evaluate the progress• Assess the Value• Interactions with other projects• Elements that should be added • Summary
3
HistoryHistoryHistoryHistory
• Ping End-to-end Reporting• Began early 1995
– Monitor network performance to sites collaborating with SLAC
• ESnet Network Monitoring Task Force (NMTF)– Extended to several DoE labs, strong support from
FNAL
• 1997 ICFA created Network Task Force– PingER spreads worldwide– Funded by DOE/MICS
4
RecentlyRecentlyRecentlyRecently
• In 2001, extended PingER to include bandwidth testing – IEPM-BW
• End-to-end user perception for high performance bulk-transfer
• Iperf, bbftp, GridFTP …• Heavy network impact compared to
lightweight PingER
5
Current StatusCurrent StatusCurrent StatusCurrent Status
• PingER funding is under Thomas Ndousse
• DoE/MICS funding runs out at end of year
• Continues to be extremely useful– Most recently began working with
ICTP/eJDS to quantify the Digital Divide• MAGGIE proposal to develop/extend
high performance monitoring (with PSC, ICIR, LBNL)
04/19/23 20:43 6
OverviewOverviewOverviewOverview
• A little History
•Evaluate the progress• Assess the Value• Interactions with other projects• Elements that should be added • Summary
7
PingERPingERPingERPingER
• Mature, Successful• Widely used in HENP• Utilization has been extended beyond
HENP– EDG, IAEA, XIWT– ICTP/eJDS– Many others
• Continues to be extended to meet new needs– Better visualization, web services access to
• Monitoring• Analysis• Visualization• Available from SLAC/FNAL websites• Package
04/19/23 20:43 10
Using PingERUsing PingERUsing PingERUsing PingER
• Since 1995• Trouble shooting• Identify Sites to Upgrade• Choosing a provider• Setting expectations for VoIP • Routing Choices for multihomed sites• Compare with http, ftp
• A little History• Evaluate the progress• Asses the Value• Interactions with other projects
•Elements that should be added
• Summary
37
MAGGIEMAGGIEMAGGIEMAGGIE
• Need to further develop IEPM-BW– On-demand measurements,
visualization, automated trouble shooting
• Measurement and Analysis for the Global Grid and Internet End-to-end performance– A secure, scalable measurement
infrastructure providing measurement, analysis and access to data.
38
MAGGIEMAGGIEMAGGIEMAGGIE
MAGGIE
NIMISecurity and scheduling
IEPM-BWMeasurement Engine
Publishing
Fault FindingAnalysis Engine
Other tools
NMWG
AMP
RIPESLAC
SLAC
FNAL
PSCICIR
LBNL
SLAC
ANLSCIDAC
UCL
Akenti NWS
04/19/23 20:43 39
OverviewOverviewOverviewOverview
• A little History• Evaluate the progress• Assess the Value• Interactions with other projects• Elements that should be added
•Summary
40
Meeting the Objectives Meeting the Objectives (1/4)(1/4)
Evaluate the ProgressEvaluate the Progress
Meeting the Objectives Meeting the Objectives (1/4)(1/4)
Evaluate the ProgressEvaluate the Progress• The problem: The user cannot assume the network
will be there. – Even if it is, the user cannot assume it will perform to
their expectation. • The vision (realized): PingER has set expectation,
provides data for troubleshooting, provides data for research. Continues to be useful.
• A Unique contribution: Probably the largest monitoring project in the world. IEPM-BW comparing tools, leveraging other efforts.
04/19/23 20:43 41
Meeting the Objectives Meeting the Objectives (2/4)(2/4)
Assess the valueAssess the value
Meeting the Objectives Meeting the Objectives (2/4)(2/4)
Assess the valueAssess the value• PingER is widely used and
continues to be useful. • Goals get more ambitious• Challenges remain
42
Meeting the Objectives Meeting the Objectives (3/4)(3/4)
Interactions Across Interactions Across ProjectsProjects
Meeting the Objectives Meeting the Objectives (3/4)(3/4)
Interactions Across Interactions Across ProjectsProjects• Long history of involvement in
other projects– HENP, ESnet, Grid, High
Performance, ICFA-SCIC – Friends, colleagues and contacts
throughout the world (Other worlds coming soon)
• Bright future for MAGGIE.
04/19/23 20:43 43
Meeting the Objectives Meeting the Objectives (4/4)(4/4)
Assess the Integrated Assess the Integrated ImpactImpact
Meeting the Objectives Meeting the Objectives (4/4)(4/4)
Assess the Integrated Assess the Integrated ImpactImpact• The contribution to the big picture
by IEPM-PingER, IEPM-BW and especially the need for MAGGIE have been summarized by Mary-Anne and Thomas– But they may not have known it
04/19/23 20:43 44
The Big PictureThe Big PictureThe Big PictureThe Big Picture
All of the National Collaboratory and Network Research projects have specific goals and objectives, but all of you involved in those projects are also part of a much larger, longer term effort, namely creating an infrastructure that will enable geographically separated scientists to effectively work together as a team and that will facilitate remote access to both facilities and data.
-Mary-Anne and Thomas
04/19/23 20:43 45
Toward a Monitoring Toward a Monitoring InfrastructureInfrastructure
Toward a Monitoring Toward a Monitoring InfrastructureInfrastructure
• Certainly the need– DOE Science Community, SCIDAC Testbed– Grid, Large Scale Networking– Troubleshooting / E2Epi
• Many of the ingredients– Many monitoring projects– Many tools– PIPES, MAGGIE (Cross domain)
46
SummarySummary
“Unfortunately, network management research has historically been very under-funded, because it is difficult to get funding bodies to recognize this as legitimate networking research.”
• Connie Logg, Jerrod Williams (SLAC), Jiri Navratil (CESnet/SLAC), David Martin, Frank Nagy, Al Thomas, Maxim Grigoriev (FNAL), Fabrizio Coccetti (INFN/SLAC).
• Brian Tierney, Eric Boyd, Jeff Boote, Matt Zekauskas, Matt Mathis, Russ Hobby, Vern Paxson, Andy Adams, kc Claffy, Iosif Legrand, Ajay Tirumala, Tom Dunigan.