Performance Tools Taxonomy
Subcategory: Internet Cloud Monitoring
| URL: |
http://www.narus.com/solutions/ |
| Contact: |
Contact form |
| Overview: |
Runs at full line speed (Gigabit Ethernet, OC3 and OC12 in production; OC48 in
alpha). Complete system is designed to operate
24x7. Highly available, fault tolerant and completely distributed. Basic output is
flow information. In addition, it is possible to add
application specific information, to aggregate and correlate information from
multiple analyzers, to apply business rules on the
data, to define thresholds, etc.
|
| Access: |
$$
|
Subcategory: Internet Weather
| URL: |
http://limestone.uoregon.edu/iwr/ping.html |
| Contact: |
Authors: Joel Jaeggli, Jon S. Stevens, Roger Bailey, Lee Wilson |
| Overview: |
The rating is based on 20 pings using 210 byte packets between the news server,
or nearest upstream pingable host for each
network and twin.uoregon.edu. The University has DS-3 level connectivty to CWIX,
DS-3 connectivity with UUNET, and 2 * oc-3
connectivity through the oregon gigapop to the Abilene network,
as well as a peering relationship with Verio and a number of other local and
regional service providers peering at the Oregon Internet Exchange.
Packet losses of less than 6 percent are rated GREEN while packet
losses of more than 12 percent are rated RED. In between is considered YELLOW.
The page is updated once every 30 minutes.
|
| Access: |
web page
|
| URL: |
http://www.internettrafficreport.com/ |
| Contact: |
Contact form |
| Overview: |
ping is used to measure round-trip travel
time along major paths on the Internet. We have several
servers in different areas of the globe perform the same ping
at the same time. Each test server then compares the current
response to past responses from the same test to determine if
the response was bad or good on a scale of 0 to 100. The
scores from all test servers are averaged together into a
single index.
|
| Access: |
web page
|
Subcategory: Monitoring Services (Application or E-business)
| URL: |
http://www.gomez.com/products/index.html |
| Contact: |
GPNcontact@gomez.com |
| Overview: |
Gomez Performance Network (GPN) measures web page and transaction performance globally and in real-time, enabling the user to continuously monitor site availability and responsiveness.
From over 53 locations spanning more than a dozen Internet backbones, GPN's secure service provides the users with data needed to identify factors that impact web site performance, compare the user's site to competitors' and evaluate changes to the user's web site, server platform or network device configurations.
Using the GPN's web interface, users can configure the benchmark tests they need, script customized transaction sequences, specify test frequency, choose nodes from which to monitor their site, set alert thresholds, and create charts for graphical report. GPN provides drill-down analysis for tests and transactions. Test data for benchmaking and trend analysis can be stored on Gomez server for 30 days for historical analysis.
|
| Access: |
$$$
sample output
free trial
|
| URL: |
http://www.gomez.com/products/private_peer.html |
| Contact: |
GPNcontact@gomez.com |
| Overview: |
Gomez PeerReview is a monthly, web-based subscription service that measures
the end-to-end performance of web applications from the customers' perspective. It provides valuable last-mile visibility into the customers' web experience from all types of Internet connections (dial-up through broadband). PeerReview monitors the speed of web applications using thousands of actual end-user PCs spread across the global Internet. Its diverse testing network delivers realistic perspective of the quality of customers' web experience.
PeerReview gathers and reports a complete range of measurements -- DNS lookup, first byte and content download time, errors, network latencies and backbones crossed. It provides on-demand diagnostic measurements from any geography and connection type. This capability allows the users to pinpoint problems and design solutions before impacting their customers' online experience.
Users can access their Gomez accounts through a secure extranet. They can configure tests, view results by specific ISPs and backbone providers, or download the raw data for further analysis. The PeerReview web interface enables users to identify trends in the performance of their web site or their competitors' sites, examing how their site compares to sites of industry leaders.
With PeerReview's automated alert tracking system and configurable "warning" and "critical" alerts, users can receive real-time service alerts in response to systemic problems and outages. Also, PeerReview's error code reporting function allows users to see the types of errors their customers experience, such as "page not found" errors, missing objects, and other HTTP and network errors.
|
| Access: |
$$$ |
| URL: |
http://www.keylabs.com/ |
| Contact: |
rfq @ keylabs.com |
| Overview: |
Web testing services performed at 40,000 square foot facility
having >1300 PCs and gigabit
capability network cabling for live-network simulations from 56K up to D3 speed.
Utilizes WebSTONE Benchmark Testing, Ziff-Davis WebBench, RadView's WebLoad,
RSW, e-LOAD, and other tools.
|
| Access: |
$$$ |
| URL: |
http://www.keynote.com |
| Contact: |
http://www.keynote.com/contact_info/contact_info_tpl.html |
| Overview: |
Quality of Service measurement provider for e-commerce. Perspective measurement
computers monitor the time it takes
to access and download a single object or the entire contents of a Web page.
Consumer Perspective performs the
se measurements over a 56 Kb modem, DSL, or cable connection. Transaction
Perspective measures response time to execute
a multi-page interactive transaction. Varying levels of service are offered.
|
| Access: |
$$$ |
| URL: |
http://www.cw.com |
| Contact: |
WaiLi.Wong @ exodus.net |
| Overview: |
SM-WEB (Diagnostic Edition) offers customized reporting, near-time notification of
performance degradation, flexible URL monitoring,
and measurement location choices.
SM-WEB (BenchMetric Edition) adds competitive performance information
and performance metrics for peak Internet hours.
Additional tools provide more specific web-site
monitoring: SM-WEBPOINT measures individual web object performance in real-time.
SM-SOURCETRACKER tracks the performance of
dynamically named elements (ad banners, log-in screens, etc.)
|
| Access: |
$$$ |
Subcategory: Monitoring Services (ISP)
BrixWorx software
| URL: |
http://www.brixnet.com/products/brixworx.html |
| Contact: |
http://www.brixnet.com/corporate/contact_overview.html |
| Overview: |
Measures specific customer's applications and services by collecting active test suite data from Brix 1000 Verifiers located (for example) at ISP service demarcation (edge router) points, and Brix 100 Verifiers located (for example)
at the entry router to a customer's enterprise network. BrixWorx
software is centrally managed from the Provider's Network Operations Center.
BrixWorx offers a web-based GUI that provides a comprehensive reporting and graphing interface designed to answer typical operational questions, monitor service and SLA performance, mine performance data, troubleshoot, or perform what-if modeling. Fine-grained, policy-based access controls let ISPs decide
what types and how much data to share with staff members and subscribers.
The set of test modules includes both active tests generating simulated
customer usage traffic and passive tests monitoring actual traffic.
|
| Access: |
$$$ hardware + service
|
| URL: |
http://www.brixnet.com/productx/brix1000.html |
| Contact: |
http://www.brixnet.com/corporate/contact_overview.html |
| Overview: |
Creates a regional ISP service demarc point. Calculates network and application statistics by measuring characteristic application transaction times. Measures round-trip latency, jitter, and packet loss. Runs active test modules (e.g., VPN, VoIP, web, streaming media, email, news, differentiated services, DNS, SNMP, router status) as specified by BrixWorx software. Built-in hardware packet-timestamp engine. Optional GPS module provides worldwide, accurate synchronization of timestamps to sub-millisecond precision. Both active probes using simulated transactions and passive measurement of actual transactions is supported. This customer-located equipment separates packet-forwarding and network-testing data paths to ensure wire rate traffic flow under all conditions. Test suites are automatically provisioned by BrixWorx software. New tests can be dynamically added without resetting or data loss.
|
| Access: |
$$$ hardware + service
|
Brix 100 Verifier
| URL: |
http://www.brixnet.com/products/brix100.html |
| Contact: |
http://www.brixnet.com/corporate/contact_overview.html |
| Overview: |
Creates customer demarc point for IP services. Calculates network and application statistics by measuring characteristic application transaction times. Measures round-trip latency, jitter, and packet loss. Runs active test modules (e.g., VPN, VoIP, web, streaming media, email, news, differentiated services, DNS, SNMP, router status) as specified by BrixWorx software. Built-in hardware packet-timestamp engine. Both active probes using simulated transactions and passive measurement of actual transactions is supported. This customer-located equipment separates packet-forwarding and network-testing data paths to ensure wire rate traffic flow under all conditions. Test suites are automatically provisioned by BrixWorx software. New tests can be dynamically added without requiring hardware reset and without data loss.
|
| Access: |
$$$ hardware + service
|
Brixnet Managed Service Level Verification
| URL: |
http://www.brixnet.com/products/brixnet.html |
| Contact: |
http://www.brixnet.com/corporate/contact_overview.html |
| Overview: |
Brixnet's Network Operations Center runs BrixWorx and monitors Verifiers on behalf of an ISP.
Measures specific customer's applications and services by collecting active test suite data from Brix 1000 Verifiers located at ISP service demarcation (edge router) points, and Brix 100 Verifiers located at the entry router to a customer's enterprise network. BrixWorx software is centrally managed from the Brixnet NOC on behalf of the provider. BrixWorx web-based GUI provides a comprehensive reporting and graphing interface designed to answer typical operational questions, monitor service and SLA performance, mine performance data, troubleshoot, or perform what-if modeling. Fine-grained, policy-based access controls let ISPs decide what types and how much data to share with staff members and subscribers. The set of test modules inccludes both active tests generating simulated customer usage traffic and passive tests monitoring actual traffic.
|
| Access: |
$$$ hardware + service
|
| URL: |
http://oss.oetiker.ch/mrtg/ |
| Contact: |
Author: Tobias Oetiker (oetiker@ee.ethz.ch) |
| Overview: |
The Multi Router Traffic Grapher (MRTG) is a tool to monitor the traffic load on network-links. MRTG generates HTML pages containing PNG images which provide a LIVE visual representation of this traffic.
MRTG consists of a Perl script which uses SNMP to read the traffic counters of your routers and a fast C program which logs the traffic data and creates beautiful graphs representing the traffic on the monitored network connection. These graphs are embedded into webpages which can be viewed from any modern Web-browser.
In addition to a detailed daily view, MRTG also creates visual representations of the traffic seen during the last seven days, the last four weeks and the last twelve months. This is possible because MRTG keeps a log of all the data it has pulled from the router. This log is automatically consolidated, so
that it does not grow over time, but still contains all the relevant data for all the traffic seen over the last two years. This is all performed in an efficient manner. Therefore you can monitor 200 or more network links from any halfway decent UNIX box.
MRTG is not limited to monitoring traffic though, it is possible to monitor any SNMP variable you choose. You can even use an external program to gather the data which should be monitored via MRTG. People are using MRTG, to monitor things such as System Load, Login Sessions, Modem availability and more. MRTG even allows you to accumulate two or more data sources into a single graph.
|
| Access: |
downloadable
papers
sample output
|
| URL: |
http://www-itg.lbl.gov/nettest/index.html |
| Contact: |
W.E. Johnston (wejohnston@lbl.gov) |
| Overview: |
Nettest is a secure, real-time network monitoring framework, it is designed to incorporate used-seleted network tests, and be run as a daemon or an interactive process. Requests for network tests are received via a SSL connection or the user interface and are authorized using an ACL list (in the future authorization using Akenti will also be supported).
Currently the nettest framework incorporates Iperf-v1.2, a simple ping type test, and a tuned TCP test that uses a given required throughput and ping results to determine the round trip time to set a buffer size (based on the delay bandwidth product) and then performs an iperf TCP throughput test. Additional network test tools can be integrated into the nettest framework in the future.
|
| Access: |
downloadable
|
| URL: |
http://www.kotovnik.com/~avg/snmpstatd.tar.gz |
| Contact: |
Author: Vadim Antonov (avg@exigengroup.com) |
| Overview: |
Snmpstatd basically collects usuage statistics (in 30-sec "peaks" and 5-min averages), memory and CPU utilization from routers, by performing asynchronous SNMP polling. It also performs time based interpolation for 30-sec sampling ( it always requests router's local time and uses it for computing accurate 30-sec peak usuage. The statistical data about network links utilizations and reliability is then aggregated and stored in separate log files for every links and gateway. Snmpstatd can also store the information about the current state of the monitored links and gateway into the network state file. Since Snmpstatd can poll gateways relatively fast, it is good to be used for operative network monitoring.
|
| Access: |
downloadable
|
Subcategory: Link Utilization
| URL: |
http://cebu.mozcom.com/riker/iptraf/index.html |
| Contact: |
Author: Gerard Paul Java ( riker @ mozcom.com ) |
| Overview: |
IPTraf is a console-based network statistics utility for Linux.
It gathers a variety of figures such as TCP connection packet and
byte counts, interface statistics and activity indicators,
TCP/UDP traffic breakdowns, and LAN station packet and byte counts.
- An IP traffic monitor that shows information on the IP traffic passing over yo
ur network. Includes TCP flag
information, packet and byte counts, ICMP details, OSPF packet types.
- General and detailed interface statistics showing IP, TCP, UDP, ICMP, non-IP a
nd other IP packet counts, IP checksum
errors, interface activity, packet size counts.
- A TCP and UDP service monitor showing counts of incoming
and outgoing packets for common TCP and UDP application ports.
- A LAN statistics module that discovers active hosts and shows statistics showi
ng the data activity on them
- TCP, UDP, and other protocol display filters, allowing you to
view only traffic you're interested in.
- Logging
- Supports Ethernet, FDDI, ISDN, SLIP, PPP, and
loopback interface types.
- Utilizes the built-in raw socket interface of the Linux kernel,
allowing it to be used over a wide range of supported
network cards.
- Full-screen, menu-driven operation.
|
| Access: |
Freely downloadable.
|
| URL: |
http://ee.lbl.gov |
| Contact: |
LBL ( libpcap @ ee.lbl.gov ) |
| Overview: |
Portable Unix library for dumping packets. Serves as a machine-independent
layer packet collection mechanism.
|
| Access: |
Freely downloadable.
|
| URL: |
http://ee.lbl.gov |
| Contact: |
LBL ( tcpdump @ ee.lbl.gov ) |
| Overview: |
Stable, mature, canonical portable packet collector, built using libpcap.
Network researchers frequently use tcpdump in lieu of
bundled packet collectors; some vendors even ship it as bundled packet dumper.
Requires reasonable understanding of networking to interpret collected
packets. Output format can be easily and portably analyzed using awk,
sed, and perl scripts.
|
| Access: |
Freely downloadable.
|
| URL: |
http://ita.ee.lbl.gov/html/contrib/tcpdpriv.html |
| Contact: |
Author: Greg Minshall ( minshall @ acm.org ) |
| Overview: |
Tcpdpriv removes sensitive information from a packet trace, replacing it
with contrived information from which the sensitive information cannot be
reconstructed. By removing the sensitive information, the output of
tcpdpriv may be shared with others (for debugging or network analysis,
say). tcpdpriv requires libpcap. It works on SunOS, Solaris,
and FreeBSD.
Link-level headers are passed through unchanged.
|
| Access: |
Freely downloadable.
|
Subcategory: Network Simulation (Capacity Planning)
| URL: |
http://www.opnet.com/products/modeler/home.html |
| Contact: |
info @ opnet.com |
| Overview: |
For network research and development. Used primarily to design and study network technologies, ranging from communications protocols to network equipment and systems. |
| Access: |
$$$ Contact OPNET Technologies at info@opnet.com or 240-497-3000
|
| URL: |
http://www.opnet.com/products/spguru/home.html |
| Contact: |
info @ opnet.com |
| Overview: |
Intelligent network management for service providers. Used primarily to troubleshoot, validate, plan, and design service provider networks. |
| Access: |
$$$ Contact OPNET Technologies at info@opnet.com or 240-497-3000
|
| URL: |
http://www.opnet.com/products/itguru/home.html |
| Contact: |
info @ opnet.com |
| Overview: |
Intelligent network management for enterprises. Common uses are network design, capacity planning, technology evaluation, application deployment, and for managing service level agreements. |
| Access: |
$$$ Contact OPNET Technologies at info@opnet.com or 240-497-3000
|
Subcategory: One-way Availability/Latency Tests
| URL: |
http://echoping.sourceforge.net/ |
| Contact: |
Stephane Bortzmeyer ( bortzmeyer @ pasteur.fr) |
| Overview: |
Echoping is a utility for measuring TCP/UDP latency by sending
to an arbitrary (default 'echo') port. It includes
support for testing HTTP query latency.
|
| Access: |
Freely downloadable.
|
| URL: |
http://www.fping.com/ |
| Contact: |
Author: Roland J. Schemers III ( schemers @ stanford.edu ) |
| Overview: |
A ping variant suitable for use in scripts. fping
will issue ICMP echo requests
to a list of hosts in round-robin fashion. fping output is meant to be parsed
by scripts. The fping man page can be found at the main website.
|
| Access: |
Freely downloadable.
|
| URL: |
http://ircache.nlanr.net/~wessels/Software/ |
| Contact: |
Author: Duan Wessels ( wessels @ nlanr.net ) |
| Overview: |
Pings multiple hosts in parallel, with graphical display (gnuplot) of delay distri
bution.
|
| Access: |
Freely downloadable.
|
| URL: |
ftp://ftp.nikhef.nl/pub/network/ping.tar.Z |
| Contact: |
Author: Eric Wassenaar |
| Overview: |
A 'ping' variant with the following differences from classic 'ping':
- Redesign for proper flodd and Cisco style ping handling
- Packet loss now properly reported in all modes
- Support for LSRR in addition to RR option
- Quick ping without normal output, quits when target is alive.
- Option to probe all addresses of multi-homed destinations
- Supports pinging to broadcast address
- Portability hooks for easy installation on various platforms
- Recognizes various new ICMP packet types and subcodes
- Recognizes bounce messages in response to sent ping requests
- RTT reporting in fractional milliseconds
- RTT standard deviation displayed in statistics summary
- Minimizes DNS queries by caching DNS lookups
- Auto-adjusts timeout period to cope with slow links
|
| Access: |
Freely downloadable. Runs on HP, SGI, IBM/AIX, SUN, DEC, Apollo, NEXT, FreeBSD
, SCO, and Linux |
| URL: |
http://e2epi.internet2.edu/owamp/index.html |
| Contact: |
boote @ internet2.edu Author: Jeff Boote |
| Overview: |
owamp measures one-way latency. It is a client-server application. The
command line is similar to ping (and the command-line tool is called
owping). It implements RFC 4656. The data results shows: latency
distributions for a set of UDP packets including delay-variation(i.e.
jitter), number of hops traversed, reordering. Different packet send
schedules can be used to mimic specific traffic patterns and several
individual packet characteristics such as packet size and DSCP codes can be
specified.
|
| Access: |
Freely downloadable. |
| URL: |
ftp://ftp.arl.mil/pub/ping.shar |
| Contact: |
ftp @ arl.mil Author: Mike Muuss |
| Overview: |
Classic tool for reachability/latency assessment. Measures hop-to-hop latency and
packet loss.
|
| Access: |
Freely downloadable. |
| URL: |
http://www.cs.washington.edu/homes/savage/sting/ |
| Contact: |
Author: Stefan Savage ( savage @ cs.washington.edu ) |
| Overview: |
sting is a TCP-based network measurement tool that
measures end-to-end network path characteristics.
characteristics. sting is unique because it can estimate
one-way properties, such as
loss rate, through careful manipulation and observation of TCP behavior.
In addition,
using TCP allows sting to leverage the existing Internet infrastructure - any TCP
server can be used as a de facto measurement service - and it avoids increasing
problems with ICMP-based network measurement
(blocking, spoofing, rate limiting, etc.).
README
file includes instructions for compilation and usage.
|
| Access: |
Freely downloadable source code. Binaries available for FreeBSD 3.x and Linux
2.3.x
|
| URL: |
http://www-nplvms.physics.ox.ac.uk/ |
| Contact: |
Author:
John MacAllister |
| Overview: |
Traceping uses ping and traceroute to track packet loss rates
to a variety of destinations. It is currently used to track performance
between various mostly-international, mostly physics-related sites.
Runs on VMS.
|
| Access: |
Available from the author by request.
|
|
|
Cooperative Association for Internet Data Analysis (CAIDA)