Answers:
i have been working with the RSng and IPMA projects at Merit. Activities include routing policy and routing traffic analysis.
Hardware/firmware system for passive measurement, use of GPS timing for transit time measurement over international ATM and IP networks.
24 years ago was Research Associate of Benoit Mandelbrot.
The ability to tie data from passive monitoring into SLA policing will also be an interesting challenge.
Ted is currently responsible for the group which handles network management, benchmarking, and research for Equinix. As an Internet Facilities provider, Equinix is interested in understanding the general characteristics of network flows through its facilities and specifically interested in how to enable effective public and private peering.
Prior to joining Equinix in November of 1998, Ted worked on the NASA Science Internet project. While at NASA, he managed development and deployment of all services offered by the NASA NIC and led several efforts to analyze application layer network traffic over NASA networks. He also served for two years as the elected chair of NASA's webmasters' working group, coordinated adoption of web technologies and protocols. Ted began working with the Internet as a member of the technical staff of the SRI Network Information Systems Center.
Coral libraries developed at CAIDA
Relevant Past Activities:
NARUS Inc.
Postdoctoral research fellow, Center for Advanced Computation and Telecommunications, University of Massachusetts Lowell
Using tcpdump for capturing measurements off the campus lans.
I have been involved in the area of data mining of network data for several years. In Bellcore, I was working on efficient classification and clustering algorithms for high dimensional data sets. These algorithms were applied in the area of fraud detection and data visualization for SS-7 traffic. At Niksun, I am working on the definition and monitoring of metrics that directly reflect user-perceived QoS as well as implementing the relational database functionality in NIKSUN's NetVCR product.
CAIDA employee for less than 1 year, I was previously employed by ANS. At ANS I was a member of the network management systems (NMS) development group. I've been involved in SNMP manager development and other real-time network management development (ICMP pollers, service monitoring (HTTP, NNTP, DNS, etc.), SLA-driven management, etc.). I've also been involved in mass measurement systems (SNMP MIB-II data, RTT data, etc.) and data storage and analysis (developer/maintainer of original ARTS library at ANS, current author of the publically-available arts++ package). I'm also the author of cflowd.
Started the ethernet measurements that led to the discovery of fractal behavior many years ago.
Did theoretical studies of TCP (the square root formula, stationary behavior of TCP, now also transient behavior of TCP).
Currently working on models for Internet Games (Quake).
Translate source behaviors into rules for link engineering.
As you see, I am more into analyzing the data than into taking the measurements. I want to learn more about taking the measurements!
In both the NNTP work and the Quake work we had to work with headers only. We found it useful to develop a ``library'' of patterns in foreward and backward directions that make it possible to pretty much reconstruct what the customer did from headers only (headers client -> server AND server -> client). This seems a useful approach whenever only headers are available (i.e. much of the time!).
Recently I've released a perl package called "Cflow" which understands cflowd flow files. (This has been announced in "comp.dcom.sys.cisco".) Also, I've released a package called "NetTree" that I've found useful to summarize flow statistics by network or subnet.
I have experimented with analyzing the flows produced by cflowd to identify machines on our campus which have had their security compromised. (This can sometimes be determined by observing their responses to scans and probes from the outside world.)
Also, we've built and are using a flow analysis package that can identify inbound and outbound traffic from a campus or site. (In some cases, such as with multipoint ATM interfaces on Cisco routers, it is not sufficient to determine whether or not the traffic is intracampus based solely on the interface ifIndex.) Also, been working with integrating MRTG's graph generation with cflowd so that I can plot the use of services (httpd, nttp, etc.) over time. The resulting GIFs are suitable for a WWW page.
Developing flexible analysis tools so that users can reduce the raw data but still be able to answer all sorts of questions about traffic is difficult. It's what led me to using perl to parse the flows so that the powerful scripting language can be used to crunch the data and report upon it.
A number of other software tools have been developed for differrent traffic trace analysis and processing.
Continued use of passive monitoring to monitor traffic on different networks and network types and to obtain accurate characterizations of new and existing network applications, protocols, etc.
In research with CAIDA, Sager is developing driver and kernel extensions to the Coral OC12mon to support in-kernel packet reassembly and filtering for security-related applications and other, more general monitoring application where low-level filtering is desired. Sager is also a contributer to the OC48mon preliminary design work.
Compuware EcoScope - good tool for application discovery and reporting, but limited to LAN and low-speed WAN topologies. Provides good visualization of the discovered network. No ability to collect TCP flow data.
RMON probes
snoop w/ basic analysis
HP Internet Advisor and NAI Sniffer analyzer tools