Ongoing data collection at CAIDA

This page contains information about various data sets collected by CAIDA and made available to CAIDA members and to other Internet researchers. Please contact data-info@caida.org for further information.

| Trends Home Project Proposal IMDC Description |

CAIDA has been actively involved in active and passive measurements of the Internet since 1998. We have accumulated comprehensive sets of data characterizing the Internet topology, performance, workload, and security. Results of our analyses of these data have been published in scientific journals and conference proceedings.

One of the tasks of Trends project (NSF ANI-0137121) is to systematize and catalog our data in order to enable a multivariant cross-correlational analysis of heterogeneous data and to search for underlying trends and interdependencies. We offer access to the following data sets for CAIDA members and the research community.

Active Measurements
- raw topology traces
  A traceroute-like tool skitter captures forward IP paths and round-trip times from a skitter host to a specified list of destinations. These measurements are ongoing.
  - project details
  - how to get the data and sample analysis code
- Adjacency matrix of the Internet AS-level graph
  AS-level graph of the Internet can be constructed from raw traces by converting observed IP addresses to routed prefixes and then to origin ASes. Daily snapshots of links making up such an AS-level graph are available for download. These data are unrestricted, there is no AUP.
  - project details
- Internet Topology Data Kit (ITDK)
  In order to provide the research community with a comprehensive input enabling macroscopic Internet topology studies, we create special data kits and release them annually. Each kit represents a set of coordinated simultaneous measurements of the Internet connectivity and latency by various CAIDA tools and includes parsing scripts and other relevant information.
Passive measurements
- backbone packet header traces (OC48, OC12)
  CAIDA does not conduct regular monitoring of backbone links, but targets its collection for specific projects of CAIDA staff members and collaborators. Timing and duration of measurements vary depending on project needs.
  - how to get the data
  - examples of trace analysis
- backscatter data from the UCSD network telescope
  A team of CAIDA and UCSD researchers monitors traffic arriving to a portion of routed IPv4 space where no legitimate traffic is expected. From these data they can observe DoS attacks, follow the spread of Internet worms, and detect network scanning. These measurements are ongoing.
  - project details
  - how to get the data *
    * - currently, we offer to external researchers only three weeks of DOS attacks data from January 2001. We expect to have more recent and diverse data available soon.
Miscellaneous data
Note: access to these data is restricted. Please contact data-info@caida.org for further information.
- DNS data
  CAIDA is actively involved in monitoring and research of the Domain Name System. We collect data in support of our DNS related projects.
  - performance of root and gTLD servers (contact Nevil Brownlee)
  - Update requests for private Internet addresses (contact kc claffy)
  - OARC membership (contact kc claffy)
  - DNS simulations (contact kc claffy)