Data Collection at CAIDA -- Data Sources

This page is no longer maintained: The CAIDA Data pages have been reorganized in January 2010, and this page is no longer being updated. This page is being retained for archival purposes, but may be removed in the future. The updated, maintained of the datasets indices are found on the CAIDA Data Overview: Overview of Datasets, Monitors, and Reports page.

CAIDA Data Collections by Source

Passive Data Collections	Data Sources
Many types of network measurements involve collecting data at strategic locations by replicating real traffic en route to its destination. No additional traffic is introduced into the network for these measurements; rather, a copy of all network information passing through a given location is recorded for future study. Since this type of data collection does not modify the links it measures, it is called passive data collection.	Anonymized Internet Traces Anonymized 2009 Internet Traces Dataset Anonymized 2008 Internet Traces Dataset OC48 Commodity Link Traces DNS Data DNS root/gTLD RTT Dataset DNS F Root Server (Palo Alto, CA) DNS RFC 1918 Data Network Telescope Raw Telescope Traffic Two Days in November 2008 Dataset Three Days of Conficker Dataset Denial-of-Service Attack Backscatter: Backscatter-2008 Dataset Backscatter-2007 Dataset Backscatter-2006 Dataset Backscatter-2004-2005 Dataset Backscatter-TOCS Dataset Internet Worms: Code Red Worms Dataset Witty Worm Dataset Host Scanning University Internet Access Link
Active Data Collections	Data Sources
Many Internet research projects, including methods of inferring the available bandwidth of an Internet link or determining the path connecting two computers, require introducing specially crafted traffic into the network. Since these measurements change the overall traffic mix, they are called active measurements.	Topology IPv4 Routed /24 Topology Dataset IPv6 Topology Dataset AS Links (AS Adjacencies) Traceroute Probe Method 2008-08 Dataset Router Graph Links IPv4 DNS Names Dataset Internet Topology Data Kit Raw Skitter Topology Traces (ended 2008-02)
Realtime Monitors	Data Sources
CAIDA operates realtime monitors of network traffic at several locations. Displays are generally updated within 15 minutes of collection.	SDNAP SDNAP Description SDNAP Monitor
Other Data Collections	Data Sources
Some data available at CAIDA is neither active nor passive; these include information facilitating the mapping of Internet hosts to geographic locations and a historic cache of Domain Name Service (DNS) hostname mappings for IP addresses. Also, data derived from external sources, including the RouteViews data falls into this category.	Routeviews Prefix to AS mappings IPv4 Topology AS Relationships AS Taxonomy IP Address to Hostname Mapping Geographic Data
External Data Sources	Data Sources
Many other organizations house valuable data collections. CAIDA's Internet Measurement Data Catalog project will provide a searchable index of measurements and measurement annotations that can be used to support research projects. The prototype catalog is expected to be online in 2005. In addition to the IMDC, we provide links to several widely-used sources of network data here.	NLANR PCH RIPE RouteViews