CAIDA Data - Overview of Datasets, Monitors, and Reports

CAIDA collects several different types of data at geographically and topologically diverse locations, and makes this data available to the research community to the extent possible while preserving the privacy of individuals and organizations who donate data or network access.

This page provides a quick-access overview of available datasets (publicly available or otherwise restricted), with links to the dataset descriptions and access request forms when applicable.


The  colored header  in the overview table below indicates the field(s) the table is being sorted by. Click the header to change or toggle sorting order, and Shift+click headers to sort by multiple fields.

Ongoing Datasets

Name Status Availability Category Source Start Date
Telescope Daily RSDoS Ongoing Request access Security Telescope 2008-10
Complete Routed-Space DNS Lookups Ongoing Request access (download) Topology Root DNS Servers 2014-08
AS Links: IPv6 AS Links Ongoing Public Topology Ark + RouteViews 2008-12
RouteViews Prefix to AS mappings Ongoing Public (download) Topology RouteViews 2005-05
AS to Organization Mapping Ongoing Public Topology Whois 2009-10
AS Classification Ongoing Temporarily Unavailable AS metadata PeeringDB + Telescope + Alexa + AS Relationships 2018-11
Internet eXchange Points (IXPs) Dataset Ongoing Public Interconnection PeeringDB,Geoname,Hurricane Electric, PCH 2018-02
CYMRU Bogon Reference Dataset Ongoing Public Census Team Cymru 2013-09
Ark IPv4 Routed /24 Ongoing Request access
Public
Topology Ark 2007-09
Ark IPv4 Routed /24 DNS Names Ongoing Request access
Public
Topology CAIDA DNS Lookup 2008-03
Ark IPv4 Prefix-Probing Traceroute Ongoing Request access
Public
Topology BGP+Ark 2015-12
Ark IPv6 Topology Ongoing Public Topology Ark 2008-12
Ark IPv6 DNS Names Ongoing Public Topology CAIDA DNS Lookup 2014-05
Ark Internet Topology Data Kit (ITDK) Ongoing Request access 
Public
Topology Ark + RouteViews 2010-01
IPv4 TNT MPLS Topology Dataset Ongoing Request access 
Public
Topology Ark + RouteViews 2018-01
Telescope: Raw Traffic Traces Ongoing Request access Traffic Telescope Most recent 30 days
Telescope Aggregated Flow Dataset Ongoing Request access Traffic Telescope 2008-10
PeeringDB dataset Ongoing Public Topology PeeringDB 2010-07
AS Relationships Ongoing Public Topology RouteViews 1998-01
 Ongoing The data collection for this dataset is still active and has continuing, regularly scheduled collections.
 One-time snapshot The dataset comes from a single collection event that only occured once. Future events will have a different dataset name. See the Completed Datasets table for these datasets.
 Complete A formerly ongoing data collection that is finished, and will not be resumed. See the Completed Datasets table for these datasets.
Column Name Column Description
Name Dataset name
Status Current status of this dataset, indicating whether the dataset collection is ongoing or not. "One-time snapshot" implies complete. A link to resulting papers or analysis would be linked from the status, if available..
  • Ongoing - The data collection for this dataset is still active and has continuing, regularly scheduled collections.
  • One-time snapshot - The dataset comes from a single collection event that only occured once. Future events will have a different dataset name. See the Completed Datasets table for these datasets.
  • Complete - A formerly ongoing data collection that is finished, and will not be resumed. See the Completed Datasets table for these datasets.
Availability Public datasets are downloadable per the Acceptable Use Policy for the dataset. Restricted datasets require prior permission as well as adherence to the Acceptable Use Policy for that dataset. If a dataset requires a formal request for usage, the form will be linked.
Category Our taxonomy of the general category this dataset belongs in.
Source The source (e.g., network monitors, measurement infrastructure, etc) used to collect the dataset.
Start Date The date when the data collection started.

Other organizations across the globe, both academic and non-academic, provide access to internet-related data that also are of interest to the research community. Links to several of the more interesting datasets are given in a non-exhaustive list of external (non-CAIDA) data.

We maintain a list of publications from research using CAIDA data. The purpose of this list is to provide insight into past uses of CAIDA data. We rely on researchers who download our data to comply with the Acceptable Use Policies of CAIDA datasets in reporting published papers and presentations to us. See this list of Non-CAIDA Publications using CAIDA Data.

Report a Publication using CAIDA data

Users of CAIDA data agree to an AUA to notify CAIDA when they make a publication using CAIDA data. Report a publication using CAIDA data by completing the form or emailing data-info@caida.org.

Additional Information

Read more about CAIDA's efforts in data curation and promoting data sharing.

To keep up to date on CAIDA datasets you can subscribe to data-announce@caida.org. For other questions about CAIDA data, please contact data-info@caida.org. For more information about using CAIDA data, please see the CAIDA Data Usage FAQ.

Related Objects

See https://catalog.caida.org/search?query=types=dataset%20links=tag:caida%20ongoing to explore related objects to this document in the CAIDA Resource Catalog.
Published
Last Modified