Skip to Content
[CAIDA - Center for Applied Internet Data Analysis logo]
Center for Applied Internet Data Analysis
www.caida.org > data : active : ipv4_dnsnames_dataset.xml
IPv4 Routed /24 DNS Names Dataset
The IPv4 Routed /24 DNS Names dataset provides fully-qualified domain names for IP addresses seen in the traces of the IPv4 Routed /24 Topology Dataset.
We also provide the DNS query and response traffic resulting from the DNS lookups required to construct the DNS Names dataset.

|   Data Sources:    Realtime Monitors    Passive    Active    Other    External   |


IPv4 Routed /24 DNS Names Dataset


DNS names are useful for obtaining additional information about routers and hosts making up the Internet topology. For example, DNS names of routers often encode the link type (backbone vs. access), link capacity, Point of Presence (PoP), and geographic location. We have DNS Names data starting March 2008.

These datasets result from CAIDA's large-scale traceroute-based measurements running on the Archipelago (Ark) measurement infrastructure (also see CAIDA's Macroscopic Topology Project).

We perform these DNS lookups centrally at CAIDA using a custom-built bulk DNS lookup service. This service performs millions of DNS lookups per day. In general, we perform DNS lookups soon after we collect the topology traces so that the results better match the state of the Internet at trace collection time. However, to avoid undue load on remote DNS nameservers and to keep the daily lookup volume at a manageable level, we never perform a lookup for an address if we have successfully obtained a result in the preceding 7 days. Apart from this 7-day rule, we always perform a lookup whenever we encounter an IP address in traces. This means that we do repeat lookups at 7-day granularity for addresses that repeatedly occur in the traces. If the first attempt to look up a given IP address fails, then we retry up to two more times, waiting about one day between retries.

In addition to the DNS names we have in the past provided the daily trace files containing DNS query and response traffic resulting from these DNS lookups. This was discontinued in April 2014, because of a change in the data collection procedure. These traces capture the DNS traffic between our local recursive name server and global DNS servers (rather than the less useful final DNS results seen by DNS clients). These data are available in two forms: the most recent 30 days of DNS traffic files (i.e. from 30 days upto the current day); and a historic collection of DNS traces about three weeks long at quarterly intervals going back to July 2008. Traces are available in two formats: a standard pcap file, and a textual dump of each pcap file containing the most useful values from the DNS responses.

Data availability

Data older then approximately two years are available as a public dataset. The most recent two years are subject to restricted access.

Acceptable Use Agreement for the restricted data

Access to these data is subject to the terms of the following CAIDA Acceptable Use Agreement (printable version in PDF format)

Acceptable Use Agreement for the public data

Access to these data is subject to the terms of the following CAIDA Acceptable Use Agreement (printable version in PDF format)

When referencing this data (as required by the AUA), please use:

The CAIDA UCSD IPv4 Routed /24 DNS Names Dataset - <dates used>,
http://www.caida.org/data/active/ipv4_dnsnames_dataset.xml.
Also, please, report your publication to CAIDA.

Request Data Access

  • Access the publicly available CAIDA IPv4 Routed /24 DNS Names (and other topology data)
  • Request Access to the restricted CAIDA IPv4 Routed /24 DNS Names Dataset (and other topology data)

Topology Datasets

References

For more information on CAIDA topology measurements, see:

For more information on topology measurements in general see:

  Last Modified: Thu Jun-23-2016 15:43:37 PDT
  Page URL: http://www.caida.org/data/active/ipv4_dnsnames_dataset.xml