Complete Routed-Space DNS Lookups

We performed the lookups using one of two tools. For older datasets, we used a custom parallel DNS lookup tool based on libunbound, a component of the Unbound validating, recursive, caching DNS resolver. For newer datasets, beginning with 2018-08-23, we use zdns in iterative mode. To determine routed addresses, we use BGP tables collected by RIPE and RouteViews via BGPstream. Lookups of the full routed space take 2-3 weeks to complete.

In the 2014-08-22 dataset, we queried 2.7 billion addresses in 10.6 million /24 prefixes (for this particular dataset, we did not query the .0 and .255 addresses in each /24, but all future datasets will query these as well).

Currently available datasets are

• 2019-01-25
• 2018-08-23
• 2017-09-08
• 2015-09-17
• 2014-08-22

File format

Result files are in a simple tab-separated, line-oriented text format.

A PTR result has the following fields:

   timestamp   IP_address      hostname
   1537482068  192.172.226.123 cider.caida.org

An SOA result has the following fields:

   timestamp   IP_address       name                      ns         mbox                  serial    refresh retry expire  ttl
   1537482068  192.172.226.123  226.172.192.in-addr.arpa. caida.org. postmaster.caida.org. 201808220 86400   300   3600000 86400

Acceptable Use Agreement

Access to these data is subject to the terms of the following CAIDA Acceptable Use Agreement

When referencing this data (as required by the AUA), please use:

The CAIDA UCSD Complete Routed-Space DNS Lookups Dataset - <dates used>,
https://www.caida.org/catalog/datasets/complete_dns_lookups_dataset/

Request Data Access

• Request Access to the CAIDA Complete Routed-Space DNS Lookups Dataset

Topology Datasets

• Freely Available Datasets
  • The Ark IPv4 Routed /24 Topology Dataset (data older than one year only)
  • The Ark IPv4 Routed /24 DNS Names Dataset (data older than one year only)
  • IPv4 TNT MPLS Topology Dataset (data older than one year only)
  • Ark Internet Topology Data Kits (ITDK) (data older than one year only)
  • The Ark IPv6 Topology Dataset
  • The Ark IPv6 DNS Names Dataset
  • The IPv6 Routed /48 Topology Dataset
  • IPv4 Routed /24 AS Links (September 2007 - ongoing)
  • IPv6 AS Links (December 2008 - ongoing)
  • AS Rank
  • AS Relationships
  • Skitter Macroscopic Topology Data
  • Skitter Internet Topology Data Kits (ITDK) - April 2002 and April/May 2003
  • Skitter AS Links (January 2000 - February 2008)
  • Skitter Router Adjacencies
  • AS Taxonomy
  • PAM 2010 "Improving AS Annotations" Supplement
• Restricted Access Datasets
  • The Ark IPv4 Routed /24 Topology Dataset (incl. most recent one year)
  • The Ark IPv4 Routed /24 DNS Names Dataset (incl. most recent one year)
  • IPv4 TNT MPLS Topology Dataset (incl. most recent one year)
  • The Ark IPv4 Prefix-Probing Dataset (incl. most recent one year)
  • Ark Internet Topology Data Kits (ITDK) (incl. most recent one year)
  • Complete Routed-Space DNS Lookups

References

For more information on CAIDA topology measurements, see:

• Internet Topology Data Comparison
• The Archipelago Project (Ark)
• Macroscopic Topology Measurements

For more information on topology measurements in general see:

• University of Oregon Route Views Project
• Paris traceroute