Internet Laboratory for Empirical Network Science (iLENS)
The goal of the iLENS project was to develop the active measurement infrastructure Archipelago (Ark), providing academic researchers with an unprecedented laboratory in which to quickly design, implement, and easily coordinate the execution of experiments across a widely distributed set of dedicated monitors.
Principal Investigator: kc claffy
Funding source: CNS-0958547 Period of performance: March 1, 2010 - February 28, 2014.
Impact Report
Over the course of the project, CAIDA upgraded and extended, both in geographic scope and in function, our active measurement platform (Ark). As of February 2014, we had deployed 80 Ark monitors, 29 of them Raspberry Pi based. The monitors are grouped in 3 teams to increase the efficiency of measurements while reducing the impact of probing on network resources.
The data obtained by using Ark infrastructure contribute to a wide range of network modeling, simulation, validation, analysis, and theoretical research activities. It enables new types of research, including historical Internet studies, improved annotations and accuracy of Internet topology graphs, evaluation of future Internet architectures, and empirical grounding for the emerging discipline of network science.
We make the raw collected and derived/aggregated data available to academic researchers all over the world. A few hundreds requests for topology data alone have been approved during the project. Aiming to promote and encourage wider use of our data for public good, we made raw IPv6 toplogy data, raw IPv4 topology data older than 2 years, and many of our derived datasets publicly downloadable from CAIDA web site.
We have also developed, released, and continued to support novel alias resolution tools as well as various software for analysis, annotation, topology generation, and interactive visualization of annotated Internet graphs derived from ongoing topology measurements with Ark.
In this project, we integrated research and education. PI KC Claffy conducted lectures and seminars for students and used the results of this project in her classroom. We encourage use of our data for educational curricula development. Young Hyun, the leading Ark developer, learned about Raspberry Pi miniature devices and how to program them to support Ark monitor functions. Using REU funds, we supported 5 UCSD undergraduate students, who worked with CAIDA researchers on data collection, analysis, and visualization therefore acquiring invaluable skills and experience in working with real Internet data.
We now critically depend on the Internet for our professional, personal, and political lives. This dependence has rapidly grown much stronger than our comprehension of its underlying structure, performance limits, dynamics, and evolution since fundamental characteristics of the Internet are perpetually challenging to research and analyze. Our project directly addressed this challenge as the deployed infrastructure and resulting data gave access and experience with worldwide Internet measurements to a larger section of the research community. These results promote informed discussion of the issues that are increasingly relevant to not just the current Internet, but to future large-scale networks as well.
Publications
-
Leveraging the IPv4/IPv6 Identity Duality by using Multi-Path Transport.
I. Livadariu, S. Ferlin, Ö. Alay, T. Dreibholz, A. Dhamdhere, A. Elmokashfi.
IEEE Global Internet Symposium (GI), Apr 2015. -
IPv6 AS Relationships, Cliques, and Congruence.
V. Giotsas, M. Luckie, B. Huffaker, k. claffy.
Passive and Active Network Measurement Workshop (PAM), Mar 2015. -
Measuring and Characterizing IPv6 Router Availability.
R. Beverly, M. Luckie, L. Mosley, k. claffy.
Passive and Active Network Measurement Workshop (PAM), Mar 2015. -
Challenges in Inferring Internet Interdomain Congestion.
M. Luckie, A. Dhamdhere, D. Clark, B. Huffaker, k. claffy.
ACM Internet Measurement Conference (IMC), Nov 2014. -
Inferring Complex AS Relationships.
V. Giotsas, M. Luckie, B. Huffaker, k. claffy.
ACM Internet Measurement Conference (IMC), Nov 2014. -
The 6th Workshop on Active Internet Measurements (AIMS6) Report.
k. claffy, D. Clark, M. Wittie.
ACM SIGCOMM Computer Communication Review (CCR), Oct 2014. -
Measurement and Analysis of Internet Interconnection and Congestion.
D. Clark, S. Bauer, k. claffy, A. Dhamdhere, B. Huffaker, W. Lehr, M. Luckie.
Telecommunications Policy Research Conference (TPRC), Sep 2014. -
A Second Look at Detecting Third-Party Addresses in Traceroute Traces with the IP Timestamp Option.
M. Luckie, k. claffy.
Passive and Active Network Measurement Workshop (PAM), Mar 2014. -
Traffic Identification Engine: An Open Platform for Traffic Classification.
W. De Donato, A. Pescapè, A. Dainotti.
IEEE Network, Mar 2014. -
A Coordinated View of the Temporal Evolution of Large-scale Internet Events.
A. King, A. Dainotti, B. Huffaker, k. claffy.
Computing, Jan 2014. -
Revisiting BGP Churn Growth.
A. Elmokashfi, A. Dhamdhere.
ACM SIGCOMM Computer Communication Review (CCR), Jan 2014. -
A First Look at IPv4 Transfer Markets.
I. Livadariu, A. Elmokashfi, A. Dhamdhere, k. claffy.
ACM SIGCOMM Conference on emerging Networking EXperiments and Technologies (CoNEXT), Dec 2013. -
Inferring Multilateral Peering.
V. Giotsas, S. Zhou, M. Luckie, k. claffy.
ACM SIGCOMM Conference on emerging Networking EXperiments and Technologies (CoNEXT), Dec 2013. -
AS Relationships, Customer Cones, and Validation.
M. Luckie, B. Huffaker, k. claffy, A. Dhamdhere, V. Giotsas.
ACM Internet Measurement Conference (IMC), Oct 2013. -
Speedtrap: Internet-Scale IPv6 Alias Resolution.
M. Luckie, R. Beverly, W. Brinkmeyer, k. claffy.
ACM Internet Measurement Conference (IMC), Oct 2013. -
The 5th Workshop on Active Internet Measurements (AIMS-5) Report.
k. claffy.
ACM SIGCOMM Computer Communication Review (CCR), Jul 2013. -
Internet-Scale IPv4 Alias Resolution with MIDAR.
K. Keys, Y. Hyun, M. Luckie, k. claffy.
IEEE/ACM Transactions on Networking, Apr 2013. -
IPv6 Alias Resolution via Induced Fragmentation.
R. Beverly, W. Brinkmeyer, M. Luckie, J. Rohrer.
Passive and Active Network Measurement Workshop (PAM), Mar 2013. -
Measuring the Deployment of IPv6: Topology, Routing and Performance.
A. Dhamdhere, M. Luckie, B. Huffaker, k. claffy, A. Elmokashfi, E. Aben.
ACM Internet Measurement Conference (IMC), Nov 2012. -
Analysis of Internet-wide Probing using Darknets.
A. Dainotti, A. King, k. claffy.
Building Analysis Datasets and Gathering Experience Returns for Security (BADGERS), Oct 2012. -
The 4th Workshop on Active Internet Measurements (AIMS-4) Report.
k. claffy.
ACM SIGCOMM Computer Communication Review (CCR), Jul 2012. -
Border Gateway Protocol (BGP) and Traceroute Data Workshop Report.
k. claffy.
ACM SIGCOMM Computer Communication Review (CCR), Jul 2012. -
Internet Topology Data Comparison.
B. Huffaker, M. Fomenkov, k. claffy.
Cooperative Association for Internet Data Analysis (CAIDA), May 2012. -
Revealing MPLS tunnels obscured from traceroute.
B. Donnet, M. Luckie, P. Mérindol, J. Pansiot.
ACM SIGCOMM Computer Communication Review (CCR), Apr 2012. -
Issues and future directions in traffic classification.
A. Dainotti, A. Pescapè, k. claffy.
IEEE Network, Jan 2012. -
Analysis of Country-wide Internet Outages Caused by Censorship.
A. Dainotti, C. Squarcella, E. Aben, k. claffy, M. Chiesa, M. Russo, A. Pescapè.
ACM Internet Measurement Conference (IMC), Nov 2011. -
Underneath the hood: ownership vs. stewardship of the internet.
k. claffy.
ACM SIGCOMM Computer Communication Review (CCR), Sep 2011. -
The 3rd Workshop on Active Internet Measurements (AIMS-3) Report.
k. claffy.
ACM SIGCOMM Computer Communication Review (CCR), Jul 2011. -
Internet measurement data management challenges.
M. Fomenkov, k. claffy.
Workshop on Research Data Lifecycle Management, Jul 2011. -
Tracking IPv6 Evolution: Data We Have and Data We Need.
k. claffy.
ACM SIGCOMM Computer Communication Review (CCR), Jul 2011. -
MERLIN: MEasure the Router Level of the INternet.
P. Mérindol, B. Donnet, J. Pansiot, M. Luckie, Y. Hyun.
Conference on Next Generation Internet, Jun 2011. -
Geocompare: a comparison of public and commercial geolocation databases - Technical Report.
B. Huffaker, M. Fomenkov, k. claffy.
Cooperative Association for Internet Data Analysis (CAIDA), May 2011. -
Internet-Scale IPv4 Alias Resolution with MIDAR: System Architecture - Technical Report.
K. Keys, Y. Hyun, M. Luckie, k. claffy.
Cooperative Association for Internet Data Analysis (CAIDA), May 2011. -
Measured Impact of Crooked Traceroute.
M. Luckie, A. Dhamdhere, k. claffy, D. Murrell.
ACM SIGCOMM Computer Communication Review (CCR), Jan 2011. -
MERLIN: MEasure the Router Level of the INternet.
P. Mérindol, B. Donnet, J. Pansiot, M. Luckie, Y. Hyun.
Université catholique de Louvain, Oct 2010. -
The ISMA 2010 AIMS-2 - Workshop on Active Internet Measurements Report.
k. claffy, E. Aben, M. Fomenkov, P. Haga, M. Luckie, Y. Shavitt, J. Augé, R. Beverly, F. Bustamante, B. Donnet, T. Friedman.
ACM SIGCOMM Computer Communication Review (CCR), Sep 2010. -
Dialing privacy and utility: a proposed data-sharing framework to advance Internet research.
E. Kenneally, k. claffy.
IEEE Security & Privacy, Jul 2010. -
Toward Topology Dualism: Improving the Accuracy of AS Annotations for Routers.
B. Huffaker, A. Dhamdhere, M. Fomenkov, k. claffy.
Passive and Active Network Measurement Workshop (PAM), Apr 2010. -
Estimating Routing Symmetry on Single Links by Passive Flow Measurements.
W. John, M. Dusi, k. claffy.
ACM International Workshop on TRaffic Analysis and Classification (TRAC), Mar 2010. -
Internet-Scale IP Alias Resolution Techniques.
K. Keys.
ACM SIGCOMM Computer Communication Review (CCR), Jan 2010.
Additional Content
Internet Laboratory for Empirical Network Science (iLENS)
The iLENS project proposes to upgrade and extend the active measurement infrastructure Archipelago (Ark), to provide academic researchers a laboratory in which to quickly design, implement, and easily coordinate the execution of experiments across a distributed set of dedicated monitors.
iLENS: Proposal
An abbreviated version of the original proposal is shown below.


