Skip to Content
[CAIDA - Center for Applied Internet Data Analysis logo]
Center for Applied Internet Data Analysis > funding : otf-observatory
An Observatory for Realtime Monitoring and Analysis of Internet Blackouts Caused by Censorship
Sponsored by:
Radio Free Asia
We are creating an observatory for Internet shutdowns caused by censorship and seek to make this platform as useful as possible to the general public.

Funding source: Radio Free Asia contract 1002-2018-027. Period of performance: December 4, 2018 - October 31, 2019.

|   Project Summary    Project Page   |

Project Summary

Episodes of politically-motivated interference with Internet access are widespread and frequent. In particular, large-scale connectivity disruptions, even at country-level, are often used by repressive regimes to attack the free flow of information. These events are often undocumented, unverified, surrounded by uncertainty about their timing, extent, cause, and specific mechanisms of execution. Objective and timely measurement data are needed in order to characterize the interference and inform citizens, policymakers, the media, and activists.

With previous funding from NSF and DHS, we have developed an Internet measurement and data analysis platform, IODA, capable of detecting, in near-realtime, macroscopic Internet outages. This project aims to improve this infrastructure in order to monitor the whole Internet 24/7 and observe connectivity disruption events at country/regional/operator level. We will make IODA more useful to the community by improving its user interface, releasing timely reports about shutdown events, and engaging in outreach and collaboration with interested stakeholders.

The ultimate project goal is to benefit populations oppressed by authoritarian regimes limiting their ability to communicate, protest, report events, and stemming the free flow of information. In practice, the results of our project will directly assist various types of actors advocating and fighting for human rights by significantly improving their capability to access accurate data on Internet shutdowns. Through comparison and cross-validation with other complementary data sources, our findings will support the development of different techniques to identify Internet censorship. The prompt detection and investigation of these adversarial events will create opportunities for cooperative targeted analysis that may yield valuable insights as well as the identification of means to effectively circumvent censorship, thus extending the impact of our work to more than awareness-raising and documentation.

Project Objectives and Activities

Activity TypeStatus
Objective 1: Improve IODA's underlying technical design
1.1Improve the reliability of IODA's data sources

(a) Filter out erratic and spoofed Network Telescope traffic
(b) Streamline periodic fetching of a destination list from ISI for Trinarkular probing
(c) Resolve handling of misleading spikes of new BGP prefixes


(b) done
1.2Improve IODA's detection methods

(a) Design and evaluate a time series modeling algorithm (in collaboration with IIJ)
(b) Deploy the time series modeling algorithm for the Network Telescope data
(c) Incorporate the notion of overlapping alerts for calculating alert score
(d) Develop methods to track the historical values of geolocated active probing signals


(a) done
(b) ongoing

Objective 2: Make IODA more useful by improving its user interface
2.1Create videos teaching how to use IODA's UIexecutionongoing
2.2Add country selection field to dashboardimplementation
2.3 Add tooltlps across user interface elementsimplementation
2.4Fix broken visualization of alert bands in IODA UIexploration
2.5Fix redirection errors occurring when clicking on an IODA link while not logged inimplementation
2.6Work with the OTF's Usability Lab to improve IODA UIcollaboration
Objective 3: Release timely reports about shutdown events
3.1Create and curate an IODA Twitter accountexecutionongoing
3.2Blog about Internet shutdownsexecutionongoing
Objective 4: Engage in outreach and collaboration
4.1Engage in discussions on the KeepItOn malling listexecutionongoing
4.2Attend Internet freedom eventsexecutionongoing
4.3Collaborate with other teamsexplorationongoing
4.4Assist IODA usersexecutionongoing

Acknowledgement of awarding agency's support

This project is the result of funding provided by Radio Free Asia under contract number 1002-2018-027. The published material represents the position of the author(s) and not necessarily that of RFA.

  Last Modified: Wed Mar-27-2019 22:23:19 PDT
  Page URL: