Skip to Content
[CAIDA - Center for Applied Internet Data Analysis logo]
Center for Applied Internet Data Analysis > publications : papers : 2015 : experience_using_mturk
Experience in using MTurk for Network Measurement
G. Huz, S. Bauer, k. claffy, and R. Beverly, "Experience in using MTurk for Network Measurement", in ACM SIGCOMM Workshop on Crowdsourcing and crowdsharing of Big (Internet) Data (C2B(I)D), Aug 2015.
|   View full paper:    PDF    DOI    Related Presentation    |  Citation:    BibTeX    Resource Catalog   |

Experience in using MTurk for Network Measurement

Gokay Huz3
Steven Bauer2
kc claffy1
Robert Beverly3

CAIDA, San Diego Supercomputer Center, University of California San Diego


Massachusetts Institute of Technology's Computer Science & Artificial Intelligence Laboratory (MIT/CSAIL)


Naval Postgraduate School

Conducting sound measurement studies of the global Internet is inherently difficult. The collected data significantly depends on vantage point(s), sampling strategies, security policies, or measurement populations -- and conclusions drawn from the data can be sensitive to these biases. Crowdsourcing is a promising approach to address these challenges, although the epistemological implications have not yet received substantial attention by the research community. We share our findings from leveraging Amazon's Mechanical Turk (MTurk) system for three distinct network measurement tasks. We describe our failure to outsource to MTurk an execution of a security measurement tool, our subsequent successful integration of a simple yet meaningful measurement within a HIT, and finally the successful use of MTurk to quickly provide focused small sample sets that could not be obtained easily via alternate means. Finally, we discuss the implications of our experiences for other crowdsourced measurement research.

Keywords: ipv6, measurement methodology, security
  Last Modified: Tue Nov-17-2020 04:47:25 UTC
  Page URL: