Network measurement II...The speed of end points matter OS of end-points matter • End points are...

Network measurement II Sebastian Castro – NZRS 27th May 2015 Victoria University

•  Network measurement in the wild •  Common pitfalls in methodologies •  Network measurement datasets •  Stories •  Our work

Agenda

May 27, 2015 Network Measurement 2

•  Active Measurement Project, Waikato University http://amp.wand.net.nz/ 20+ probes across New Zealand for active network measurement NZRS strong supporter of the project

AMP Project


•  https://www.truenet.co.nz/ •  NZ Organization doing broadband

measurement •  Results used by media and government to

decide who’s best

Truenet


•  ISP speed index http://ispspeedindex.netflix.com/

•  Every Netflix client does network measurement: latency, loss, jitter, bandwidth

•  Main objective: maximize user experience, minimize buffering

•  New Zealand case: Best SNAP, worse Spark

Netflix


•  Active measurement of critical DNS infrastructure Latency, Packet loss https://atlas.ripe.net/dnsmon/

RIPE DNSMON


•  Distributed measurement platform •  8200 probes around the world! •  Open API to execute measurements •  DNS, traceroute, ping, HTTP, HTTPS •  Possibilities are endless!

https://labs.ripe.net/Members/wilhelm/cyclone-pam-and-the-internet-in-vanuatu

RIPE Atlas


•  Consortium of research, industry and public-interest partners

•  Platform, data, tools and visualizations •  http://www.measurementlab.net/ •  Notable tools: NDT, Glasnot

MLab


•  Throughput != User experience Testing throughput with web traffic

•  Delay != Web response Different layers A web request includes: DNS query and response, TCP connection, object request, object transfer

•  Use ICMP to test everything Mixed policies how to handle ICMP Could get de-prioritized, dropped, etc. When possible, use application traffic

Common pitfalls


•  Bandwidth != Throughput Throughput is from an application PoV Bandwidth is a measure of capacity UDP will give you something closer to BW TCP will give you something closer to Throughput. The speed of end points matter OS of end-points matter

•  End points are key! ISP X offers plans of 50Mbps download Key question: from where to where?

Common pitfalls


•  Practical Guide to Correctly troubleshoot with traceroute https://www.nanog.org/meetings/nanog45/presentations/Sunday/RAS_traceroute_N45.pdf Many of the concepts showed before are explained there, excellent read!

Advise


•  Scans.io From University of Michigan Various Internet wide scans Specific application ports Really useful to avoid doing your own

Datasets


•  DITL: Day in the Life of the Internet Largest collection of DNS data in the world Two days of packet captures, annually Root servers, TLD, other http://www.caida.org/projects/ditl/ https://www.dns-oarc.net/oarc/data/ditl

Datasets


•  RouteViews Near real-time archive of Internet routing data Multiple sites, BGP view of the world Datasets at http://archive.routeviews.org/ Nice visualization at http://bgplay.routeviews.org/ Allow us to do stuff like http://bgp.topology.net.nz

Datasets


•  RIPE RIS Routing Information Service Collection of Internet Routing data by RIPE Similar and complementary to RouteViews Enables query and visualization tools https://stat.ripe.net/widget/looking-glass

Datasets


•  Measure network characteristics •  Determine protocol compliance •  Discover support for new features

Like IPv6? DNSSEC?

•  Independent data for policy reasons Network neutrality

•  Economics of Internet •  Security

Stories from network research


•  Measuring network characteristics How the Internet looks like?

Stories


•  Internet, Brazil and the World Cup http://research.dyn.com/2014/07/brazil-winning-internet/

•  More football and Internet data Internet Traffic During Euro 2012 https://labs.ripe.net/Members/fergalc/internet-traffic-during-euro-2012-final-conclusions

Stories


•  Protocol compliance Path MTU Discovery

http://wand.net.nz/pmtud/ https://www.usenix.org/conference/imc-05/inferring-and-debugging-path-mtu-discovery-failures

http://www.caida.org/~mjl/pubs/measuring-pmtud.pdf

Stories


•  New features support IPv6

http://www.ipv6.org.nz/metrics/ https://www.google.com/intl/en/ipv6/statistics.html

http://www.worldipv6launch.org/measurements/ DNSSEC

http://stats.labs.apnic.net/dnssec http://stats.research.icann.org/dns/tld_report/

Stories


•  Network Neutrality Project Glasnot from Mlab

http://www.measurementlab.net/tools/glasnost Detect if ISP is doing application-specific traffic shaping https://www.battleforthenet.com/internethealthtest/

Stories


•  Economics Who’s the biggest Internet provider in the world? http://research.dyn.com/2014/01/bakers-dozen-2013-edition/

Stories


•  HeartBleed vulnerability Internet wide scanners to find vulnerable sites http://heartbleed.com/

•  Open Resolvers Internet wide scans to find vulnerable servers http://openresolverproject.org/

•  Open NTP No need to repeat http://openntpproject.org/

•  Various Internet wide scans https://scans.io/

Security


•  NZRS: .nz Domain Name Registry •  Part of InternetNZ: A better world through

a better Internet •  Technical Research

DNS Data Analysis Internet Topology Broadband Map

Our Work


•  Internet Topology BGP Map: http://bgp.topology.net.nz IP Map: http://ip.topology.net.nz

•  DNS Data Analysis Domain popularity ranking: http://domain-rank.nzrs.net.nz/popular.html

•  Broadband Map To be announced really soon

•  Spark and DNSSEC validation https://nzrs.net.nz/content/dnssec-validation-spark-nz

Our work


Network measurement II...The speed of end points matter OS of end-points matter • End points are...

Documents

Transcript of Network measurement II...The speed of end points matter OS of end-points matter • End points are...