Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.
-
Upload
elvin-walker -
Category
Documents
-
view
228 -
download
1
Transcript of Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.
![Page 1: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/1.jpg)
R O E NM A N I A N D U C A T I O N E T W O R K
N etE duR o
Monitoring backbone networks
Manuel Șubredu, Valeriu Vraciu – RoEduNet
Chișinău, September 9, 2014
![Page 2: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/2.jpg)
Agenda
Why ? What ? How ? Tools ? Facts !
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 3: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/3.jpg)
Why ?
A picture is worth a thousand words ! – Frederick R. Barnard, 20th century
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 4: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/4.jpg)
What to monitor ?
Backbone and critical equipment – routers, switches, firewalls, load-balancers, etc
Servers and services Values of traffic Error rates Transport network equipment, if available
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 5: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/5.jpg)
How
Always use Industry standards for collecting data like:
SNMP NetFlow v5/v9 and IPFIX
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 6: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/6.jpg)
Tools
OSS Software largely available SNMP based:
NMIS Cacti Weathermap
NetFlow based: NFSEN/NFDUMP
Custom software Maps using free API from Google Maps (CEENGINE
VTR) Maps using different technologies: JS, ActionScript,
PHP, SVG, etc (RoEduNet WeatherMap) Proprietary software
For optical network
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 7: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/7.jpg)
Facts forRomanian Education Network !
NMIS: home: https://opmantek.com/network-
management-system-nmis/ 90 routers and 20 switches monitored Uses SNMP for collection of data Xen based VPS - 1 x Xeon 2.4Ghz, 1G of
memory, 64G of disk OpenSuSE (64 bits) Average load of the server – 2-3 3G of disk space for data since 2009 (5 years) Requires some knowledge of Linux system
and services for setup
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 8: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/8.jpg)
NMIS (main page)
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 9: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/9.jpg)
Facts forRomanian Education Network !
Cacti home: http://www.cacti.net/ Uses SNMP for collecting data Can easily monitor any OID that returns an
integer (think about temperature, number of routes, etc)
Easy deployment and small requirements (web server with PHP)
Easy administration using a web interface Authenticated access, configurable per user
views
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 10: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/10.jpg)
Cacti (custom temperature graph)
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 11: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/11.jpg)
Facts forRomanian Education Network !
Weathermap home: http://www.network-weathermap.com/ Uses RRDs from NMIS Can be build using only OSS technologies like
SVG and JavaScript Is very flexible and can accommodate all kind
of data visualisation Major downside – requires some programming
skills
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 12: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/12.jpg)
RoEduNet Weathermap
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 13: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/13.jpg)
Facts forRomanian Education Network !
Nfsen/nfdump home: http://nfsen.sourceforge.net/ Uses NetFlow (v5 or v9) Can have profiles of subset of data (think about
graphs by service type or by IP addresses) Supports plugins (Perl knowledge is required) Supports alerts based on threshold or deviation
from the mean Major downside – lots of hardware needed on
big networks: 1 server for data processing (8 x Xeon E7000 2.8Ghz with 64G of memory) and 22T of storage for 6 month of NetFlow’s exported by 13 core routers (8-12Gbps average traffic).
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 14: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/14.jpg)
Nfsen (main page)
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 15: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/15.jpg)
Facts forRomanian Education Network !
CEENGINE Visual Traceroute home: https://noc.ceengine.eu/vtr/ Based on Google Maps Heavy use of JS and custom web services Backend and data collector written in Perl
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 16: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/16.jpg)
VTR
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 17: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/17.jpg)
Facts forRomanian Education Network !
Custom maps home: N.A. Frontend based on JS and HTML5 Backend uses multiple OSS services and
technologies: Lots of data input points: email, http, logs,
other databases. PostgreSQL as database server Perl for data processing REST API
Low hardware requirements: 1 Xen based VPS with 1 Processor and 4G or memory.
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 18: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/18.jpg)
Project Asgard
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 19: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/19.jpg)
(Extra slide – RoEduNet Optical network management)
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
![Page 20: Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014.](https://reader031.fdocuments.net/reader031/viewer/2022032015/56649d825503460f94a6832f/html5/thumbnails/20.jpg)
Q ?
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014