Sponsored by the National Science Foundation GENI Exploring Networks of the Future .
-
Upload
norman-follin -
Category
Documents
-
view
216 -
download
1
Transcript of Sponsored by the National Science Foundation GENI Exploring Networks of the Future .
Sponsored by the National Science Foundation
GENIExploring Networks of the Future
www.geni.net
Sponsored by the National Science Foundation 2GENI Introduction www.geni.net
Outline
What is GENI?
How is GENI being used?
Key GENI Concepts
Demo: A simple experiment using GENI
Sponsored by the National Science Foundation 3GENI Introduction www.geni.net
GENI: Infrastructure for Experimentation
GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.
Sponsored by the National Science Foundation 4GENI Introduction www.geni.net
GENI: Infrastructure for Experimentation
GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.
Sponsored by the National Science Foundation 5GENI Introduction www.geni.net
Multiple GENI Experiments run Concurrently
Resources can be shared between slices
Experiments live in isolated
“slices”
Sponsored by the National Science Foundation 6GENI Introduction www.geni.net
GENI is “Deeply Programmable”
I install software I want throughout my network slice (into routers, switches, …) or control
switches using OpenFlow
OpenFlow part of the experiment not only the infrastructure
Sponsored by the National Science Foundation 7GENI Introduction www.geni.net
GENI Compute Resources
GENI RacksGENI Wireless compute nodes
Existing Testbeds
Emulab
Planetlab
ORBIT
Sponsored by the National Science Foundation 8GENI Introduction www.geni.net
Creating and deploying GENI racks
Ilia BaldineRENCIMore resources / rack,fewer racks
Rick McGeerHP Labs
Fewer resources / rack,more racks
Latest addition
Rajesh Narayanan DELL
KC Wang Clemson
Sponsored by the National Science Foundation 9GENI Introduction www.geni.net
GENI Networking Resources
Networking within a Rack
National Research Backbones(e.g. Internet2)
Regional Networks(e.g. CENIC)
WiMAX Base Stations
4G/3G GENI network
Sponsored by the National Science Foundation 10GENI Introduction www.geni.net
FederationGENI grows by GENI-enabling heterogeneous infrastructure
Avoid technology “lock in” and grow quickly by incorporating existing infrastructure
Backbone #1
Regional
GENI Rack
GENI Rack
Access#1
CommercialClouds
CorporateGENI suites
Non-USTestbeds
ResearchTestbed
Campus
My experiment runs acrossthe evolving GENI federation.
My GENI Slice
This approach looks remarkably familiar . . .
Sponsored by the National Science Foundation 11GENI Introduction www.geni.net
GENI Architecture
• Flexible network / cloud research infrastructure
• Also suitable for physics, genomics, other domain science
• Distributed cloud (racks) for content caching, acceleration, etc.
MetroResearch
Backbones
InternetISPU N I V E R S I T YU N I V E R S I T Y
U N I V E R S I T YU N I V E R S I T Y
Regional Networks Campus
g
g
gLegend
GENI-enabled hardware
Layer 3Control Plane
Layer 2Data Plane
Sponsored by the National Science Foundation 12GENI Introduction www.geni.net
Current GENI buildout
• More WiMAX base stationswith Android handsets
• GENI-enable 5-6regional networks
• Inject moreOpenFlow switchesinto Internet2
• Add GENI Racks to 50-80 locationswithin campuses, regionals, andbackbone networks
GENI Racks serve as programmable routers, distributed clouds, content
distribution nodes, caching or transcoding nodes, etc
Sponsored by the National Science Foundation 13GENI Introduction www.geni.net
GENI Operations
GMOC: GENI Meta-operation Center• Keeps track of outages• Notification system for resource reservation• Monitors most GENI Aggregates
GMOC Google Calendar keeps track of reservations/outages
Sponsored by the National Science Foundation 14GENI Introduction www.geni.net
Federation Extends the Reach of GENI and International Peer Testbeds
Initial plan to federate testbeds on five continents
Sponsored by the National Science Foundation 15GENI Introduction www.geni.net
Testbeds Involved
Modified slide from: http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/MonPlenary/
GEC18_brecht_vermeulen_International_Federation.pdf
Sponsored by the National Science Foundation 16GENI Introduction www.geni.net
Outline
What is GENI?
How is GENI being used?
Key GENI Concepts
Demo: A simple experiment using GENI
Sponsored by the National Science Foundation 17GENI Introduction www.geni.net
How is GENI being Used?
Research• Future Internet
architectures• Software defined
networking• Large scale evaluation of
smart grid protocols
Education• Over 50 classes using
GENI in all levels• Networking and
Distributed systems classes
• Cloud computing classes• WiMAX classes
As of October 2014, GENI has over 2700 users!
Sponsored by the National Science Foundation 18GENI Introduction www.geni.net
Outline
What is GENI?
How is GENI being used?
Key GENI Concepts
Demo: A simple experiment using GENI
Sponsored by the National Science Foundation 19GENI Introduction www.geni.net
GENI: Terms and Definitions
– An experiment uses resources in a slice
– Slices isolate experiments
– Experimenters are responsible for their slices
SliceAbstraction for a collection of resources capable of running experiments
Sponsored by the National Science Foundation 20GENI Introduction www.geni.net
Slice credentials
Clearinghouse and Aggregates
• Clearinghouse: Manages users, projects and slices– Standard credentials shared via custom API or new Common CH API– GENI supported accounts: GENI Portal/CH, PlanetLab CH, ProtoGENI CH
• Aggregate: Provides resources to GENI experimenters– Typically owned and managed by an organization– Speaks the GENI AM API– Examples: PlanetLab, Emulab, GENI Racks on various campuses
Create & Register Slice
Researcher
Aggregate Manager API - listResources - createSliver … Aggregate
ManagerAggregate Resources
users
slices
clearinghouse
projects
Tool
Sponsored by the National Science Foundation 21GENI Introduction www.geni.net
GENI: Terms and Definitions
• A slice : One or more resources provided by an aggregate– E.g. Bare machines, virtual machines, VLANs
Backbone #1
Backbone #2
GENI Rack#3
GENI Rack#2
Access#1
CommercialClouds
CorporateGENI suites
Other-NationProjects
ResearchTestbed
GENI Rack#1
My GENI Slice
My slice contains slivers from many aggregates.
Sponsored by the National Science Foundation 22GENI Introduction www.geni.net
Resource Specifications (RSpecs)
• RSpecs: Lingua franca for describing and requesting resources– “Machine language” for negotiating resources between experiment
and aggregate– Experimenter tools eliminate the need for most experimenters to
write or read RSpec
<?xml version="1.0" encoding="UTF-8"?><rspec xmlns="http://www.protogeni.net/resources/rspec/2" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.protogeni.net/resources/rspec/2 http://www.protogeni.net/resources/rspec/2/request.xsd" type="request" > <node client_id="my-node" exclusive="true"> <sliver_type name="raw-pc" /> </node></rspec> RSpec for requesting a single node
Sponsored by the National Science Foundation 23GENI Introduction www.geni.net
Resource Reservation using RSpecs and the AM API
• Advertisement RSpec: What does an aggregate have?• Request RSpec: What does the experimenter want?• Manifest RSpec: What does the experimenter have?
AggregateManager
Client
ListResources(…)
Advertisement RSpec
CreateSliver(Request RSpec, …)
Manifest RSpec
ListResources(SliceName, …)
Manifest RSpec
Sponsored by the National Science Foundation 24GENI Introduction www.geni.net
Outline
What is GENI?
How is GENI being used?
Key GENI Concepts
Demo: A simple experiment using GENI
Sponsored by the National Science Foundation 25GENI Introduction www.geni.net
Access to GENI
For many experimenters:• no new passwords• familiar login screens
Leverage InCommon forsingle sign-on authentication
Experimenters from 304 educational and research institutions have InCommon accounts
GENI Project Office runs a federated IdP to provide accounts for non-federated organizations.
Sponsored by the National Science Foundation 26GENI Introduction www.geni.net
NTUA is now federated …
1. Choose National Technical University of Athens from the drop down list
2. Use your NTUA username and password to login
Sponsored by the National Science Foundation 27GENI Introduction www.geni.net
Putting it all Together: Demo
• Demo– Create a slice– Create a sliver at one
aggregate• Two computers (raw PCs),
connected by a LAN
– Install and run software on the machines
– View output of software– Delete sliver
• Experimenter tool: Jacks
server(VM)
client(VM)
Sponsored by the National Science Foundation 28GENI Introduction www.geni.net
Ways to Get Help
• Sign Up for :
• Use #geni IRC chatroom
• HowTo pages on the GENI
Wiki
http://groups.geni.net/geni/wiki/GENIExperimenter/GetHelp
Sponsored by the National Science Foundation 29GENI Introduction www.geni.net
Other Important Lists
• geni-announce– GENI news and events
• Experimenters– Announcements of interest to GENI experimenters
• Experimenter-ops– Announcements about infrastructure maintenance
Full list at: http://groups.geni.net/geni/wiki/GENICommunicationChannels
Sponsored by the National Science Foundation 30GENI Introduction www.geni.net
Answer is
Have a question?
Sarah EdwardsNiky Riga
Vic Thomas
which is an email list which only goes to members of the GPO including…
(However, the archive of the list is public)
Sponsored by the National Science Foundation 31GENI Introduction www.geni.net
QUESTIONS?
Sponsored by the National Science Foundation 32GENI Introduction www.geni.net
BACKUP SLIDES
Sponsored by the National Science Foundation 33GENI Introduction www.geni.net
“At scale” GENI prototype
Campus photo by Vonbloompasha
Build GENI at sufficient scale
Infeasible to build a testbed as big as the Internet
GENI-enabled campuses,students as early adopters
HP ProCurve 5400 Switch
NEC WiMAX Base Station
GENI-enabledequipment
GENI-enable testbeds, commercial equipment, campuses, regional and backbone networks
Sponsored by the National Science Foundation 34GENI Introduction www.geni.net
Current GMOC Operational Support
• Monitor and triage problem resolution on the GENI Integrate OpenFlow Core network (Mesoscale)
• Emergency Stop • GENI Experimenter Support • Manage network/systems alarms, outages, maintenances,
– Mesoscale provisioning, maintenance freezes, demo reservations and disruptive experiment reservations (and post-mortem)
• Notifications, Escalation and Reporting • Engineering configuration (Internet2, MOXI, Indiana) and
new Aggregate site, regional and GENI rack turn-up • GMOC Measurement API for GENI Aggregates • Develop new tools for network monitoring and
measurement Modified slide from: http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/RackOpsAndMeasurement/GEC18%20GMOC
%20Presentation.pdf