GEC3 www.geni.net 1
GENI Spiral 1Control Frameworks
Global Environment for Network Innovations
Aaron Falk ([email protected])
www.geni.netClearing house for all GENI news and documents
Goals for this talk
• Review System Decomposition & Control Framework
• Brief overview of the Spiral 1 Control Framework Clusters
• What do I have to do to integrate into a control framework cluster?
GEC3 3www.geni.net
Goals for this talk
• Review System Decomposition & Control Framework
• Brief overview of the Spiral 1 Control Framework Clusters
• What do I have to do to integrate into a control framework cluster?
GEC3 4www.geni.net
Control Framework Functions
• Resource allocation– w/ local policy, secure authorization
• Slice management & control
• Logging for forensics & accounting
GEC3 www.geni.net 5
GENI System Decomposition
GEC3 www.geni.net 6
GENIEnd User
GENI Srvc S3
Srvc S3 Internet GW
GENI Srvc S2GENI Srvc S1
DOE Agg Z(federated aggregate)
Comp Z
GENI Admin and Operations
GENI Aggr A
■ Operator■ Admin
Help Desk
■ Admin & Account Tools
Host A1
Host Ax
GENI Comp B
Comp B
Srvc S2 Measure & Store
Srvc S1 Software Storage
● ■ Srvc Mgr
● ■Aggr Mgr with Ops Portal
Admin Oper
● ■ Srvc Mgr
● ■ Srvc Mgr
GENI Clearinghouse
ComponentRegistry
Principal Registry
●■Ticket: Store Query
●■Principal: Register Authen Query
Slice Registry
TicketLog
SoftwareReposit
●■Slice: Register Cred Issue or Tkt Broker Query
●■Soft Mod: Store Get Query
●■Component: Register Query
Research Org A
● Researcher
● ExperimentSupport Tools
Research Org B
● Slice Admin
● PI
LocalPrincipal Registry
EndUser
via Internetor GENI
■ Ops & Mgmt Tools
● ExperimentSupport Tools● Experiment
Control Tools
Experiment Plane
Measurement Plane
● Control Plane
■ Ops and Mgmt Plane
● ■Comp Mgr with Ops Portal
Admin Oper
● ■Aggr Mgr with Ops Portal
Admin Oper
Keep in mind: this is a snapshot of a work-in-progress. Expect it to change. Tell us what’s wrong with it.
Keep in mind: this is a snapshot of a work-in-progress. Expect it to change. Tell us what’s wrong with it.
Slices
GENI Srvc S3
Visualization Service
GENI Srvc S2GENI Srvc S1
Measure & Store
Software Storage
GENIEnd User
EndUser
via Internetor GENI
DOE Aggr Z(federated aggr)
● ■Aggr Mgr
Aggr Z
GENI Aggr A
● ■Aggr Mgr
Research Org A
● Researcher
Research Org B
Host A1
Host Ax
GENI Aggr B
● ■Aggr Mgr
Comp B
GENI Clearinghouse
CompRegistry
Principal Registry
●■Ticket: Store Query
●■Principal: Register Authen Query
Slice Registry
TicketLog
SoftwareReposit
●■Slice: Register Cred Issue or Tkt Broker Query
●■Soft Mod: Store Get Query
●■Comp: Register Query
Slice ARecord
Slice BRecord
Sliver
Sliver Sliver
Sliver Sliver
“Sliver”
“Sliver”Slice A
Slice B
“Sliver”
“Sliver” “Sliver” “Sliver”
● Researcher
● ExperimentSupport Tools● Experiment
Support Tools● ExperimentControl Tools
Experiment Plane
Measurement Plane
● Control Plane
■ Ops and Mgmt Plane
GENI Operations & Management
■ Operator■ Admin
Help Desk & Tools
■ Admin & Account Tools
■ Ops & Mgmt Tools
GEC3 7www.geni.net
Clearinghouse Federation
●ExperControl Tools
●ExperControl Tools
EU CompEU-A
EU Admin and Ops Org
EU Clearinghouse(federated network)
Trust
Trust
DOE Aggr Z(federated aggr)
GENI Aggr A
Host A1
Host Ax
GENI Comp B
Comp B
EU CompEU-Z
Research Org EU-A
● Researcher
Research Org EU-B
● Slice Admin
● PI
LocalPrincipal Registry
●ExperControl Tools
Link
Link
Route
Route
GENI Clearinghouse
CompRegistry
Principal Registry
●■Ticket: Store Query
●■Principal: Register Authen Query
Slice Registry
TicketLog
SoftwareReposit
●■Slice: Register Cred Issue or Tkt Broker Query
●■Soft Mod: Store Get Query
●■Comp: Register Query
● ■ Comp Mgr with Ops Portal
Admin Oper
● ■ Aggr Mgr with Ops Portal
Admin Oper
Research Org A
● Researcher
●ExperControl Tools
Research Org B
● Slice Admin
● PI
LocalPrincipal Registry
● ■ Aggr Mgr with Ops Portal
Admin Oper
GENI Operations & Management
■ Operator■ Admin
Help Desk & Tools
■ Admin & Account Tools
■ Ops & Mgmt Tools
Experiment Plane
Measurement Plane
● Control Plane
■ Ops and Mgmt Plane
Aggr Z
GEC3 8www.geni.net
Goals for this talk
• Review System Decomposition & Control Framework
• Brief overview of the Spiral 1 Control Framework Clusters
• What do I have to do to integrate into a control framework cluster?
GEC3 9www.geni.net
GENI’s Critical Technical RisksThese risks drive the Prototyping Goals for GENI Spiral 1
GEC3 www.geni.net 10
GENIClearinghouse
Components
Aggregate AComputer Cluster
Components
Aggregate BBackbone Net
Components
Aggregate CMetro Wireless
Create my slice
Critical Risk #1Clearinghouse & control framework is central but never demonstrated
Critical Risk #1Clearinghouse & control framework is central but never demonstrated
Critical Risk #2End-to-end slices across multiple technologies have never been demonstrated
Critical Risk #2End-to-end slices across multiple technologies have never been demonstrated
Key Goals for GENI Spiral 1Drive down the critical technical risks in GENI’s concept
GEC3 www.geni.net 11
GENIClearinghouse
Components
Aggregate AComputer Cluster
Components
Aggregate BBackbone Net
Components
Aggregate CMetro Wireless
Create my slice
Goal #1Fund multiple, competing teams to develop GENI Clearinghouse technology, encourage strong competition within the first few spirals
Goal #1Fund multiple, competing teams to develop GENI Clearinghouse technology, encourage strong competition within the first few spirals
Goal #2Demonstrate end-to-end slices across representative samples of the major substrates / technologies envisioned in GENI; Spiral 1 employs VLANs as “low hanging fruit”
Goal #2Demonstrate end-to-end slices across representative samples of the major substrates / technologies envisioned in GENI; Spiral 1 employs VLANs as “low hanging fruit”
www.geni.net 12
Components
Aggregate AComputer
Cluster
Components
Aggregate BBackbone Net
Components
Aggregate CMetro Wireless
ReferenceDesign
Spiral 1 integration and trial operationsFive competing control frameworks, wide variety of substrates
Components
Aggregate A1
Computer Cluster
Components
Aggregate A2
Optical Network
Components
Aggregate A3
Metro Wireless
Cluster A
Components
Aggregate B1
Optical Network
Components
Aggregate B2
Sensor Network
Cluster B
Components
Aggregate C1
Computer Cluster
Components
Aggregate C2
Programmable Switches
Cluster C
Components
Aggregate D1
Optical Network
Components
Aggregate D2
Sensor Network
Cluster D
Components
Aggregate E1
Computer Cluster
Components
Aggregate E2
Optical Network
Components
Aggregate E3
Sensor Network
Cluster E
Components
Aggregate E4
Programmable Switches
GEC3
Why five control frameworks?
• The control plane provides a critical capability• We don’t yet have agreement on several high-
level issues– E.g., Aspects of federation, Identity, centralization vs.
distribution of services
• Implementation experience is really important to inform design choices– We want ‘running code’
GEC3 www.geni.net 13
Cluster A Integration (uses DETER control framework)
• DETER Trial Integration
– DETER security testbed– Emphasis on federation– Clearinghouse, CM
– 100+ nodes at ISI, UC Berkley
• GMOC– Global Research NOC
(Indiana)
GEC3 www.geni.net 14www.geni.net 14
DETERlab – USC/ISI
PoP PoP
DETERlab - Univ of California, Berkeley
Research Org A
● Researcher
● Slice Admin
● PI
GENI Clearinghouse
RegistriesRegistries
●■Services
● ■ Aggr/Comp Mgr
GENI Admin and Operations
■ Operator■ Admin
Help Desk
■ Admin & Account Tools
■ Ops & Mgmt Tools
● ExperimentSupport Tools● Experiment
Support Tools
● ExperimentSupport Tools
GMOCHerron, Indiana
Univ
DETERWroclawski,
USC/ISI
DETERWroclawski,
USC/ISI
● ■ Aggr/Comp Mgr
PoP PoP
Experiment Plane
Measurement Plane
● Control Plane
■ Ops and Mgmt Plane
Cluster B Integration (uses PlanetLab control framework)
• PlanetLab– Clearinghouse, CM– 800+ nodes– VINI (virtual topologies)
• Enterprise GENI– GENI VLANs on enterprise nets
• SPP Overlay Nodes– Programmable routers
• GUSH Tools– Experiment design tools
• Provisioning Service– Slice & experiment
management tools• Mid-Atlantic Crossroads
– Regional network with VLAN control plane
• GpENI– Regional network with sliceable
optics & routers
• GMOCGEC3 www.geni.net 15www.geni.net 15
Research Org A
● Researcher
● Slice Admin
● PI
Programmable Switch/Router
Programmable Switch
Regional Optical Network
PoP PoP
GENI Clearinghouse
RegistriesRegistries
●■Services
Compute Cluster
● ■ Aggr/Comp Mgr
GENI Admin and Operations
■ Operator■ Admin
Help Desk
■ Admin & Account Tools
■ Ops & Mgmt Tools
● ExperimentSupport
Tools
● ExperimentSupport
Tools
GMOCHerron, Indiana
Univ
PlanetLabPeterson, Princeton
GUSH ToolsAlbrecht Williams
Provisioning ToolsHartman, Univ
Arizona
SPP Overlay Nodes
Turner, Wash Univ
Enterprise GENIMcKeown, Stanford
Mid-Atlantic CrossroadsO’Neil, Univ
Maryland
Regional Optical Network
PoP PoP
GpENISterbenz, Univ Kansas, et al
Experiment Plane
Measurement Plane
● Control Plane
■ Ops and Mgmt Plane
Cluster C Integration (uses ProtoGENI Control Framework)
• ProtoGENI– Clearinghouse, CM– Emulab resources– (370+ nodes)
• CMULab– Home Wireless APs– Emulab cluster– Wireless emulation testbed
• Instrumentation Tools– UK Edulab (compute/store)
• Measurement System– GIMS prototype
• Virtual Tunnels– Dynamic tunnel tools– BGP distribution tools
• GMOC
GEC3 www.geni.net 16www.geni.net 16
Compute Cluster ResidentialWireless APs & Wireless Emulation Testbed
Measurement and Storage Service
Research Org A
● Researcher
● Slice Admin
● PI
GENI Clearinghouse
RegistriesRegistries
●■Services
Compute Cluster, Programmable Switch
● ■ Aggregate Manager
GENI Admin and Operations
■ Operator■ Admin
Help Desk
■ Admin & Account Tools
■ Ops & Mgmt Tools
● ExperimentSupport Tools
GMOCHerron, Indiana
Univ
ProtoGENIRegehr, Univ
Utah
ProtoGENIRegehr, Univ
Utah
Instrumentation Tools
Griffioen, Univ Kentucky
Measurement System
Barford, Univ Wisconsin
InstrumentationToolset
Compute Cluster
CMULabAndersen,
Carnegie Mellon
Experiment Plane
Measurement Plane
● Control Plane
■ Ops and Mgmt Plane
Internet GW
Virtual TunnelsFeamster,
GeorgiaTech
Cluster D Integration (uses ORCA Control Framework)
• ORCA/BEN– ORCA resource leasing
software– Metro-Scale Optical Testbed
(BEN)
• Sensor/Actuator Network– CASA (radar, video, weather
sensors)
• Kansei Sensor Network– Wireless sensor network arrays– 3 federated sites each w/~100
sensor nodes
• Vehicular Mobile Network– Programmable nodes with
radios on city busses
• GMOC
GEC3 www.geni.net 17www.geni.net 17
GENI Vehicular Mobile Wireless Network
GENI Optical Network
GENI Sensor/Actuator Wireless Network
GENI Sensor Network
Research Org A
● Researcher
● Slice Admin
● PI
GENI Clearinghouse
RegistriesRegistries
●■Services
● ■ Aggregate Manager
GENI Admin and Operations
■ Operator■ Admin
Help Desk
■ Admin & Account Tools
■ Ops & Mgmt Tools
● ExperimentSupport Tools● Experiment
Support Tools● ExperimentSupport Tools
GMOCHerron, Indiana
Univ
ORCA/BENBaldine and
Chase, RENCI and Duke
Vehicular MobileLevine, Univ
Mass
Sensor/ActuatorKurose, Univ
Mass
Kansei Sensor Network
Arora,Ohio State
PoP PoP
Experiment Plane
Measurement Plane
● Control Plane
■ Ops and Mgmt Plane
Cluster E Integration (uses ORBIT control framework)
• ORBIT– Heterogeneous testbed
control, management, & measurement software
– WINLAB wireless testbeds resources (400+ sensor nodes)
– NICTA (Australia) wireless outdoor traffic testbed
• WiMAX– Open, programmable
WiMAX base station
• GMOC
GEC3 www.geni.net 18www.geni.net 18
GENI Wireless NtwkResearch Org A
● Researcher
● Slice Admin
● PI
GENI Wireless Metro Network
GENI Clearinghouse
RegistriesRegistries
●■Services
● ■ Aggregate Manager
GENI Admin and Operations
■ Operator■ Admin
Help Desk
■ Admin & Account Tools
■ Ops & Mgmt Tools
● ExperimentSupport Tools
GMOCHerron, Indiana
Univ
ORBITGruteser,
Rutgers Univ
WiMAXRaychaudhuri, Rutgers Univ
ORBITGruteser,
Rutgers Univ
Experiment Plane
Measurement Plane
● Control Plane
■ Ops and Mgmt Plane
GEC3 www.geni.net 19
GENI Spiral 1 Integration: 5 Control Framework Clusters
1578 Overlay Hosting Nodes1578 Overlay
Hosting Nodes
1579 ProtoGENI
1579 ProtoGENI
1595 GpENI1595 GpENI
1646 CMULab1646 CMULab
1609 DETERTrial
Integration
1609 DETERTrial
Integration
1642 Instrumentation
Tools
1642 Instrumentation
Tools
1613 Enterprise
GENI
1613 Enterprise
GENI
1600 PlanetLab
1600 PlanetLab
1658 Mid-Atlantic Crossroads
1658 Mid-Atlantic Crossroads
1602 Sensor/Actuat
or Network
1602 Sensor/Actuat
or Network
1582 ORCA/BEN
1582 ORCA/BEN
1599 Vehicular Mobile
Network
1599 Vehicular Mobile
Network
1660 ORBIT Framework
1660 ORBIT Framework
1601 Virtual Tunnels
1601 Virtual Tunnels
1657WIMAX
1657WIMAX
1663 Digital Object
Registry
1663 Digital Object
Registry
1633 Kansei Sensor Network
1633 Kansei Sensor Network
1628 Measurement
System
1628 Measurement
System
1604 GENI Meta
Operations
1604 GENI Meta
Operations
1643 Programmable
Edge Node
1643 Programmable
Edge Node
1621 GUSH Tools
1621 GUSH Tools
1622 Provisioning
Service
1622 Provisioning
Service
1650 Regional
Opt-In
1650 Regional
Opt-In
1632 Security Architecture
1632 Security Architecture
1645 Million- Node GENI1645 Million- Node GENI
1610 GENI at 4-
Year Colleges
1610 GENI at 4-
Year Colleges
1653 Data Plane
Measurements
1653 Data Plane
Measurements
Cluster A Cluster ECluster D Cluster CCluster B
Key:
Projects with active Spiral 1clearinghouse interfaces
STUDY ALL PICK ONE
1631 Embedded Real-time
Measurements
1631 Embedded Real-time
Measurements
1619 Optical Access
Networks
1619 Optical Access
Networks
Column labels showcommon control framework
Goals for this talk
• Review System Decomposition & Control Framework
• Brief overview of the Spiral 1 Control Framework Clusters
• What do I have to do to integrate into a control framework cluster?
GEC3 20www.geni.net
www.geni.net 21
What resources can I use?
Components
Aggregate A
Components
Aggregate B
Components
Aggregate C
These
GENIClearinghouse
Researcher
Resource discoveryAggregates publish resources, schedules, etc., via clearinghouses
Early-adopter researcher, not part of the development team
Across any substrate combination in the cluster
Control plane services developed and operated by cluster anchor project
GEC3
www.geni.net 22
GENIClearinghouse
Components
Aggregate A
Components
Aggregate B
Components
Aggregate C
Create my slice
Slice creationClearinghouse checks credentials & enforces policyAggregates allocate resources & create topologies
GEC3
www.geni.net 23
Components
Aggregate A
Components
Aggregate B
Components
Aggregate C
Experiment – Install my software,debug, collect data, retry, etc.
GENIClearinghouse
ExperimentationResearcher loads software, debugs, collects measurements
GEC3
What to do for Spiral 1?
Some example tasks:• Clearinghouse developers
– Share component manager reference code– Develop discovery services, slice control/mgmt tools– Documentation
• APIs• User manuals
• Aggregates– Develop component RSpecs – Adapt component managers to your system– Documentation
• Component programming guides• Measurements
• Integrate, Test, Demo– 6 months for internal development– 6 months to integrate, use, and fix
GEC3 www.geni.net 24
Top Related