1GEC3 – October 28-30, 2008 www.geni.net 1

Substrate WORKING GROUP

System Engineering Report

John JacobSWG System Engineer

groups.geni.netGENI working group wiki

2GEC3 – October 28-30, 2008

Goal

By the end of this section you should understand the GPO system engineering role and contributions to this working group.

Some of you should have volunteered to contribute to sections of the SE documents to be completed during spiral-1

www.geni.net 2

3GEC3 – October 28-30, 2008

Agenda

• Introduction• You are here• Spiral 1 projects relevant to Substrate Working

Group• My plans• Technical Discussion

www.geni.net 3

4GEC3 – October 28-30, 2008

Who am I?

• John Jacob• Background - Optical Communications and

Optical Networking• Substrate Systems Engineer

www.geni.net 4

5GEC3 – October 28-30, 2008

My role in this working group

• Frame issues from top-down through document development– Collect & frame issues– Collect input from group & revise

• Synthesize input from bottom-up– Test for & document consensus (or lack of it)– Take & distribute notes– Maintain wiki

www.geni.net 5

6GEC3 – October 28-30, 2008

You are here.

www.geni.net 6

GENIEnd User

GENI Srvc S3

Visualization Service

GENI Srvc S2GENI Srvc S1

DOE Agg Z(federated aggregate)

Aggr Z

GENI Operations & Management

GENI Aggr A

■ Operator■ Admin

Help Desk & Tools

■ Admin & Account Tools

Host A1

Host Ax

GENI Comp B

Comp B

Measure & Store

Software Storage

● ■Aggr Mgr with Ops Portal

Admin Oper

GENI Clearinghouse

ComponentRegistry

Principal Registry

●■Ticket: Store Query

●■Principal: Register Authen Query

Slice Registry

TicketLog

SoftwareReposit

●■Slice: Register Cred Issue or Tkt Broker Query

●■Soft Mod: Store Get Query

●■Component: Register Query

Research Org A

● Researcher

● ExperimentSupport Tools

Research Org B

● Slice Admin

● PI

LocalPrincipal Registry

EndUser

via Internetor GENI

■ Ops & Mgmt Tools

● ExperimentSupport Tools● Experiment

Control Tools

Experiment Plane

Measurement Plane

● Control Plane

■ Ops and Mgmt Plane

● ■Comp Mgr with Ops Portal

Admin Oper

● ■Aggr Mgr with Ops Portal

Admin Oper

The substrate working group focuses on aggregates and their interfaces, with emphasis on the experiment plane

The substrate working group focuses on aggregates and their interfaces, with emphasis on the experiment plane

7GEC3 – October 28-30, 2008

Plans

• Substrate WG Documents and Dates (Spiral 1)– Substrate Capabilities Summary (draft 11/16/08, final

5/1/09)– Substrate Capabilities based use-case(s) (draft 11/25/08,

final 6/1/09)• Derived from Capabilities Summary

• Substrate WG Documents and Dates (GENI Design)– Aggregate Subsystem Technical Description (draft

12/1/08, final 7/1/09)– Aggregate ICD (draft 1/16/09, final 8/1/09)

• Derived from Aggregate Subsystem Technical Description and Substrate Capabilities Summary

www.geni.net 7

8GEC3 – October 28-30, 2008

How GPO system engineering works with working groups

• SE’s draft documents• Internal GPO review• Post publically

– on wiki initially, repository up RSN

• Discuss doc on working group list– Possible one-on-one followups– Please send text

• Revision is posted– Repeat process

www.geni.net 8

9GEC3 – October 28-30, 2008

1st Substrate WG Deliverable

• Substrate Capabilities Summary (draft 11/16/08, final 5/1/09)• What is it?

– A comprehensive catalogue of spiral-1 substrate technologies

– how they are connected

– their relevance to GENI

• Why do we need it?– The substrate defines the experimentation domain of GENI

• we need a detailed view of the substrate as a whole

– Critical input for GENI integrations (Lead by Heidi Picher Dempsey)

– Produce detailed substrate technology coverage maps

– Some non-substrate projects need to analyze Spiral-1 capabilities

• We will depend on those teams providing Spiral-1 substrates to produce the information that is the subject of this document.

www.geni.net 9

10GEC3 – October 28-30, 2008 www.geni.net 10

GENI Spiral 1: 5 Control Framework Clusters (29 Projects)

DETERTrial

Integration

Cluster A

Cluster B

PlanetLab

Enterprise GENI

GUSH Tools

Provisioning Service

Mid-Atlantic Crossroads

GpENI

SPP Overlay Hosting Nodes

Cluster C

ProtoGENI

Virtual Tunnels

CMU Testbeds

Instrumentation Tools

Measurement System

Studies

GENI Meta Operations

Security Architecture

Data Plane Measurements

Optical Access Networks

Cluster D

ORCA/BEN

Vehicular Mobile Network

Sensor/Actuator Network

Kansei Sensor Network

Cluster E

Orbit Framework

WiMAX

PICK ONE

Programmable Edge Node

GENI at 4yr Colleges

Million Node GENI

Regional Opt-In

Digital Object Registry

Embedded Real-time

Measurements

11GEC3 – October 28-30, 2008

Spiral-1 Substrate Projects

National Backbones

NLR

Internet2

Regional Optical

Networks

GpENI

Mid-Atlantic Crossroads

ORCA/BEN

Vehicular Mobile Network

Sensor/Actuator Network

Kansei Sensor Network

Wireless and Sensor Networks

CMU Testbeds

Orbit Framework

WiMAX

Campus Networks

Enterprise GENI

Programmable

Nodes

ProtoGENI

SPP Overlay Hosting Nodes

Programmable Edge Node

CPU Clusters

ProtoGENI

PlanetLab

DETERTrial

Integration

GIMS

Measurement System

?

Virtual Tunnels

All Spiral-1 Substrate Projects need to contribute information to the Substrate Capabilities Summary document.

12GEC3 – October 28-30, 2008

B

C

A

Node 2

B

C

A

Node 1

B

C

A

Node 1

B

C

A

Node 3

GENI Data Plane

GENI Control Framework

GIMS

GENI OPS

Config

Test Eq.

Aggregate Manager

Operations and

Management

Substrate Elements of an Aggregate

Components and Subsystems

“non-GENI” Networks and Nodes

External Instrumentation

Aggregate Specific Tools

Aggregate Network Operations and Management

• All aggregates will have one or more of these elements• All aggregates interface to the control framework (CF) via the aggregate manager

– Native GENI on one interface (CF WG)

– Box specific translations on the other interface (Substrate WG and aggregate projects)

Aggregate Manager

Identify and Describe all elements for each substrate aggregate project

13GEC3 – October 28-30, 2008

Substrates and Networks

LabCampus

Metro/AccessRegional

National

• Spiral-1 has GENI substrate projects located at all network scales– BUT…many substrate projects will need to transit non-GENI networks

• We must identify and describe ALL network connections and services for GENI end-to-end VLAN connections– May have physical details of intermediate networks

• boxes, interfaces, locations, routes…

– May have no physical details of intermediate networks• End-points, services, carriers,…

14GEC3 – October 28-30, 2008

1st Cut at Required Information List• Overview of aggregate hardware components

– Detail component description (Vendor, model, configuration, SW&P…)– Identification of GENI resources (what are you offering to the GENI researcher?)– Identification of non-GENI nodes and networks– Discussion on resource sharing and its isolation– Discussion on the use of resources (how are they configurable, programmable?)

• Overview of intra-aggregate data plane connections– Interface types (bandwidth, protocols, framing)

• Overview of inter-aggregate data plane connections– Interface types (bandwidth, protocols, framing)

• Overview of control plane connections– Identify host(s) of aggregate manager– Interface types (bandwidth, protocols, framing)

• Overview of aggregate services– Description of tools and configuration services– Host(s) and connections for user-helper tools/configurations

• Overview of measurement resources– Discussion of external test equipment resources

• Connections, bandwidths, interfaces– Discussion of internal measurement resources

• Access to information– Discussion of measurement resource sharing– Discussions of measurement resource configuration, programmability

• Initial user-readable drafts of R-specs

B

C

A

Node 2

B

C

A

Node 1

B

C

A

Node 1

B

C

A

Node 3Config

Test Eq.

Aggregate Manager

Operations and

Management

15GEC3 – October 28-30, 2008

Spiral-1 Substrate Projects

National Backbones

NLR

Internet2

Regional Optical

Networks

GpENI

Mid-Atlantic Crossroads

ORCA/BEN

Vehicular Mobile Network

Sensor/Actuator Network

Kansei Sensor Network

Wireless and Sensor Networks

CMU Testbeds

Orbit Framework

WiMAX

Campus Networks

Enterprise GENI

Programmable

Nodes

ProtoGENI

SPP Overlay Hosting Nodes

Programmable Edge Node

CPU Clusters

ProtoGENI

PlanetLab

DETERTrial

Integration

GIMS

Measurement System

?

Virtual Tunnels

We need volunteers to provide initial set of information for initial draft of Substrate Capabilities Summary (due 11/16/2008)

16GEC3 – October 28-30, 2008

Other SWG Documents

• Substrate WG Documents and Dates (Spiral 1)– Substrate Capabilities Summary (draft 11/16/08, final 5/1/09)

– Substrate Capabilities based use-case(s) (draft 11/25/08, final 6/1/09)

• Substrate WG Documents and Dates (GENI Design)– Aggregate Subsystem Technical Description (draft 12/1/08, final 7/1/09)

– Aggregate ICD (draft 1/16/09, final 8/1/09)

Do you have ideas on the other (3) documents? Any volunteers to work on initial outlines?

Submit any thoughts or ideas to: substrate-wg@geni.net

17GEC3 – October 28-30, 2008

Follow-up

• Notes, slides, actions, etc will be sent to the working group mail list and posted on the wiki page: http://groups.geni.net/geni/wiki/GeniSubstrate

www.geni.net 17