e-RemoteCtrl: Concepts for VLBI station e-RemoteCtrl: Concepts for VLBI station control as part of NEXPReScontrol as part of NEXPReS

Arpad Szomoru (JIVE)

Alexander Neidhardt (FESG), Martin Ettl (FESG), Matthias Mühlbauer (BGK), Walter Alef (MPIfR), Ed Himwich (NASA/GSFC), Christopher Beaudoin (MIT-Haystack),

Christian Plötz (BKG), Arpad Szomoru (JIVE)

NEXPReSNovel EXplorations Pushing Robust e-VLBI Services

NEXPReS WP5/Task 3: Continuous quality monitoring & Station Remote Control NEXPReS WP5/Task 3: Continuous quality monitoring & Station Remote Control

- three-year project - aimed at further developing e-VLBI services of the European VLBI Network (EVN)- incorporating e-VLBI into every astronomical observation conducted by the EVN.-15 astronomical institutes and National Research and Education Network (NREN) providers- e‑Infrastructure project funded by the European Union's Seventh Framework Programme- Four main technical activities:

- Cloud Correlation- Dynamically Provisioned Network Resources- Computing in a Shared Infrastructure- Provisioning High-Bandwidth, High-Capacity Networked Storage

Novel EXplorations Pushing Robust e-VLBI Services

NEXPReS first year review – Brussels – September 8, 2011

- WP5 at JIVE:

- Dealing with increasing complexity of operations

- Handling of data streams in real-time, recorded, mixed

- At 1, 2, 4, 10 (?) Gbps

-More frequent/irregular e-VLBI observations involve

- Much improved monitoring- Both hardware, network- (semi) automated scheduling- Rapid feedback- Robust warning systems

NEXPReS WP5/Task 3: Continuous quality monitoring & Station Remote Control NEXPReS WP5/Task 3: Continuous quality monitoring & Station Remote Control

- three-year project - aimed at further developing e-VLBI services of the European VLBI Network (EVN)- incorporating e-VLBI into every astronomical observation conducted by the EVN.-15 astronomical institutes and National Research and Education Network (NREN) providers- e‑Infrastructure project funded by the European Union's Seventh Framework Programme- Four main technical activities:

- Cloud Correlation- Dynamically Provisioned Network Resources- Computing in a Shared Infrastructure- Provisioning High-Bandwidth, High-Capacity Networked Storage

Novel EXplorations Pushing Robust e-VLBI Services

WP5/Task 3:WP5/Task 3:(TUM, MPIfR, JIVE)(TUM, MPIfR, JIVE)

- identify and re-act on observation failures in near real-time- improve diagnostics- allow direct (read) access to the field system control parameters- extend the capabilities of the NASA Field System by

- remote control with authentication, authorization and a operator role management- station and system monitoring

NEXPReS WP5/Task 3: Continuous quality monitoring & Station Remote Control NEXPReS WP5/Task 3: Continuous quality monitoring & Station Remote Control

now

July 1st

Remote Control(“e-RemoteCtrl” software)

„„e-RemoteCtrl“ software – the original test bede-RemoteCtrl“ software – the original test bed

TIGO Concepción/Chile

GARS O’Higgins/Antarctica

RT Wettzell/Germany

TTW Wettzell/Germany

Remote Control on Site

Comm

unicat

ion

Tele-working

FS Monitor Client GUI

TCP/IP-Network

FS Monitor Client Communication

FS Monitor Server CommunicationFS Monitor Server Functionality

FS Monitor

Device …

Device …

Device …

Server functionality

Communicationgenerated with thesoftware generator

idl2rpc.pl

Graphical User Interface (GUI)Client (currently wxWidgets)

NASA Field System

e-R

emo

teC

trl

RPCInterface-definition

RPC

RPC = (Sun) Remote Procedure CallsSSH = Secure Shell

„„e-RemoteCtrl“ software – the communication stack for a remote operatore-RemoteCtrl“ software – the communication stack for a remote operator

Wettzell Software Toolbox(well tested SW modules)

FS Monitor Client GUI

TCP/IP-Network

FS Monitor Client Communication

FS Monitor Server CommunicationFS Monitor Server Functionality

FS Monitor

Device …

Device …

Device …

Server functionality

Communicationgenerated with thesoftware generator

idl2rpc.pl

Graphical User Interface (GUI)Client (currently wxWidgets)

NASA Field System

e-R

emo

teC

trl

RPCInterface-definition

RPCEstablish&ControlSSHtunnels

sshbroker

RPC = (Sun) Remote Procedure CallsSSH = Secure Shell

„„e-RemoteCtrl“ software – the communication stack for a remote operatore-RemoteCtrl“ software – the communication stack for a remote operator

Wettzell Software Toolbox(well tested SW modules)

Status monitor

Logging

User input

Mark 5 capacity

Systemtemperature

Connection state

Connection information

„„e-RemoteCtrl“ software – some impressionse-RemoteCtrl“ software – some impressions

Chat

Commandline history

Safe logfiles

Filter logfiles by userdefined tokens

Alarm sound (on/off)

Permanent logfile filter

Operator Input

„„e-RemoteCtrl“ software – some impressionse-RemoteCtrl“ software – some impressions

An authentication and authorization mechanism.

Confirm someone

is authenticand permited

to access

Give him a role

Password + Username

Individual, station specific access rights for every individual client users withfine grained access levels (e.g. only read rights for monitoring or dedicated change rights to interact)

„„e-RemoteCtrl“ software – authentication & authorizatione-RemoteCtrl“ software – authentication & authorization

SysMonSystem Monitoring at Wettzell

- - Collect dataCollect data from several sensors at the telescope and site - - VisualizeVisualize the data with graphs and diagrams- - ArchiveArchive the collected data- (- (ReactReact according to predefined rules ))

SysMon – System Monitoring at WettzellSysMon – System Monitoring at Wettzell

→ Get a better knowledge about the system behavior during

1. Session

2. Post processing

SysMon – System Monitoring at WettzellSysMon – System Monitoring at Wettzell

Local safety for people and systems in combination with reliability in operations

Data for science and analysis

Data forsystem operations

Data fordiagnosis

Meteo, WVR, Clock offsets, …=> low sampling rates=> as scheduled

Power supply, wind uploads, emergency stops, rack temp., …=> medium sampling rates=> permanently

Servo currents, contouring errors, … => high sampling rates=> on demand

See also:Monitoring and Control Interface

Collaboration Group

SysMon – System Monitoring at WettzellSysMon – System Monitoring at Wettzell

Windsensor displaySafety-system display

SysMon – System Monitoring at WettzellSysMon – System Monitoring at Wettzell

Current status – a “e-RemoteCtrl” network

Current status – a “e-RemoteCtrl” networkCurrent status – a “e-RemoteCtrl” network

parallel remote attendance test

IVS Cont11 Test

Current status – a “e-RemoteCtrl” networkCurrent status – a “e-RemoteCtrl” network

TIGOWebcam

TIGOe-RemoteCtrl

WettzellControl

WettzellMark5B+Control

TIGOShifts

22

Thank youSoftware available under http://www.econtrol-software.de