Mark5 OS & Mark5C Software Development · State of Mark5’s OS • Debian Lenny (under test) –...

24
Mark5 OS & Mark5C Software Development Chester “Chet” Ruszczyk [email protected]

Transcript of Mark5 OS & Mark5C Software Development · State of Mark5’s OS • Debian Lenny (under test) –...

Mark5 OS &Mark5C Software Development

Chester “Chet” [email protected]

Objective

• State of Mark5’s OS• Mark5A/B Application Software

– SDK9– Version Info

• Maintenance• Mark5C Software / Status

6th IVS TOW April 2011 2

State of Mark5’s OS• Debian Lenny (under test)

– Latest OS distribution supported– Linux kernel 2.6.26– Requires Conduant SDK9

• Debian Etch– Latest OS distribution no longer supported– Last patch available on Jan 2011

6th IVS TOW April 2011 3

State of Mark5’s OS• Why have sites upgraded their OS’s

– Security concerns / maintainability• Mark5 is connected to a network

– Performance improvements• Linux kernel network stack improvements

– Network interface cards (NICs) support» 1 Gbps / 10 Gbps NIC

• Other subsystems– Disk– Raid, etc

– New motherboard support• Old distributions do not support chipsets

– Bug fixes / capabilities Streamstor controller card• Large Module SATA support

6th IVS TOW April 2011 4

Mark5 Application Software

• Mark5A– Converted to work with SDK9.1– Testing on Mark5A / 5B / 5B+– Critical bug

• We are trying to resolve with Conduant• Capacity of disks returns incorrect value• VSN, record, disk_size, etc.

6th IVS TOW April 2011 5

Mark5 Application Software• What it is:

– Two debian packages• Mark5A/5B application

– mark5a_2.0.X-i386.deb– mark5b_2.0.X-i386.deb– Same code, the post install script creates proper

command to start application• streamstor_9.1.0-i386.deb

– Installed / maintained through a standard package manager

• synaptic (apt-get) / aptitude • dpkg

6th IVS TOW April 2011 6

Upgrade Approach• Debian mirror at Haystack

– edit /etc/apt/source.list and add: deb http://evlbi.haystack.mit.edu/debian/ binary/

– run apt-get update

• For Mark5A systems• apt-get install mark5a

– Updates mark5a / streamstor

• apt-get install streamstor– Updates streamstor only

6th IVS TOW April 2011 7

Upgrade Approach (cont)• For Mark5B systems

• apt-get install mark5b– Updates mark5b / streamstor / mk5bio

• apt-get install streamstor– Updates streamstor only

6th IVS TOW April 2011 8

What’s Next• Presently 2 stable Debian OS distro’s

– Lenny / Squeeze• Support for Lenny

– thru February 2012– Debian supports second distribution for 1 year

• After release of new distribution

• Linux kernel 2.6.26 (Lenny) 2.6.32 (Squeeze)– Not Mark5 Application dependent– Conduant / Jungo driver dependent– SDK9.X in house under test

• 64 bit kernel support – Jungo / SDK dependent – Under verification at Conduant.

6th IVS TOW April 2011 9

SDK InformationSDK

VersionShared Library

version numbercc5A/cc5B

linked libraryDebian Package version

9.1 libwdapi1021 -lwdapi1021 streamstor_9.1.0-i386 (u.t)

9.0 libwdapi1011 -lwdapi1011 streamstor_9.0.0-i386 (5c)

8.3beta libwdapi1001 -lwdapi1001 streamstor_1.2.2-i386 (u.t.) (1)

8.3 libwdapi1001 -lwdapi1001 streamstor_1.2.1-i386.deb

8.2 libwdapi921 -lwdapi921 streamstor_1.1.4-i386.deb

8.1 libwdapi910 -lwdapi910 NA

7.6 libwdapi801 -lwdapi801 NA

6.X libwdapi521 -lwdapi623 NA

6th IVS TOW April 2011 10

u.t. -> Under Test (5A/5B/5C)1 -> Contains a firmware fix potential e-transfer problem (disk2net)5c -> for Mark5C only

Maintenance

• Recommend signing up for – debian-security-announce mailing list

• http://lists.debian.org/debian-security-announce/

– Informs the users about security problems by posting security advisories about “all” Debian packages on this list.

• Alternative– Update the package list weekly– Upgrade the required packages if any

6th IVS TOW April 2011 11

Mark5C

Software• DRS Version 0.9.2 official released

– 2Gbps in 1 bank mode – Mark5B data support (User directory)– Support specific for hardware correlation

• DRS Version 1.0 (under development/test)– 4Gbps in 2 bank mode – VDIF Support (user directory)– Support specific for software correlation– Expected release

• Beta version in June• Software Utilities in July

6th IVS TOW May 2011 13

Mark5C Software Utilities• SDK 9.1 officially released

– Correct firmware for 10G DB– Haystack had a special version with appropriate firmware files– Official SDK9.0 from Conduant would not work with 5C

– Verifying operations with DRS 0.92 and pre 1.0

• FuseMk5 modifications– 2 bank mode support under development

• SSErase– 2 bank mode support under development

• Difx support– Direct reading of disk modules in 2 bank mode??– With FuseMk5 initial path

6th IVS TOW April 2011 14

Mark5C Features• Uses the same chassis and disk modules as

Mark 5C/5A• Data rate capability to 2048 Mbps

– to a single ‘8-pack’ disk module

• Data rate capability to 4096 Mbps – to two ‘8-pack’ disk modules

• Uses inexpensive consumer-grade SATA disks• Designed to meet Mark5C specification• 10G CX-4 Ethernet support

6th IVS TOW April 2011 15

Mark5C Features (cont)

• There is no 1pps– Timing or synchronization

• Recording starts immediately after command is issued– What ever is on the 10G wire potentially is

recorded– The data source (RDBE/DBBC/etc) is responsible

for gating• the data on the wire• timing synchronization

6th IVS TOW April 2011 16

PSN Mode 0• Records all packets received • No reordering of packets• Missing packets are not detected• Presently supported by 10G firmware• Used when RDBE / DBBC is connected directly

to the Mark5C• To configuration of the PSN Mode must use

the “packet” command

6th IVS TOW April 2011 17

PSN Mode 1• Using a 32 bit packet serial number

– Guarantees order of packets written to disk– Missing packets replaced by fill pattern

• Used when transmitting data through network switch

• Awaiting firmware from Conduant to support this feature

6th IVS TOW April 2011 18

PSN Mode 2

• Same as PSN Mode 1 with the addition of– If the most significant bit of the PSN is set, the

packet is discarded• A method to discard invalid marked packet• Used when transferring data through a network switch

• Awaiting firmware from Conduant to support this

6th IVS TOW April 2011 19

6th IVS TOW April 2011 20

6th IVS TOW April 2011 21

Mark5C User Directory• Is not backward compatible with 5A/5B• Has support for

– 5B data (0.92)– VDIF Data (1.0)

• If there is a need for bank mode with VDIF support– an early version can be released

• New data structure– Describing the meta data of the scans recorded

• Impact is to hardware correlators

6th IVS TOW April 2011 22

Field System Support

• When will the mark5C be integrated into the field system?– I will be working with Ed Himwich on this

• Mark5C commands• RDBE commands

– Release for standard operations– After extensive testing

6th IVS TOW April 2011 23

Questions ?