Mark5 OS & Mark5C Software Development · State of Mark5’s OS • Debian Lenny (under test) –...
Transcript of Mark5 OS & Mark5C Software Development · State of Mark5’s OS • Debian Lenny (under test) –...
Objective
• State of Mark5’s OS• Mark5A/B Application Software
– SDK9– Version Info
• Maintenance• Mark5C Software / Status
6th IVS TOW April 2011 2
State of Mark5’s OS• Debian Lenny (under test)
– Latest OS distribution supported– Linux kernel 2.6.26– Requires Conduant SDK9
• Debian Etch– Latest OS distribution no longer supported– Last patch available on Jan 2011
6th IVS TOW April 2011 3
State of Mark5’s OS• Why have sites upgraded their OS’s
– Security concerns / maintainability• Mark5 is connected to a network
– Performance improvements• Linux kernel network stack improvements
– Network interface cards (NICs) support» 1 Gbps / 10 Gbps NIC
• Other subsystems– Disk– Raid, etc
– New motherboard support• Old distributions do not support chipsets
– Bug fixes / capabilities Streamstor controller card• Large Module SATA support
6th IVS TOW April 2011 4
Mark5 Application Software
• Mark5A– Converted to work with SDK9.1– Testing on Mark5A / 5B / 5B+– Critical bug
• We are trying to resolve with Conduant• Capacity of disks returns incorrect value• VSN, record, disk_size, etc.
6th IVS TOW April 2011 5
Mark5 Application Software• What it is:
– Two debian packages• Mark5A/5B application
– mark5a_2.0.X-i386.deb– mark5b_2.0.X-i386.deb– Same code, the post install script creates proper
command to start application• streamstor_9.1.0-i386.deb
– Installed / maintained through a standard package manager
• synaptic (apt-get) / aptitude • dpkg
6th IVS TOW April 2011 6
Upgrade Approach• Debian mirror at Haystack
– edit /etc/apt/source.list and add: deb http://evlbi.haystack.mit.edu/debian/ binary/
– run apt-get update
• For Mark5A systems• apt-get install mark5a
– Updates mark5a / streamstor
• apt-get install streamstor– Updates streamstor only
6th IVS TOW April 2011 7
Upgrade Approach (cont)• For Mark5B systems
• apt-get install mark5b– Updates mark5b / streamstor / mk5bio
• apt-get install streamstor– Updates streamstor only
6th IVS TOW April 2011 8
What’s Next• Presently 2 stable Debian OS distro’s
– Lenny / Squeeze• Support for Lenny
– thru February 2012– Debian supports second distribution for 1 year
• After release of new distribution
• Linux kernel 2.6.26 (Lenny) 2.6.32 (Squeeze)– Not Mark5 Application dependent– Conduant / Jungo driver dependent– SDK9.X in house under test
• 64 bit kernel support – Jungo / SDK dependent – Under verification at Conduant.
6th IVS TOW April 2011 9
SDK InformationSDK
VersionShared Library
version numbercc5A/cc5B
linked libraryDebian Package version
9.1 libwdapi1021 -lwdapi1021 streamstor_9.1.0-i386 (u.t)
9.0 libwdapi1011 -lwdapi1011 streamstor_9.0.0-i386 (5c)
8.3beta libwdapi1001 -lwdapi1001 streamstor_1.2.2-i386 (u.t.) (1)
8.3 libwdapi1001 -lwdapi1001 streamstor_1.2.1-i386.deb
8.2 libwdapi921 -lwdapi921 streamstor_1.1.4-i386.deb
8.1 libwdapi910 -lwdapi910 NA
7.6 libwdapi801 -lwdapi801 NA
6.X libwdapi521 -lwdapi623 NA
6th IVS TOW April 2011 10
u.t. -> Under Test (5A/5B/5C)1 -> Contains a firmware fix potential e-transfer problem (disk2net)5c -> for Mark5C only
Maintenance
• Recommend signing up for – debian-security-announce mailing list
• http://lists.debian.org/debian-security-announce/
– Informs the users about security problems by posting security advisories about “all” Debian packages on this list.
• Alternative– Update the package list weekly– Upgrade the required packages if any
6th IVS TOW April 2011 11
Software• DRS Version 0.9.2 official released
– 2Gbps in 1 bank mode – Mark5B data support (User directory)– Support specific for hardware correlation
• DRS Version 1.0 (under development/test)– 4Gbps in 2 bank mode – VDIF Support (user directory)– Support specific for software correlation– Expected release
• Beta version in June• Software Utilities in July
6th IVS TOW May 2011 13
Mark5C Software Utilities• SDK 9.1 officially released
– Correct firmware for 10G DB– Haystack had a special version with appropriate firmware files– Official SDK9.0 from Conduant would not work with 5C
– Verifying operations with DRS 0.92 and pre 1.0
• FuseMk5 modifications– 2 bank mode support under development
• SSErase– 2 bank mode support under development
• Difx support– Direct reading of disk modules in 2 bank mode??– With FuseMk5 initial path
6th IVS TOW April 2011 14
Mark5C Features• Uses the same chassis and disk modules as
Mark 5C/5A• Data rate capability to 2048 Mbps
– to a single ‘8-pack’ disk module
• Data rate capability to 4096 Mbps – to two ‘8-pack’ disk modules
• Uses inexpensive consumer-grade SATA disks• Designed to meet Mark5C specification• 10G CX-4 Ethernet support
6th IVS TOW April 2011 15
Mark5C Features (cont)
• There is no 1pps– Timing or synchronization
• Recording starts immediately after command is issued– What ever is on the 10G wire potentially is
recorded– The data source (RDBE/DBBC/etc) is responsible
for gating• the data on the wire• timing synchronization
6th IVS TOW April 2011 16
PSN Mode 0• Records all packets received • No reordering of packets• Missing packets are not detected• Presently supported by 10G firmware• Used when RDBE / DBBC is connected directly
to the Mark5C• To configuration of the PSN Mode must use
the “packet” command
6th IVS TOW April 2011 17
PSN Mode 1• Using a 32 bit packet serial number
– Guarantees order of packets written to disk– Missing packets replaced by fill pattern
• Used when transmitting data through network switch
• Awaiting firmware from Conduant to support this feature
6th IVS TOW April 2011 18
PSN Mode 2
• Same as PSN Mode 1 with the addition of– If the most significant bit of the PSN is set, the
packet is discarded• A method to discard invalid marked packet• Used when transferring data through a network switch
• Awaiting firmware from Conduant to support this
6th IVS TOW April 2011 19
Mark5C User Directory• Is not backward compatible with 5A/5B• Has support for
– 5B data (0.92)– VDIF Data (1.0)
• If there is a need for bank mode with VDIF support– an early version can be released
• New data structure– Describing the meta data of the scans recorded
• Impact is to hardware correlators
6th IVS TOW April 2011 22
Field System Support
• When will the mark5C be integrated into the field system?– I will be working with Ed Himwich on this
• Mark5C commands• RDBE commands
– Release for standard operations– After extensive testing
6th IVS TOW April 2011 23