phase 3 workflow & tools

1 ESO Public Surveys Phase III Workshop 30.11.2010

1

S. ZampieriV. ForchiP. NunesD. SfornaM. Klein GebbinckF. Sogni

2

workflow

1. Create Phase 3 Program

2. Manage Program

Permissions

ESO/EDP PI PI/COI

3. Create Collection

and Release

4. Prepare Data

5. Validate Data

6. Upload Data

7. Close Release

8. Validate Release

(automatic)

9. Validate Release

(scientific)

10. Archive Release

11. Publish Release

Legend:

3

start

4

login

5

manage programs

6

manage program permissions

7

create new collection

8

manage collections

9

create new release

science data: *.fits, *.fits.fz, PRODCATG

ancillary data: *, associated to science data

scientific meta-data: FITS keywords

associations: ASSONi, ASSOCi

provenance: PROVi

description: release-description.tar

See Phase 3 User DocumentationSee Jörg’s presentation

10

prepare data release

java –jar validator.jar –r <dir> \ -m create|update

OutputSummary: console (OK | ERROR)Table of contents: validator.tocValidation errors: validator.errorApplication log messages: validator.log

11

validate data release

lftp –u user,pass phase3ftp.eso.org

cd program/collection/release

mput *

Requires secure FTP client (FileZilla, lftp, etc.)

Standard FTP doesn’t work

12

upload data

13

close release

Only PI can close a release

Triggers automatic validation process

FTP area becomes unavailable for the user

14

release states

1. Open 2. Closed

3a. Valid 3b. Error

4. ToBeArchived

5. Archived

PI/COI

ESO/SYSTEM

ESO/EDP

15

view release contents (only for archived releases)

download release description file

16

updating or superseding a release

To update a release:

1. Download releasedescription fileCONTENT.ESO

2. CreateCHANGES.USERDELETE fileREPLACE file

3. Validate-m update

4. Upload data +CHANGES.USER