phase 3 workflow & tools

16
phase 3 workflow & tools 1 ESO Public Surveys Phase III Workshop 30.11.2010 1 S. Zampieri V. Forchi P. Nunes D. Sforna M. Klein Gebbinck F. Sogni

description

phase 3 workflow & tools. S. Zampieri V. Forchi P. Nunes D. Sforna M. Klein Gebbinck F. Sogni. 1 ESO Public Surveys Phase III Workshop 30.11.2010. workflow. 1. Create Phase 3 Program. 2. Manage Program Permissions. 3. Create Collection and Release. 4. Prepare Data. 5. Validate Data. - PowerPoint PPT Presentation

Transcript of phase 3 workflow & tools

Page 1: phase 3 workflow & tools

phase 3 workflow & tools

1 ESO Public Surveys Phase III Workshop 30.11.2010

1

S. ZampieriV. ForchiP. NunesD. SfornaM. Klein GebbinckF. Sogni

Page 2: phase 3 workflow & tools

2

workflow

1. Create Phase 3 Program

2. Manage Program

Permissions

ESO/EDP PI PI/COI

3. Create Collection

and Release

4. Prepare Data

5. Validate Data

6. Upload Data

7. Close Release

8. Validate Release

(automatic)

9. Validate Release

(scientific)

10. Archive Release

11. Publish Release

Legend:

Page 3: phase 3 workflow & tools

3

start

Page 4: phase 3 workflow & tools

4

login

Page 5: phase 3 workflow & tools

5

manage programs

Page 6: phase 3 workflow & tools

6

manage program permissions

Page 7: phase 3 workflow & tools

7

create new collection

Page 8: phase 3 workflow & tools

8

manage collections

Page 9: phase 3 workflow & tools

9

create new release

Page 10: phase 3 workflow & tools

science data: *.fits, *.fits.fz, PRODCATG

ancillary data: *, associated to science data

scientific meta-data: FITS keywords

associations: ASSONi, ASSOCi

provenance: PROVi

description: release-description.tar

See Phase 3 User DocumentationSee Jörg’s presentation

10

prepare data release

Page 11: phase 3 workflow & tools

java –jar validator.jar –r <dir> \ -m create|update

OutputSummary: console (OK | ERROR)Table of contents: validator.tocValidation errors: validator.errorApplication log messages: validator.log

11

validate data release

Page 12: phase 3 workflow & tools

lftp –u user,pass phase3ftp.eso.org

cd program/collection/release

mput *

Requires secure FTP client (FileZilla, lftp, etc.)

Standard FTP doesn’t work

12

upload data

Page 13: phase 3 workflow & tools

13

close release

Only PI can close a release

Triggers automatic validation process

FTP area becomes unavailable for the user

Page 14: phase 3 workflow & tools

14

release states

1. Open 2. Closed

3a. Valid 3b. Error

4. ToBeArchived

5. Archived

PI/COI

ESO/SYSTEM

ESO/EDP

Page 15: phase 3 workflow & tools

15

view release contents (only for archived releases)

download release description file

Page 16: phase 3 workflow & tools

16

updating or superseding a release

To update a release:

1. Download releasedescription fileCONTENT.ESO

2. CreateCHANGES.USERDELETE fileREPLACE file

3. Validate-m update

4. Upload data +CHANGES.USER