6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

GSC-II and DSS-II ProjectsGSC-II and DSS-II Projects2000 Annual Report2000 Annual Report

Brian McLean19th October 2000

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

Project GoalsProject Goals

Provide products/tools to increase efficiency of telescope operations and observation planning.

ALL-SKY Will support HST, GEMINI, VLT, Galileo and NGST

Digitize available Schmidt Survey photographic plates Distribute 10x compressed images to community

Build object catalogues from images Positions, Proper motions, Magnitudes, Colors,

Classification Distribute to community

Provide access tools to images and catalogue.

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

DSS-II OverviewDSS-II Overview

Scan new survey plates from the Palomar and UK Schmidt telescopes

All-sky, minimum 3 bandpasses (J, F, N) 15 ”) sampling, 23040x23040 pixels of 1.1 Gbyte each Older 25 scans to be replaced as resources permit

STScI/CASB scan archive Magneto-optical discs 8mm tape backup Eventual goal to ingest image archive into STScI DADS system on

DVD

Photometric and astrometric calibration of all images calibrations provided in image headers

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

DSS-II OverviewDSS-II Overview (continued) (continued)

Distribute 10x compressed DSSII images to participating institutions

STScI , ESO, CADC, CDS, NAOJ, BAO, ROE, and Australian consortium. Two sets also to be made for the GEMINI telescopes Disk replication by collaboration with CADC colleagues

All compressed image data available on-line preliminary data on STScI and other webservers

CADC, ESO, NAOJ

Large-scale community distribution at end of project Tentatively by printing about 500 sets on DVD (or other new

technology)

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

Survey Epoch Plate/ Filter Band Depth Scanned CDROM Notes Pal-QV 1983-85 I I aD+W12 V 19.5 100% 100% 1,3

SERC-J 1975-87 I I I aJ +GG395 BJ 23.0 100% 100% 1,2,6

SERC-EJ 1979-88 I I I aJ +GG395 BJ 23.0 100% 100% 1,2,6

POSS-I E 1950-58 103aE+red R 20.0 100% 70% 2

POSS-I O 1950-58 103aO B 21.0 20% 0% 5

Summary of First-Epoch Plate Scans for use in GSC-II and for general reference

Notes to the First Generation Table. All scans (except POSS-I O plate) were made with 25 m (1.7”) sampling. [1] Used in the GSC-I. [2] These scans are part of the 102 volume CD set distributed as DSS-I. [3] Not published, but available on the STScI network server. [4] Plans include completing the -18, -24, and -30 degree zones as time permit. [5] Selected fields only. [6] About 150 J/EJ fields at the lowest latitudes are also being rescanned with 15 m sampling.

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

Survey Epoch Plate/ Filter Band Depth Observed Scanned CD ROM POSS-I I J 1987-00 I I I aJ +GG385 BJ 22.5 100% 100% 100%

POSS-I I F 1987-99 I I I aF+RG610 R 20.8 100% 100% 99%

POSS-I I N 1987-xx I V-N +RG9 I 19.5 97% 96% 38%

AAO-SES 1990-00 I I I aF+OG590 R 22.0 100% 100% 94%

SERC-ER 1990-xx I I I aF+OG590 R 22.0 98% 94% 85%

SERC-I 1990-xx I V-N +RG715 I 19.5 94% 63% 11%

Status of Second-Epoch Plate Scans for DSS-II and GSC-II

Notes to the Second Generation Table. Statistics estimated as of Oct 1, 1999. All scans on this page were made with 15 m (1”) sampling. The POSS-II surveys each cover the northern hemisphere (centers in +90>d>0) in 894 fields. The SERC ER covers the southern equatorial zone (centers in -15<d<0) in 288 fields, and the AAO SES (Second Epoch Survey) covers the remainder of the south in 606 fields. About 100 supplemental short exposure special plates taken in crowded fields are not listed in the table.

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

GSC-II OverviewGSC-II Overview

All-sky catalogue of positions, proper motions, magnitudes and colours

Use all available images : DSS-I/DSS-II images + unpublished (QV,XO)

complete to a minimum of V=18 (Goal is plate limited) GSC-II will have ~10 billion entries for ~2 billion objects GSC-II project is partially funded by external partners

OATo, GEMINI, ESA/ST-ECF and ESA/SA Receive prepublication data access for telescope

operations

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

GSC-II Overview GSC-II Overview (continued)(continued)

Positions < 0.50”absolute; average across a single plate; < 0.20” relative,

over 1/2o field < 0.15”adherence to ICRS reference frame, average over all plates

Proper Motions Errors due to limited time baseline between observation epochs typically 5-30 mas/year in North and 20-40 mas/year in South

Photometry 0.2mag error between 12-18 magnitude

Classification: 95% accuracy within two magnitudes of plate limit

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

Improved Reference CataloguesImproved Reference Catalogues

Astrometric Reference catalogues TYCHO - 2 ICRS reference frame Now precision is limited by measurement error

Photometric Reference catalogues Obtaining CCD sequences (14-18 magnitude) for all

survey plates Second Guide Star Photometric Catalogue (GSPC-II) 95% sky observed

Classification Training sets Availability of deep CCD catalogues over significant

area Tools to allow visual classification of objects from plates

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

Improved Plate ProcessingImproved Plate Processing

Improved software system to process images Sky determination and Object detection, improved deblending Position calibration using Tycho-2 (ICRS) Derived systematic corrections (Masks and Filters) Magnitude calibration using GSPC-II Improved vignetting function and derived emulsion sensitivity

variations. Object classification using decision tree based on ranked object

features All objects loaded into commercial object-oriented database

(Objectivity) Database designed to support recalibration

Use best available calibration during plate processing Recalibrate within database as algorithms/plate modeling/etc

improved

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

HighlightsHighlights

DSS-II Plate scanning is approaching completion POSS-II J and F surveys completed UKSTU SES and ER close to completion N+S IV-N surveys now weather limited Began scanning Southern IV-N plates

ESA/ECF plate processing agreement completed Higher throughput than expected (~2150 plates)

Plate processing completed for available GSC 2.2 plates Recalibration

operational GSPC 2.2 and Tycho 2 Astrometric masks implemented + improved vignetting

GSC 2.1.n deliveries

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

HighlightsHighlights

New Database server system for operational DB 4x500Mhz cpu’s, 2GB memory, H/W RAID, 8 channels on 64-bit PCI bus MUCH faster I/O bandwidth (40-50 Mb/s)

Expansion of disk space for COMPASS 1.8TB on-line for ooDB files

Hierarchical Storage Management software was replaced

DLT jukebox for auxiliary file management Community cooperation in developmental areas

HTM, Virtual Observatory, visualization GSPC-II paper

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

LowlightsLowlights

Resource reductions Vacant scientist position lost Reallocation of 0.25 FTE to NEXUS/NGST work End of George Hawkins contract End of ST-ECF contract

Consequences De-scoped QA for GSC 2.2 release Deferred classification improvements for GSC 2.3 Deferred relative proper motion for GSC 2.3

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

LowlightsLowlights

Database load delays HW problems with installation of RAID array New Hierarchical Storage Management software still

had operational difficulties with ooDB files. Delayed database load when disks were full Technical difficulties with 2nd jukebox

Technical difficulties with installation of DLT jukebox and backup software to automate backups

Manual backups took 8-10 days These problems increased manual operator

intervention Consequences

~3 month schedule slip Deferred POSS-I, QV plates till GSC 2.3

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

Catalog ReleasesCatalog Releases

GSC 2.0 delivered Sky coverage prioritized for GEMINI SV, HST BOP Two-passbands (J,F), without proper motions Deliverable to GEMINI and ESO/VLT only

GSC 2.1.0 delivered Same as GSC 2.0, but with available sky coverage Preliminary application of astrometric masks

GSC 2.1.1 delivered Same as GSC 2.1.0, increased sky coverage Improved Photometric calibration with GSPC 2 Improved Astrometric calibration with Tycho 2

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

Catalog ReleasesCatalog Releases

GSC 2.2 January 2001 Complete sky coverage in 2 passbands Compute error fields Initial community release (www, data-centers)

GSC 2.3 January 2002 Adds available XE, XO, QV plates + IR (XI, XN) Proper motions computed Reclassification with final decision trees Improved precision, etc., depending on resources

final astrometric masks and magnitude equation and vignetting Galaxy photometry Improved global error analysis and removal of systematic errors

colour corrections proper motion corrections

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

Goals for this meetingGoals for this meeting

Identify all critical issues related to GSC 2.2 and 2.3 deliverables Completion of calibration tasks Multi-plate tasks Magnitude equation GSPC 2.2 and 2.3 Galaxy photometry Derivation of final Classification decision trees QA GSC-II paper(s)

SCIENCE PR plans

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

Project ScheduleProject Schedule

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

6th A

nn

ual G

SC

-II

Pro

ject

Meeti

ng

C

B

A

S

SummarySummary

Widespread use and success of DSS-I and GSC-I for telescope operations prompted development of DSS-II and GSC-II for next-generation telescopes.

Approaching completion and not far behind schedule.

“The end is in sight!”

STScI is committed to the “Virtual Observatory” Recognize importance and scientific value DSS-II and GSC-II will be major datasets

(+SDSS,2MASS,FIRST,etc)