27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 1

State of the IVOA

state of the VOstate of the IVOA

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 2

IVOA : State of the Union

STATE OF THE VO VO vision VO progress

STATE OF THE IVOA news roadmap issues

Part 1 State of the VO

The VO vision

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 5

VO : Generic Science Drivers

data growth : volume and richnessdesire to work on-linemulti-archive sciencelarge database scienceempowerment

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 6

Data re-use : a market fact

HST : more retrieval than ingestHST : more retrieval than ingest

multi- views of a Supernova Remnant

Shocks seen in the X-ray

Heavy elementsseen in the optical

Dust seen in the IR

Relativistic electrons seen in the radio

needles in a haystack b

- faint moving object is a cool white dwarf- may be solution to the dark matter problem- but hard to find : one in a million- even harder across multiple archives

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 9

VO : Technical Drivers

data rate, storage and flops : x 1000 /decade but device bw x 10/decade search engines next to the data

backbone network bw ~Gbpsbut end-end bw ~10Mbps analyse in situ : shift results not data

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 10

network development

higher level protocols ==> transparency

TCP/IP message exchangeHTTPdoc sharing (web) grid suite CPU sharingXML/SOAP data exchange

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 11

the VO concept

web all docs in the world inside your PCVO all databases in the world inside your PC

VO structure

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 13

what its not

not a monolithnot a warehouse

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 14

VO framework

standardsinter-operable datainter-operable software modules

no central VO-command

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 15

publishing metaphor

experiments/facilities are authorsdata centres are publishersVO portals are shopsend-users are readers

VO infrastructure is distribution system.

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 16

work to do

agree standardsbuild software gluebuild VO-aware toolsbuild VO-aware data services

Standards, Standards, Standards

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 18

International VO alliance (IVOA)

http://www.ivoa.net

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 19

IVOA activities

development of standardstechnical working groupsbi-annual interoperability workshops exchange of best practice formal process modelled on W3C

Progress towards the VO

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 21

IVOA standards

key standards so far protocols for tables, images, spectra resource and service metadata definitions standardised query language provisional semantic dictionary standardised grid and web service interfaces

coming up ? generic data model, identification, semantics

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 22

glue accomplishments

prelim versions of key components Registry, Workflow, Sign-on, VOSpace

several crafted-demos some real science done

first users starting to play AVO SWG; AstroGrid AGSAG NVO summer school

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 23

services and tools

data centres upgrading worldwidemany data centres now exporting VOTablereal data services in SkyQuery and others standard tools being VO-ised Aladin, DS9, Sextractor, etc

new tools : VOPlot, SEDTool, TOPCATambitious services : AusVO grid-visualisation

Part 2 State of the IVOA

news

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 26

IVOA news

Successful showing at SPIE Glasgownew recommendation : VOTable 1.1Prague IAU pre-proposal submitted OECD report released : IVOA praised

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 27

project news

NVO : summer school a success France-VO plan similar event

Euro-VO : VOTECH proposal fundedAus-VO : new Grid-funding AstroGrid : RC1 scheduled for end of yearCVO : new VO Database Exploration PrototypeIVO : Pune meeting a success (TBC)

Guest Spot

roadmap

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 30

Done. Demo 05FreezeCurrent

Roadmap V1

SIA V1.0

Architecture

RSM V1.0

UCD V1.0

VOTable V1.0

Spectrum Access V0.9

Observation Data Model V0.9

VOTable V1.1

Registry Interface V0.9

Image Access V1.1

UCD V1+

Roadmap V2

ADQL + SkyNode V0.9

Web Service V0.5

MySpace + MyDB + SRB VOSpace

Workflow Workflow

not yet subject to standardizationprogress on IVOA standard documents

Roadmap as of Jun3 2004

Roadmap 2005+

VOQL 1.0 ‘05Full registry specification 1.0 ‘05Single sign on 1.0 ‘05VOSpace 1.0 ‘05??Work flow 1.0 ‘06Web Services Interfaces 1.0(inc logging) ‘05Data Model plans (Registries - VOResource) ‘05VOList 0.5 ‘05?Ontology (semantics) ‘05->Simulation data (services) milestone’05Preservation 1.0 ‘06 ???January 2005 Coordinated complex demoJuly 2005 Data Centre take-up workshop and evaluation January 2006 Data Centre Interoperability Coordinated demo IAU August 2006Data Centre take-up statistics (July 05, July 06)Reference implementations January 2006Implementations feedback July 2006VO-enable science metric August 2006 IAUJanuary 2007 Community Applications in action? (Jan’05, Jan’06)

IVOA Calendar

Jun 2004 - IVOA Exec, Glasgow, UKJun 2004 - VO session at the SPIE - Glasgow, UKSep 2004 NVO Summer School, Aspen, ColoradoSep 2004 - IVOA InterOp Pune, IndiaSep 2004 - Pune regional VO meetingAutumn 2004 - Astro-RG at GGF12, BrusselsOct 2004 - ADASS, Pasadena (no InterOp)Jan 2005 - NVO demo at the AAS, San Diego with IVOA Exec ?Jan 2005 - Euro-VO demo event - Madrid, SpainMay 2005 - IVOA InterOp, Kyoto, Japan - with IVOA ExecJuly 2005 - Euro-VO tech workshop - MunichAutumn 2005 - ADASS + IVOA InterOp Madrid, SpainAug 2006 - IAU Prague : VO Symposium

IVOA issues

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 34

IVOA issues

whither DM useable product now or design of VO-to-come

VOTable vs TabSky how do we evolve new standards ?

proposed VOTransient WG schedule a discussion

Grid-compliance vs W3 complianceIVOA "Business Plan" charter, strategic plan ...

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 35

meeting goals

general : exchange ideas, discuss issues

confirm state of readiness for Jan demosdraft 2005 roadmap for agreement Jan

provocative finale

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 37

are we getting there ?

data interoperabilityresource interoperability data integrationsingle sign oncomplex jobs

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 38

are we getting there ?

data interoperability good progress VOtable, SIAP, SSAP will need refreshing

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 39

are we getting there ?

resource interoperability good progress RSM doc, harvestable registries progress on WS interfaces prelim storage sharing (MySpace)

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 40

are we getting there ?

data integration not really there plain proximity SkyQuery best attempt really science / algorithm problem not IT need real semantics - not just types

UCNs; units; grammar concentrate on operations not philosophy

who is the rescue team ? UCD++ ? DM ? Semantic Web ?

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 41

are we getting there ?

single sign on liimited IVOA attention (GWS-WG) primitive AstroGrid deployment need to cohere with rest of

academia Shibboleth looks like the winner

27-Sept-2004 Andy Lawrence : IVOA workshop, Pune 42

are we getting there ?

complex jobs : workflow negligible IVOA attention simple AstroGrid deployment Bio way ahead

talking about patenting workflows

FIN