XMM EPIC MOS Jenny Carter ([email protected]) 6 th EPIC BG WG Meeting Mallorca, Nov 07 BGWG blank...

XMMEPICMOS

Jenny Carter ([email protected])6th EPIC BG WG Meeting

Mallorca, Nov 07

BGWG blank sky updates

Jenny Carter, University of Leicester

Andy Read, University of Leicester

XMMEPICMOS


Mallorca, Nov 07

• BG_WG_04_05: Selection tool, web based. Sketched out html/CGI script tool. Currently on hold.

• BG_WG_04_06: Individual users ghosting script. Available for testing through my pages. Needs link/upload to ESAC page

• Improved ghosting, re-release, add version of exp. maps with those with Jean Ballet flags, re-release files with larger source exclusion region (central residual sources)

• Sort out Bauer problem• Improve selection tools if worthwhile• Dataset increase, consider

Status at end of last meeting Palermo April 2007

XMMEPICMOS


Mallorca, Nov 07

Current status, November 2007 (1)

• Completed Action Items:• AI_EPIC_BG_WG_04_06 – ghosting script now installed on

web page.• AI_EPIC_BG_WG_05_02 – count rate plots in SSC/PPS

energy bands

• Update of files (events and exposure maps), removing low-E central ring, delivered May 2007.

• Vignetted exposure maps with sources removed for unfilled files delivered May 2007.

• Update of files, corrupt TIME column of refilled event files (FTOOL prob/space?), delivered Aug. 2007.

XMMEPICMOS


Mallorca, Nov 07

Low-E residual sources issue

• ‘Dodgy’ component observations now removed from some data sets

• Updated files on web

May 2007

e.g. M1 M FF 0.5 – 2.0 keV

XMMEPICMOS


Mallorca, Nov 07

Current status, November 2007 (2)

• Uncompleted Action Items:• BG_WG_04_05: Selection tool, web based.

Sketched out html/CGI script tool. Currently on hold, suggest disregard (depending on current use).

• Other plans:• Datasets still to be added to increase file size• Advice regarding scaling exposure maps to

different energy bands – later in presentation

XMMEPICMOS


Mallorca, Nov 07

Blank sky web page

• Updates marked as before

• Addition of count rate graphs as EPIC_BG_WG_05_02 – count rate plots in SSC/PPS energy bands

XMMEPICMOS


Mallorca, Nov 07

XMMEPICMOS


Mallorca, Nov 07

Maps of Blank Sky coverage – some examples

M2 T FF

PN M FF

•http://www.star.le.ac.uk/~jac48/BG/SkyMapsBGWGregions

XMMEPICMOS


Mallorca, Nov 07

User feedback presented to UGDate User Comment Problem Solution Available/Status

Oct-07 R. Gilli Confused over diff. in MOS/pn CR Pointed to Blank Sky CR graphs Oct-07

compared to User Handbook and if on web and KK/SS 2007 paper

MOS CR increasing with revn. as per on quiescent particle-induced

AMR pres. 04/07 Pallermo bkg

Jun-07 M. Jackson Thanks for all Advice required Email regarding Jun-07

your help regarding scaling scaling method.

of Blank Sky files

Jun-07 M. Jackson Query regarding Advised new Jun-07

selection regions selection region -

using SelectRADec tool images sent of

selection regions

Apr-07 H. Chen Exposure maps only Advised scaling Awaiting feedback,

in one energy band method current

Mar-07 G. Trinchieri Inability TL keywords Apr-07

to merge files, need adding

for refilled files (SAS-merge)

Mar-07 J. Ballet V. Useful Bright annulus seen Remove component Mar-07

low energy (200-500eV) culprit observations

some Blank Sky files

Mar-07 D.Hall Questions re Questions dealt

difficulties in with (no problems) Mar-07

extracting out-FOV

events

Dec-06 M. Bauer If task skycast run on Appears to be when after Ongoing

Blank Sky files, backscale running attcalc twice,

unable to assign BACKSCAL investigating

keyword

Nov-06 H. Chen Thank you for 100eV shift seen if Insert TLMINn/MAXn Dec 06, Feb 07

your prompt response spectra created with no keywords. New file

expression in evselect release

Oct-06 D-W. Kim Thank you for making Prob. running SAS task Absence of DATE keywords, Oct-06

your blank sky data evigweight as intended in files,

sets public in the advice added to website

first place!

XMMEPICMOS


Mallorca, Nov 07

Oct-06 D-W. Kim Query regarding Added comments to website Dec-06

filtering expression and user advised by email

Sep-06 Helpdesk Query regarding backscale Advice regarding adding Sep-06

task and DATE keywords adding keywords given

Aug-06 J.Ballet Nice job 1. Offset row Not reproduced Feb-07

you did! 2. livetime discrepancy in row on Needed FLAG&&0x2fb0008 Feb-07

CCD edge PN exposure map

3. Request for extra Needed FLAG&&0x2fb0008

flag in creation of

exposure maps

Aug-06 A.Juett Questions re SP Questions dealt Aug-06

filtering of with (no problems)

blank sky files

Jul-06 M. Ehle Absence of GTI extensions, GTI extensions added. Aug-06

minor bugs in selectRADec Bugs corrected.

script

Jun-06 N.Schartel evselect fails on TSTART/TSTOP Jun-06

GTI filtering keywords to EXPOSUREn

extensions

Mar-06D.Neumann Great that new files

are coming out

Mar-06 R.Saxton File size issues Files reduced Apr-06

(SAS & Linux) and/or split

XMMEPICMOS


Mallorca, Nov 07

Other comments from UG

• How often are these files going to be updated.• previous work up to revn. 1037

• Inclusion of other modes, e.g. timing• look up to revn. 1207 (XMM-Newton at revn.

~1450)

• Refilled files – that have gone through ghosting procedure, issue with flagging of events

XMMEPICMOS


Mallorca, Nov 07

Updates and rare modes – up to revn. 1207, all obs

Mode Total Obs.

EPN EMOS1 EMOS2

Full-frame 8622 2223 3172 3227

Ext. full-frame 730 730 N/A N/A

Large window 895 266 320 309

Large window – free running 11 N/A 5 6

Small window 1323 538 371 424

Small window – free running 22 N/A 11 11

Timing 199 199 N/A N/A

Fast Compressed 7 N/A 5 2

Fast Uncompressed 798 N/A 528 270

Burst 34 34 N/A N/A

Full-frame two modes 10 N/A 5 5

Refresh frame store 31 N/A 16 15

XMMEPICMOS


Mallorca, Nov 07

Effects of ghosting/refilled files• Query from UG – how to filter out good events that are now, for example in the

wrong position spatially in the event file, or how to consider ‘bad’ events that have been ghosted into a ‘good’ area.

• How many extra bad-flagged events are seen in refilled event files

Unfilled NAXIS2

Refilled NAXIS2

NAXIS2 % diff

Unfilled next to

win/border

Refilled next to

win/borderUnfilled next to bad pixel

Refilled next to bad pixel

% diff. next to win

% diff. next to

bad

M1 K FF 449951 522167 16.05 1541 1657 14337 16423 7.53 14.55

M1 M FF 3961156 4505101 13.73 10874 10923 120003 134952 0.45 12.46

M1 T FF 5259638 5849204 11.21 15529 15228 156304 171546 -1.94 9.75

M2 K FF 529422 611002 15.41 2435 2513 11511 12621 3.20 9.64

M2 M FF 4153455 4706427 13.31 15929 16125 88357 95825 1.23 8.45

M2 T FF 5163550 5700938 10.41 19507 18847 109015 115098 -3.38 5.58

PN K EF 617534 671193 8.69 75290 73943 12217 12596 -1.79 3.10

PN M EF 10359282 11291277 9.00 896798 886323 141006 149500 -1.17 6.02

PN T EF 13732526 14967154 8.99 1391740 1369387 220664 232080 -1.61 5.17

PN K FF 2816945 3345998 18.78 274787 297379 37812 41028 8.22 8.51

PN M FF A 10646568 12661536 18.93 940321 1016135 138368 151668 8.06 9.61

PN M FF C 13612751 15717445 15.46 950145 977372 132112 140576 2.87 6.41

PN T FF A 10322523 11498689 11.39 847854 851535 114873 120515 0.43 4.91

PN T FF C 9964874 11060368 10.99 769109 772206 107380 111274 0.40 3.63

XMMEPICMOS


Mallorca, Nov 07

Event selection

• MOS: • #XMMEA 1

• close to CCD border• #XMMEA 5, 6, 8, 9, 10

• close to onboard bad pixel, close to bright pixel, close to dead pixel, close to bad col, close to bad row

• PN:• #XMMEA_2

• close to CCD window• #XMMEA 5, 6, 8

• close to onboard bad pixel, close to bright pixel, close to dead pixel

XMMEPICMOS


Mallorca, Nov 07

Images of files, events flag #XMMEA_1 – refilled files MOS

M1 T FF M1 M FF M1 K FF


XMMEPICMOS


Mallorca, Nov 07

Images of files, events flag #XMMEA_5, 6, 8, 9, 10 – refilled files MOS



XMMEPICMOS


Mallorca, Nov 07

Images of files, events flag #XMMEA_2 – refilled files PN

PN T EF PN M EF PN K EF

PN T FF - A PN M FF - A

PN K FF

PN T FF - C PN M FF - C

XMMEPICMOS


Mallorca, Nov 07

Images of files, events flag #XMMEA_5, 6, 8 – refilled files PN

PN T EF PN M EF PN K EF PN K FF

PN T FF - A PN M FF - APN T FF - C PN M FF - C

XMMEPICMOS


Mallorca, Nov 07

Possible solutions to ghosting problem

• Masking chip gaps more stringently (good events in bad areas) – already the refilled files are conservatively cleaned

• Difficult to get bad events out of good areas

• Ideas? / a limitation to the refilled files and advise on the web page? New ghosting flag?

XMMEPICMOS


Mallorca, Nov 07

Exposure map scaling to different E-bands

• User query – user would like to know how to scale the exposure maps to use in a different energy band

• Original files created between pimin=200 and pimax=10000

User’s exposuremap – own band

Blank Sky exposuremap – in band pi 200 - 10000

Blank Sky file scaled

to user’s energy band

User’s exposuremap – in band pi 200 - 10000

× =

XMMEPICMOS


Mallorca, Nov 07

Scaling exposure maps – testing method

Create a Blank Sky exposure map for a choose band and compared to a Blank Sky exposure map in the original band that has been scaled to this choose band

If this method is valid, the difference between these two files should be very small

Choose band of interest, pi=200 to pi=500

Scale file

User file in band of choice

User file in band of blank sky files

÷

XMMEPICMOS


Mallorca, Nov 07

BGSelector• To replace SelectRADec tool, which selected events within a given

search area, on Blank Sky page

• Currently found at: http://www.star.le.ac.uk/~jac48/tools/

• Can now select on:

• coordinates, equatorial or galactic, within a search radius

• revolution numbers within a range

• exposure times within a range

• time within a range

• nH values within a range

XMMEPICMOS


Mallorca, Nov 07

XMMEPICMOS


Mallorca, Nov 07

Extra slides …

XMMEPICMOS


Mallorca, Nov 07

XMMEA_0 = '(FLAG & 0x1) != 0' / DIAGONALXMMEA_1 = '(FLAG & 0x2) != 0' / CLOSE_TO_CCD_BORDER

XMMEA_5 = '(FLAG & 0x20) != 0' / CLOSE_TO_ONBOARD_BADPIXXMMEA_6 = '(FLAG & 0x40) != 0' / CLOSE_TO_BRIGHTPIXXMMEA_8 = '(FLAG & 0x100) != 0' / CLOSE_TO_DEADPIXXMMEA_9 = '(FLAG & 0x200) != 0' / CLOSE_TO_BADCOL

XMMEA_10= '(FLAG & 0x400) != 0' / CLOSE_TO_BADROWXMMEA_11= '(FLAG & 0x800) != 0' / IN_SPOILED_FRAME

XMMEA_13= '(FLAG & 0x2000) != 0' / ON_BADOFFSETXMMEA_15= '(FLAG & 0x8000) != 0' / FLICKERING

XMMEA_16= '(FLAG & 0x10000) != 0' / OUT_OF_FOVXMMEA_17= '(FLAG & 0x20000) != 0' / IN_BAD_FRAME

XMMEA_19= '(FLAG & 0x80000) != 0' / COSMIC_RAYXMMEA_21= '(FLAG & 0x200000) != 0' / ON_BADPIX

XMMEA_22= '(FLAG & 0x400000) != 0' / REJECTED_BY_GATTIXMMEA_25= '(FLAG & 0x2000000) != 0' / OUT_OF_CCD_WINDOWXMMEA_26= '(FLAG & 0x4000000) != 0' / OUTSIDE_THRESHOLDS

XMMEA_28= '(FLAG & 0x10000000) != 0' / ON_BADROWXMMEA_29= '(FLAG & 0x20000000) != 0' / BAD_E3E4

XMMEA_30= '(FLAG & 0x40000000) != 0' / UNDERSHOOTXMMEA_EM= '(FLAG & 0x766ba000) == 0' / Select good MOS events

XMMEA_SM= '(FLAG & 0xfffffeff) == 0' / Select good MOS events for spectra

XMMEA_0 = '(FLAG & 0x1) != 0' / INVALID_PATTERNXMMEA_2 = '(FLAG & 0x4) != 0' / CLOSE_TO_CCD_WINDOW

XMMEA_3 = '(FLAG & 0x8) != 0' / ON_OFFSET_COLUMNXMMEA_4 = '(FLAG & 0x10) != 0' / NEXT_TO_OFFSET_COLUMN

XMMEA_5 = '(FLAG & 0x20) != 0' / CLOSE_TO_ONBOARD_BADPIXXMMEA_6 = '(FLAG & 0x40) != 0' / CLOSE_TO_BRIGHTPIXXMMEA_8 = '(FLAG & 0x100) != 0' / CLOSE_TO_DEADPIXXMMEA_11= '(FLAG & 0x800) != 0' / IN_SPOILED_FRAME

XMMEA_16= '(FLAG & 0x10000) != 0' / OUT_OF_FOVXMMEA_17= '(FLAG & 0x20000) != 0' / IN_BAD_FRAME

XMMEA_19= '(FLAG & 0x80000) != 0' / COSMIC_RAYXMMEA_20= '(FLAG & 0x100000) != 0' / MIP_ASSOCIATED

XMMEA_21= '(FLAG & 0x200000) != 0' / ON_BADPIXXMMEA_22= '(FLAG & 0x400000) != 0' / SECONDARY

XMMEA_23= '(FLAG & 0x800000) != 0' / TRAILINGXMMEA_25= '(FLAG & 0x2000000) != 0' / OUT_OF_CCD_WINDOW

XMMEA_EP= '(FLAG & 0xfa0000) == 0' / Select good PN events

XMMEPICMOS


Mallorca, Nov 07

Dear Stefano,

you wrote:> I associate Prime Partial W2 and W4 to Small Window and Prime Partial W3andW5> to large Window, having the same pixel dimensions.

In the UHB we are listing only mode names as they are visible in theremote proposal system, too. The W? MOS nomenclature was used in the earlyphase of the mission and might still be present as header keywordsand in SSC products. Please, find below a table of corresponding MOS modenames:

Prime Full Window = full framePrime Partial RFS = refresh frame storePrime Partial W2 = small windowPrime Partial W3 = large windowPrime Partial W4 = small window free running (not offered)Prime Partial W5 = large window free running (not offered)Prime Partila W6 = full frame two nodesFast Uncompressed = timing uncompressed

Cheers,Matthias

Matthias Ehle XMM-Newton SOC User Support Group

XMMEPICMOS


Mallorca, Nov 07

Exposure map scaling to different E-bands

• User query – user would like to know how to scale the exposure maps to use in a different energy band

• Original files created between pimin=200 and pimax=10000

User’s exposuremap – own band

Blank Sky exposuremap – band pi 200 - 10000

Ratio – scaling factor

Blank Sky file scaledto user’s energy band

User’s exposuremap – in band pi 200 - 10000

XMMEPICMOS


Mallorca, Nov 07

• Refresh frame store – 6% exposure in FF• L/S window free running – GATTI off

XMMEPICMOS


Mallorca, Nov 07

Individual queries outstanding• Jean Ballet

1. Offset between count maps and exposure maps, MOS.

• Michael Bauer• Skycast and blank sky files. If use attcalc

more than once then on using task backscale, the backscale keyword is 0.

XMMEPICMOS


Mallorca, Nov 07

Exposure map

• Test with Blank Sky files• create and merge exposure maps

for test band• use pimin=200 and pimax=500 • does scaling of the blank sky file

give the same result?• test by ratio between scaled-bs-

exposure map and this band-bs-exposure map, should be 1.0 all over map if scaling procedure perfect.

• minor differences found• differences very small compared to

max livetime of blank sky exposure map (in this case 931./251324s)

XMMEPICMOS


Mallorca, Nov 07

Images of bad flags – refilled files MOS


Expression MOS:

M1 T FF M1 K FFM1 M FF

Expression for MOS selection: expression="#XMMEA_0 || #XMMEA_1 || #XMMEA_5 || #XMMEA_6 || #XMMEA_8 ||

#XMMEA_11 || #XMMEA_13 || #XMMEA_15 || #XMMEA_16 || #XMMEA_17 || #XMMEA_19 || #XMMEA_21 || #XMMEA_22 || #XMMEA_25 || #XMMEA_26 || #XMMEA_28 || #XMMEA_29 ||

#XMMEA_30"

XMMEPICMOS


Mallorca, Nov 07

Expression for PN: expression="#XMMEA_0 || #XMMEA_2 || #XMMEA_3 || #XMMEA_4 || #XMMEA_5 || #XMMEA_6 ||

#XMMEA_8 || #XMMEA_11 || #XMMEA_16 || #XMMEA_17 || #XMMEA_19 || #XMMEA_20 || #XMMEA_21 || #XMMEA_22

|| #XMMEA_23 || #XMMEA_25"

PN M EFPN T EF

Images of bad flags – refilled files PN

PN K EF PN K FF

PN T FF - C PN T FF - A PN M FF - C PN M FF - A

XMMEPICMOS


Mallorca, Nov 07

My notes – exposure scaling testing

• First image – blankskyM1KFF_scaled

• Second image – diff_bsband_bsscaled

• Third image – ratio_bsband_bsscaled

XMM EPIC MOS Jenny Carter ([email protected]) 6 th EPIC BG WG Meeting Mallorca, Nov 07 BGWG blank...

Documents

Transcript of XMM EPIC MOS Jenny Carter ([email protected]) 6 th EPIC BG WG Meeting Mallorca, Nov 07 BGWG blank...