Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.
-
date post
15-Jan-2016 -
Category
Documents
-
view
218 -
download
1
Transcript of Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.
![Page 1: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/1.jpg)
Squirrel Overview
Donna Sueper
June, 2007
Aerodyne, University of Colorado, Boulder
![Page 2: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/2.jpg)
Outline Squirrel Motivation
What, Why, How
Squirrel Analysis Flow ChartOutline major steps, Quick & Complete Analysis
Squirrel FeaturesAMS Igor Panel Screen Shots, Resulting Graphs
Squirrel FutureBug list & Feature requests
Closing Remarks
![Page 3: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/3.jpg)
SQUIRREL (SeQUential Igor data RetRiEvaL) is an AMS data management and analysis tool. It is collection of code using the Igor software program.
Silke Hings, Frank Drewnick
James Allan, Jonny Croiser
Ed Dunlea, Donna Sueper
Tim Onasch
And many other AMS Users!
Ongoing, collaborative effort
What is Squirrel?
![Page 4: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/4.jpg)
Why Squirrel?
Aerodyne AMS generates large data sets * Not feasible to load all data into memory * The squirrel approach is to load sufficient data for task at hand (diagnostics, quick look…)
Familiarity with Igor * Publication-quality graphs * Users can write custom code
Recreation of James Allan’s quad program * Generates mass spectra averages, size distributions, time trends; uses same frag list and batch files
![Page 5: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/5.jpg)
How does Squirrel work?
Access Raw HDF files generated from DAQ * HDF is a general purpose file format for storing scientific data * Raw data remains on the disk in randomly accessible HDF format
Create intermediate HDF files (pre-processing) * Files name example: AMS_intermediate_000001.hdf * Some operations which create intermediate files: conversion to Hz, stick recalculation, application of DC markers for PToF size distributions
Select runs to analyze via Todo waves * Todo waves are made up of run numbers, have a special format * For quad users, Todo waves are generalized and versatile mask waves
![Page 6: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/6.jpg)
How does Squirrel access data?
Intermediate HDF files, written to disk, hold processed MS and PToF data
Pre-processed data include open and closed MS sticks (MSSOpen, MSSClosed, MSSDiff, raw MS spectra (MSOpen, MSClosed, MSDiff), PToF sticks (PToF_Stick) and PToF raw (PToF) spectra.
MSSDiff_p matrix stays in memory MSSDiff_p = stick values of difference spectra, rows are run #s,
columns are m/z. The ‘_p’ indicates that it is ‘pre-processed’.
This has implications for how to organize, store Igor experiments!
RAW DATA REMAINS UNMODIFIED in original HDF files
![Page 7: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/7.jpg)
Screen ShotsAMS Panel
Select Data to Act UponCreate, view todo waves
Is it done yet?
Select Analysis Action* Always read top to bottom,
left to right* Buttons make things go* Checkboxes indicate options* Gold buttons are popular* Most default setting are
appropriate * Italicized items aren’t functional
Squirrel Credits, Web link
Manipulate Output, Other Info
![Page 8: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/8.jpg)
Get Index
Pre-ProcessH
DF
Ind
ex T
ab
Quick Look
PT
oF T
abtime series,avg spectrum
image,avg size dist,size binned spectrum
_p data (DAQ sticks)
MS
Tab
Squirrel Data Analysis Flow Chart
![Page 9: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/9.jpg)
Screen ShotsHDF tab Output
Get Index Output =Diagnostics Plot
Pre-Process Output =History Window
Get Index
Pre-Process
_p data
![Page 10: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/10.jpg)
12
8
4
0
4:00 PM4/29/2006
4:30 PM 5:00 PM 5:30 PM 6:00 PM
Screen ShotsMS Tab
PT
oF
Ta
b image,avg size dist,size binned spectrum
_p data
time series,avg spectrum
MS
Ta
b
20015010050m/z
10-7
10-6
10-5
10-4
10-3
10-2
10-1
100
Nitr
ate
equi
vale
nt m
ass
(µg
m-3
) MSSD all 112.709 MSSD Air 110.953 MSSD Water -0.762827 MSSD NO3 0.133794 MSSD SO4 0.257086 MSSD Org 0.703696 MSSD NH4 0.166322 MSSD Chl 0.00246195
![Page 11: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/11.jpg)
1
10
100
1000
NO
3im
_H
iLh
hh
_d
4:54 PM3/20/2006
1
10
100
1000
SO
4im
_H
iLh
hh
_d
1
10
100
1000
NH
4im
_H
iLh
hh
_d
4
2
0
-2
-4
1 10 100 1000
Screen ShotsPToF Tab
25
20
15
10
5
0
x10
-3
100806040
10nm - 100 nm
PT
oF
Ta
b image,avg size dist,size binned spectrum
_p data
time series,avg spectrum
MS
Ta
b
![Page 12: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/12.jpg)
Get Index
Pre-ProcessHD
F I
nd
ex
Ta
b
Quick LookP
To
F T
abtime series
avgs, etc.
size dist,mass spec,image, etc.
_p data (DAQ sticks)
Complete Look
Pre-ProcessHD
F I
nd
ex
Ta
b
Get Index
Check m/z calibration
_p data (recalc sticks)
m/z fitting params
MS
Ta
b
Check baseline
baseline fitting params
Squirrel Data Analysis Flow Chart
PT
oF
Ta
btime seriesavgs, etc.
size dist,mass spec,image, etc.
MS
Ta
b
Modify SI
Ion_user
![Page 13: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/13.jpg)
Screen ShotsCheck m/z calibration
Choose whichpeaks to fit
View peak fitsfor individual runs
View fit infofor many runs
Filter out bad runs
![Page 14: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/14.jpg)
Screen ShotsCheck baseline
Choose stick compliment parameters
Choose fitting parameters
View many runs
View details of one run
![Page 15: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/15.jpg)
Screen ShotsModify SI
Change these values IF daq values wrong
![Page 16: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/16.jpg)
Get Index
Pre-ProcessHD
F I
nd
ex
Ta
b
Quick LookP
To
F T
abtime series
avgs, etc.
size dist,mass spec,image, etc.
_p data (DAQ sticks)
Complete Look
Pre-ProcessHD
F I
nd
ex
Ta
b
Get Index
Check m/z calibration
Co
rre
ctio
ns
Ta
b
_p data (recalc sticks)
m/z fitting params
MS
Ta
b
Check baseline
baseline fitting params
Squirrel Data Analysis Flow Chart
PT
oF
Ta
btime seriesavgs, etc.
size dist,mass spec,image, etc.
MS
Ta
b
Modify SI
Ion_user
Fra
g C
he
cks
Ta
bTweak
Frag table
Do Corrections
corr_fact
Calc Loadings
Airb
ea
mP
To
F
_p data (dc marker)
Loading waves DiagnosticsPlot
![Page 17: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/17.jpg)
Screen ShotsCorrections - Airbeam
![Page 18: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/18.jpg)
Screen ShotsCorrections - PToF
![Page 19: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/19.jpg)
Screen ShotsFrag Checks
![Page 20: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/20.jpg)
Get Index
Pre-ProcessHD
F I
nd
ex
Ta
b
Quick LookP
To
F T
abtime series
avgs, etc.
size dist,mass spec,image, etc.
_p data (DAQ sticks)
Complete Look
Pre-ProcessHD
F I
nd
ex
Ta
b
Get Index
Check m/z calibration
Co
rre
ctio
ns
Ta
b
_p data (recalc sticks)
m/z fitting params
MS
Ta
b
Check baseline
baseline fitting params
Squirrel Data Analysis Flow Chart
PT
oF
Ta
btime seriesavgs, etc.
size dist,mass spec,image, etc.
MS
Ta
b
Modify SI
Ion_user
Fra
g C
he
cks
Ta
bTweak
Frag table
Do Corrections
corr_fact
Calc Loadings
Airb
ea
mP
To
F
_p data (dc marker)
Loading waves DiagnosticsPlot
![Page 21: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/21.jpg)
Version 5.05 or more of Igor
HDF5 xop to be placed in your Igor Extensions folder
Latest Squirrel software, a packed Igor template
http://cires.colorado.edu/jimenez-group/ToFAMSResources/ToFSoftware/SquirrelInfo/(Email Donna Sueper for the username and password for downloading)
What do I need to do to use Squirrel?
![Page 22: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/22.jpg)
Implement existing feature requests
* Journal interface
* Misc panel & graph tweaking
What is next for Squirrel?
Continued bug fixing
![Page 23: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/23.jpg)
Where can I go for more Squirrel info?
http://cires.colorado.edu/jimenez-group/ ToFAMSResources/ToFSoftware/SquirrelInfo
![Page 24: Squirrel Overview Donna Sueper June, 2007 Aerodyne, University of Colorado, Boulder.](https://reader036.fdocuments.net/reader036/viewer/2022070412/56649d495503460f94a25845/html5/thumbnails/24.jpg)
Thanks to fellow coders
We are squirrel !
Special Thanks to James Allan
Thanks in advance for the ongoing collaboration
Thanks!