Image Calibration Using PixInsight - Duncan...

41
Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017 [email protected]

Transcript of Image Calibration Using PixInsight - Duncan...

Page 1: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Image Calibration Using PixInsight

Duncan Kitchin

Oregon Star Party 2017

[email protected]

Page 2: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Outline

• Introduction

• A tour of the PixInsight user interface

• Calibration & pre-processing walk through

• Calibration & pre-processing demo

• Wrap-up

Page 3: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Introduction

Page 4: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Spectrum of Tools

DeepSkyStacker

MaximDL

ImagesPlus

PixInsight

Complexity

Control

PhotoShop

Page 5: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Workflow Document

• PixInsight workflows can be very complex

– The tools have many options

– Much experimentation can be required to fully understand all of the capabilities

– The return on work put in to understand all of the features can be high

• Writing everything down is key

– Get a copy of my current workflow document

– Most important recommendation: write your own!

Page 6: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Directory Structure

Page 7: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Calibration & Pre-Processing Options

• PixInsight provides a number of tools for calibration & pre-processing– Other tools treat at least calibration as a single black

box

– PixInsight has many tools that can be used to assemble a pre-processing workflow

• PixInsight also includes a “Batch Pre-Processing” (BPP) script– Assembles a single black box for you

– I do not recommend this

Page 8: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Maxim Versus PixInsight

PixInsightMaximDL

Here it is

Page 9: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

A Tour of the PixInsight User Interface(Live Demo)

Page 10: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Overview of Calibration and Pre-Processing

Page 11: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Calibration and Pre-Processing Outline

• Calibration

– Bias subtraction

– Dark subtraction

– Flat frame correction

• Cosmetic Correction

• Registration

• Integration

Page 12: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Defects That We Are Trying to Fix

• Quasi-Consistent Dark Effects– Offsets in the pixel values due to repeatable bias and

dark current

– Hot pixels and bad columns

• Light dependent effects– Uneven illumination

– Uneven photo-response of individual pixels

• One-Off Outliers– Cosmic rays

– Satellites & rocket boosters

Page 13: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Hot Pixels, Bad Columns & Cosmic Rays

Page 14: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Expanded View

Page 15: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Uneven Illumination

Page 16: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Example Flat Frame

Page 17: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Satellites & Boosters

Page 18: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Satellites & Boosters

Page 19: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

The Mechanics of Calibration

• Start with a set of calibration frames– Bias– Dark– Flat

• Set will contain a large number of each of these– Average* the set of each to create master bias, dark and flat

frames

• Calibrate a set of light frames using the calibration set

• Not obvious from the “black box calibration” method:– Some of the calibration frames themselves have to be calibrated– There is more than one order in which the operations can be

done

Page 20: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Components of Pixel Values

Bias Frame Dark Frame(Long)

Flat Frame Light Frame

Page 21: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Calibration Requires Separating These Components

BiasComponent

DarkComponent

FlatComponent

LightComponent

Flat Correction

Page 22: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Averaging (or “Integration”)

• The same integration tool will be used to combine sets of bias, dark and flat frames, as well as registered light frames

• This is the point at which you can (and should) eliminate one-off effects

• PixInsight’s Integration tool contains many statistical outlier rejection algorithms for this purpose

Page 23: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Outlier Rejection

Page 24: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Outlier Rejection Algorithms

• Several options for the rejection algorithm

• Which one is optimal will depend on how many frames you have in the set

• There is also an option for setting an absolute range of values for rejection, which you almost certainly want to turn off

• Experiment using the Blink tool

Page 25: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Algorithms

Number of Frames Algorithm

1 - 5 Percentile clipping

5 - 10 Averaged sigma clipping

> 5 Linear fit clipping

> 10 Sigma clipping

> 15 Winsorized sigma clipping

• Opinions vary on this

• Note that the ranges overlap

Page 26: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Rejection Settings

Set Algorithm

Yes

No

Page 27: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Rejection Settings

Typically 2.500 to 3.000Lower value rejects more

Page 28: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Creating a Master Bias Frame

Integration

M

Page 29: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Creating a Master Dark Frame

Integration

M

Calibration

M

Page 30: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Creating a Master Dark Frame

MCalibration

MIntegration

M

Page 31: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Two Calibration Methods for Darks(and Flats)

• “Pre-calibrate” or “Post-calibrate”

• Which one does MaximDL do?

– It’s inside the black box

– Probably the second one

• Which one does PixInsight do?

– Whichever one you want

– Be sure not to accidentally do both!

Page 32: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

“Post-Calibrate” Workflow

Page 33: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

“Pre-Calibrate” Workflow

Page 34: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

The Next Slide is Important

Page 35: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Calibration Tool

Calibrate optionsfor calibration frames

Only check these forpost-calibration flow

Page 36: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Why Would You Use the More Complex Version?

• Flat frames may have uneven brightness

• This can be fixed in integration of flats by scaling according to brightness

• In order to do this, you need to pre-calibrate flats

Page 37: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Integration for Flats

Scale flats tosame brightness

Take this into accountin rejection algorithm

Page 38: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Final Calibration Workflow

Page 39: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Next Step: Cosmetic Correction

• Final step after calibration

• Removes “escaped” hot pixels & bad columns

• Allows creation of a defect list

– This can take some time, but can be reused later

• Results in extremely clean data going in to post-procesing

Page 40: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Calibration & Pre-Processing(Live Demo)

Page 41: Image Calibration Using PixInsight - Duncan Kitchinduncankitchin.org/.../PixInsight-Calibration-Final.pdf · Image Calibration Using PixInsight Duncan Kitchin Oregon Star Party 2017

Wrap-Up