Post on 06-Feb-2016
description
SEEM Calibration for Manufactured Homes
Regional Technical Forum
July 15, 2014
2
OverviewSame basic structure as single-family calibration.
• Phase I: Estimating total heating energy.– Align SEEM with billing data for homes with strong and
clear heating energy signatures and no off-grid fuels.
• Phase II: Estimating electric heating energy in “typical” program homes.– How is electric heating energy affected by the presence
of natural gas and off-grid fuels?– What can we say about electric heating energy in
homes with weak or unclear heating energy signatures?
3
Phase I: Total heating energy in “well-behaved” homes
4
Phase I general approachPhase I calibration needed because we don’t have perfect knowledge of SEEM inputs. • Built around “SEEM (69/64).” This has…
– Some inputs based on RBSA data (location, wall insulation, heating equipment…)
– Others based on convention (thermostat settings, internal gains…)
– “69/64” refers to inside air temperatures (64°F day and 64°F night), but T-stat isn’t the only standardized input.
• Uses regression to understand differences between SEEM (69/64°F) and billing data (VBDD) heating energy estimates.
• Regression results provide adjustment factors needed to align SEEM (69/64) with VBDD.
5
Sneak preview!Adjustment factors look a lot like the SF calibration factors, but…
• They’re smooth (no abrupt change of slope);
• The Uo variable has been replaced with a more inclusive heating intensity variable.
6
More sneak preview! Measure: Attic insulation from R8 to R19.Examples are randomly chosen RBSA sites, not measure prototypes.
Home A:Zone 1, Heat pump
SEEM.69 kWh
Square feet
Intensity Phase I factor
Phase I kWh
Attic R8 4,417 1200 3.68 1.31 5,786 Attic R19 3,611 1200 3.01 1.42 5,127
807 659
Home B:Zone 2, Elec. FAFAttic R8 21,262 1404 15.14 0.56 11,928Attic R19 16,576 1404 11.81 0.60 9,862
4,687 2,065
7
Phase I groundwork
Phase I analysis is restricted to homes whose RBSA entries…
– Include building characteristics needed to build SEEM inputs, and
– Suggest VBDD reasonably estimates total in-door heating energy
8
Phase I data filters, part 1
• Some filters not really related to indoor heating energy, don’t really threaten our total indoor heating energy estimates.
• Some have a lot to do with indoor heating energy. Need to accounts for these.
• Many “other reason” SEEM failures due to unusually high SLF entries. Staff proposes to included these in baseline SLF averages (but a separate calibration adjustment would be redundant).
Filter definition Reason for exclusion Bias risk
Has large outdoor heating load Billing data can’t isolate indoor heating energy Medium
Has DHP Out of scope (will calibrate MH DHP separately) NA
Missing billing data Can’t generate VBDD estimate for analysis Low
Missing SEEM input data Can’t generate SEEM (69/64) for analysis Low
Failed SEEM run, other reason Can’t generate SEEM (69/64) for analysis High
Has non-utility heat Billing data can’t isolate indoor heating energy High
Poor VBDD fit or low VBDD est. Billing estimates not meaningful. High
9
Phase I data filters, part 2
By the numbers….
n Filter description Total number flagged by filter n
Number that survive prior filters but get caught by filter n
Sample size after first n filters
None NA NA 3211 Has large outdoor heating load 31 31 2902 Has DHP 3 3 2873 Missing billing data 18 15 2724 Missing SEEM input data 6 4 2685 Failed SEEM Run for other reason 8 8 2606 Has non-utility heat 109 86 1747 Poor VBDD fit or low VBDD est. 103 34 140
Phase I sample size: 140
10
Regression backgroundSingle-family calibration found that the difference SEEM 69/64 - VBDD tends to be more greater (more positive) in homes with…
• Poor weatherization (high U-values),
• Colder climates,
• Electric resistance heat (instead of gas or heat pump).
The SF regression estimated these variables’ effects individually -- a separate coefficient for each.
11
The Uo trend for manufactured homes…
Observations:1. Looks similar to SF case.
2. Minor variations in data filters lead to a distinct “dip” around Uo=0.12. (partially caused by a handful of homes with 5+ occupants).
3. Smaller MH sample size makes it very hard to separate different variables’ effects (Uo, equipment, climate, other?).
Pre-1992 Post-1992
12
The (SEEM 69/64) heating intensity trend for manufactured homes…
Observations:1. Trend is more clear.
2. Consistent across minor data filter variants.
3. Naturally combines several important variables (Uo, equipment, climate, etc.)
4. Steeper drop at far left due to combined effects of efficient equipment, good weatherization, mild climate.
13
Wait, what?SEEM (69/64) is part of the dependent variable,
Is it okay for it to also be an explanatory variable? – Goal is to estimate typical VBDD values based on
variables that are known to us when we build measure workbooks.
– SEEM (69/64) is always known (or knowable) to us, so we can use it however we like in our models.
14
Capturing the (approximate) heating intensity trend
1. Can’t represent loess smoother (black curve) in simple Excel formula.
2. Splines would work, but aren’t necessary…
3. A cubic polynomial (blue curve) captures the trend very well.
4. SF calibration used a piecewise-linear function for this. That works okay but has caused some headaches.
15
Regression model fit (v1)Variable Coefficient Std. Error t value p value
(Intercept) -1.08 0.169 -6.3 0.000
(SEEM 69 kWh / sq. ft.) 0.259 0.038 6.8 0.000
(SEEM 69 kWh / sq. ft.)2 -0.0141 0.0026 -5.4 0.000
(SEEM 69 kWh / sq. ft.)3 0.000237 0.000055 4.4 0.000
Gas heat -0.255 0.077 -3.3 0.001
Heat pump 0.205 0.076 2.7 0.008
Adjusted R-square: 38%
• Dependent variable is (SEEM – VBDD)/SEEM. • Energy intensity variable gives the regression a chance to take care of
climate, heating system, and heat loss all at once. • Still had to check to see if the regression treated these variables “fairly”.• Some equipment variables still needed to be included. • Use caution interpreting these variables’ coefficients.
16
Regression model fit (v1)Curviness at right end isn’t really data-driven.
(It’s caused by the polynomial form of our model, not a pattern in the data.)
May be better to force the graph to flatten to the left of the local max (x≈14). See v2.
17
Regression model fit (v2)Idea is to preserve the shape of the data-driven portion of the v1 polynomial (left part).
Method: Define a new variable that equals the v1 polynomial up to the local max, then stays constant to the right.
Fit new regression replacing polynomial terms with new variable.
Cubic polynomial (v1 output)
New curve (v2 input)
18
Regression model fit (v2)Write = SEEM (69/64)/sq. ft. V1 estimates the percent difference as…
For , the V2 estimate is…
For , the V2 estimate is…
19
Regression model fit (v2)Almost identical to v1 to the left of x = 14.6.
Main change is that it’s flattened out to the right.
Smallest SEEM.69/sq. ft. values by heat source:
HP: 1.8, 1.8, 1.8, 1.8, 2.0
ER: 3.8, 3.9, 4.1, 4.4, 4.6
Gas: 5.4, 6.5, 6.7, 7.3, 7.5
20
Phase I Adjustment Factors (v2)Note: Only have about 15 points with SEEM/ft2 < 4.
Need to take care around lower x-value range. Not safe to extrapolate beyond observed data.
21
Phase I Calculation Example
Measure: Attic insulation from R8 to R19.Examples are randomly chosen RBSA sites, not measure prototypes.
Home A:Zone 1, Heat pump
SEEM.69 kWh
Square feet
Intensity Phase I factor
Phase I kWh
Attic R8 4,417 1200 3.68 1.31 5,786 Attic R19 3,611 1200 3.01 1.42 5,127
807 659
Home B:Zone 2, Elec. FAFAttic R8 21,262 1404 15.14 0.56 11,928Attic R19 16,576 1404 11.81 0.60 9,862
4,687 2,065
22
Phase I Decision
“I, __________, move that for existing manufactured homes, the RTF approves the Phase I calibration described above (v2).”
23
Phase I Decision for NC?
“I, __________, move that for manufactured-home new construction measures, the RTF approve the Phase I calibration described above, but with the following modifications…”
24
Phase II: Electric heating energy in “program-like” homes
25
Phase II general approach• Phase I gave us total heating energy estimates for
homes with clear VBDD signatures.
• RTF measure savings needs average electric energy savings for all program homes.
• Phase II uses regression to find out…– How the presence of non-electric fuels affects electric
heating energy,
– How heating energy differs in homes with unclear VBDD signatures.
• Regression focuses on TMY-normalized (VBDD) estimates derived from electric billing data.
26
Phase II data filters, part 1
Sites excluded from Phase-II analysis for three reasons.
• Don’t have to worry about SEEM input data because Phase II doesn’t use SEEM estimates.
• Don’t want to remove sites with non-electric heating fuels or weak VBDD signatures since our goal is to estimate those features’ effects.
• Limit sample to “program-like” homes so we can capture dynamics programs are likely to see.
Filter definition Reason for exclusion Bias risk
Has large outdoor heating load Billing data can’t isolate indoor heating energy Low
Has DHP Out of scope (will calibrate MH DHP separately) NA
Missing billing data Can’t generate VBDD estimate for analysis Low
No hard-wired electric heat Minimal program eligibility screen NA
27
Phase II data filters, part 2
By the numbers….
n Filter description Total number flagged by filter n
Number that survive prior filters but get caught by filter n
Sample size after first n filters
None NA NA 3211 Has large outdoor heating load 31 31 2902 Has DHP 3 3 2873 Missing billing data 18 15 2724 No hard-wired electric heat 78 69 2035 No gas FAF 69 2 201
Phase II sample size: 201
28
Phase II regression fitVariable Estimate Std. Error t value p value
Intercept 1.98 1.02 1.9 0.053
ln(UA × HDD65) 0.73 0.11 6.9 0.000
Heat pump -0.47 0.43 -1.1 0.283
Gas Ht. (kWh) 4K to 8K -1.21 0.50 -2.4 0.016
Gas Ht. (kWh) Over 8K -0.47 0.09 -5.0 0.000
Wood (kWh) 6K to 12K -0.39 0.11 -3.7 0.000
Wood (kWh) Over 12K -0.73 0.14 -5.0 0.000
Bad VBDD fit -0.33 0.10 -3.3 0.001
Adjusted R-square: 40%
29
Phase II adjustments, part 1
VariableRegression coefficient
Adjustment, affected sites
Percent of sites affected
Net average adjustment
Net additive adjustment,
Gas Ht. (kWh) 4K to 8K -0.47 -37% 0.7% -0.2% -0.3%
Gas Ht. (kWh) Over 8K -1.21 -70% 0.5% -0.3% -0.5%
Wood (kWh) 6K to 12K -0.39 -33% 15% -5.0% -4.9%
Wood (kWh) Over 12K -0.73 -52% 11% -5.9% -4.8%
Total adjustment due to energy displaced by other fuels: -10.4%
Bad VBDD fit -0.33 -28% 28% -7.8% -6.8%
Total adjustment due to energy that doesn’t exist: -17.3%
All else equal, VBDD-electric in homes with feature differ from that of homes without feature by a factor of
Feature associated with less VBDD kWh.
30
Phase II Decision
“I, __________, move that the RTF adopt the Phase II calibration for existing manufactured homes as described in the previous slides.”