Manual of Petroleum Measurement Standards Chapter 13...

1

Manual of Petroleum Measurement Standards Chapter 13—Statistical Aspects of Measuring and Sampling Section 2—Methods of Evaluating Meter Proving Data SECOND EDITION, DRAFT 2017

This document is not an API Standard; it is under consideration within an API technical committee but has not received all approvals required to become an API Standard. It shall not be reproduced or circulated or quoted, in whole or in part, outside of API committee activities except with the approval of the Chairman of the committee having jurisdiction and staff of the API Standards Dept. Copyright API. All rights reserved.

2

Introduction

Minimizing petroleum measurement errors, estimating remaining errors and informing affected parties of errors is important to the petroleum industry. A consistent basis for estimating the size and significance of errors is essential for communication among affected parties. A fundamental source of measurement error is the inaccuracy of the meter factor which is a number that represents the performance of a meter throughout a batch.

Meter factors are monitored to gain confidence in the reported volumes and to detect trends or sudden deviations as indications of when to perform maintenance on or calibration of measurement equipment. The purpose of this standard is to suggest procedures for monitoring variations in meter factors so that uncertainties are understood and consistent with the objectives of parties affected by the measurement operations. The procedures for monitoring meter performance, limits on meter factor variations and actions to take because of these variations are left to the agreement among the parties affected by the measurement operations which can depend on company policy, contract agreements, regulations and laws.

3

1 Scope

This standard establishes the basic concepts and procedures to estimate and report meter performance uncertainty in consistent and comparable ways.

2 Normative References

The following referenced documents are indispensable for the application of this document. For dated references, only the edition cited applies. For undated references, the latest edition of the reference document (including any amendments) applies.

API Manual of Petroleum Measurement Standards (MPMS) Chapter 1, Online Terms and Definitions Database API Manual of Petroleum Measurement Standards (MPMS) Chapter 4, Proving Systems API Manual of Petroleum Measurement Standards (MPMS) Chapter 5, Metering API Manual of Petroleum Measurement Standards (MPMS) Chapter 13.3, Measurement Uncertainty

3 Terms, Definitions and Acronyms

For the purposes of this document, the following terms and definitions apply. Terms of more general used may be found in the API MPMS Chapter 1 Online Terms and Definitions Database. Acronyms are defined in the text at first use.

3.1 standard deviation limit A control limit equal to 3 standard deviations from the arithmetic mean of the set. Note: For a set of normal data this limit is also known as the 3‐sigma limit.

3.2 action limits Horizontal lines found on a run chart or control chart which, if exceeded, suggests that some sort of action is necessary to modify the underlying process or to modify the reports generated from the process. Related terms: tolerance limit, warning limit.

3.3 central line A line on a control chart or run chart that represents the central value.

3.4 central value The mean value of the statistic under consideration. Synonym: central tendency.

3.5 control chart A graphical method for evaluating whether a process is in or out of statistical control.

3.6 control limits Horizontal lines on a control chart used in the evaluation of whether or not a process is in statistical control.

3.7 control log A tabular method for evaluating whether a process is in or out of statistical control.

3.8 datetime A number with integer and decimal parts used to designate a particular point in time in which the integer represents the day and the decimal represents the fraction of the day.

3.9 measurement resolution The smallest change in a quantity being measured that causes a perceptible change in the corresponding indication. Synonym: resolution

4

3.10 meter curve A graph of meter factors or K‐factors as a function of flow rate.

3.11 meter factor log A table for recording meter factors and associated data in chronological order.

3.12 normal The designation for a set of data that exhibits a Gaussian distribution. Note: In this standard all references to “normal” and associated word forms (normality and normally) are meant in the “Gaussian” sense and not in the “typical” sense.

3.13 rational subgroups Subsets of a set of data selected in a way to maximize the variation between the subsets and to minimalize the variation within the subsets.

3.14 routine variation The variation inherent in a process. Synonyms: noise, common cause variation

3.15 run chart A graphical method to display process data in chronological order.

3.16 special cause variation Variation in a process that is not routine variation. Synonyms: exceptional variation, signal, assignable cause variation.

3.17 statistical control Predictable within a confidence interval.

3.18 student’s t A statistical function that varies in magnitude with degrees of freedom.

3.19 tolerance maximum permissible error in a series of measurements.

3.20 tolerance limit Horizontal lines found on a run chart or control chart which, if exceeded, strongly suggests that special cause variation in the process has occurred requiring some action to mitigate or explain. Synonyms (control charts only): natural process limit, control limit. Related terms: action limit, warning limit.

3.21 warning limit A horizontal line found on a run chart or control chart which, if exceeded, suggests that the underlying process should be monitored more closely. Related terms: action limit, tolerance limit.

4 Significance and Use

API MPMS Chapters 4, Proving Systems and Chapter 5, Metering shall be consulted for the installation, operation and proving of meters. These standards shall govern should any conflict exist between this standard and these standards. Additionally, this standard assumes knowledge of the content of API MPMS Chapter 13.3, Measurement Uncertainty.

Caution: Statistics derived from a set of data cannot be used to prove a point about the data; statistics can only, to some degree, suggest that point. All statements in this standard should be interpreted with this in mind.

5

5 Elements that Influence Meter Factors

The performance of a flow meter will vary in response to changes in flow rate, mechanical condition of the meter and changes in fluid properties. A meter factor, a number that represents the performance of a meter in situ, is established through calibration against a standard. The standard is commonly known as a meter prover and the calibration process is commonly referred to as a meter proof. However, since the meter factor is determined from a proof, a change in a meter factor can be due to a change in meter performance OR a change in the proving system OR a change in other peripheral equipment OR a change in fluid properties.

For example: Consider a turbine meter and an associated bi‐directional ball prover with all signals flowing to a flow computer. The mechanical state of the meter such as sharpness of the leading edge of the turbine blades and bearing wear will directly affect the meter’s performance. Fluid properties that directly affect the flow meter’s performance are viscosity and lubricity with density (API gravity), temperature, pressure and concentration of contaminants having indirect effects. The proving system for a ball displacement prover consists of interchange valves, detector switches, prover sphere and prover coating along with proving procedures and the operator performing the proof. Peripheral equipment includes piping components (basket strainers, valves, thermowells, etc.), secondary instrumentation (pressure, temperature, density, etc.), pulse generators, wiring from the pulse generators to the flow computer, the flow computer and the programming in the flow computer. Other types of meters and provers can have different influences.

While the meter factor is the current representation of the performance of a meter during a batch, the meter factor is actually the performance of the metering system and the proving system during the time the meter is on proof. An operator of a metering skid has to consider these other variables and develop metering and proving procedures designed to filter out the noise from variation of influences external to the meter in order to discover meter problems.

6 General Suggestions to Improve the Monitoring Process

Meter factors should be determined as often as practical as the more frequent the proving, the better the statistics derived from the data and the better the chance of early discovery of performance changes. In addition to routine, planned proofs, proofs should be initiated whenever the process has changed “too much” since the last proof. “Too much” of each process component is best determined from proving data and the tolerance for error. Once the proof is completed, the data should be analyzed soon thereafter in conjunction with previous proving data in order to discover any problems in a timely manner. Frequent proving can indicate how much a particular meter in a particular metering system is influenced by the various elements mentioned in Section 5. Note: A meter factor needs to be judged in relationship to a series of other meter factors obtained from the same meter in order to draw meaningful conclusions regarding the meter’s performance. For example, a meter factor of 1.500 may be perfectly fine but that wouldn’t be known without comparison to other contemporaneous meter factors from this meter.

The ideal monitoring program would result in never performing maintenance when it is not needed (no false positives) and always performing maintenance when it is needed (no false negatives). When action is suggested, successful monitoring will indicate what action needs to occur.

7 Data Signals

All processes return variable results. The variability inherent in a process is called routine variation. Another type of variability is special cause which is an indication of a problem with the inputs into a process or a problem with the execution of the process – in other words, “trouble”. If the process is predictable, then routine variation is the best that can be expected of the process; to reduce the

6

common cause variability, the process must be improved. Special causes need to be identified and dealt with because they are not typically part of the process. The idea behind monitoring is to separate the signals from the noise and act upon signals.

Monitoring meter factors will generate data that show variation in meter factors over time and analysis of the data might return signals to the operator of a metering skid to take some kind of action. The signals are known as limits with various modifiers such as “warning”, “action” and “tolerance” corresponding to increasing degree of variance or discovered trends and corresponding increasing levels of response. Exceeding 3‐standard deviation limits is nearly always due to special cause regardless of the underlying distribution*. Accordingly, it is suggested that the tolerance limit be at 3‐standard deviations. See Table 1 below for a primitive example of confidence intervals and the approximately equivalent standard deviations that could be associated with the three limits mentioned above. As stated above, this standard explicitly does not mandate any of the criteria shown in Table 1; it is shown to help the user craft company guidelines for monitoring the performance of meters.

* See Wheeler, Donald J., Probability Limits, Quality Digest, www.qualitydigest.com/inside/quality‐insider‐column/probability‐limits.html, March 2, 2015

Limit that is Exceeded

Confidence Interval

Equivalent Standard Deviations

Response(s) to consider (Responses at any part in the table include responses listed above in the table)

Warning 90‐95% Slightly < 2 sd

Reprove the meter

Action 95 – 99% Between 2 and 3 sd

Verify temperature, pressure and gravity inputs. Verify meter strainer condition. Verify valve seals. Verify the proving system. Depending on what is found, correct the custody transfer ticket.

Tolerance 99% + > 3 sd Repair or replace the meter.

Table 1 – Responses to consider when Limits are exceeded

The limits can be determined from statistics derived from the data (See section 8.4 for details) but the limits can depend on company policy, contract agreements, regulations or laws. The latter limits are known as “fixed” as opposed to limits that change based on changes in the data. Fixed limits may be thought of as specifications.

8 Ways to Monitor Meter Factors

8.1 General

Following are four ways to monitor meter factors presented in order of increasing complexity. Not all are applicable to all installations due to differences in process stability and in the ability to gather data.

Logging

Run Charting

One‐dimensional Control Charting

Multi‐dimensional Control Charting

7

8.2 Logging

The most basic form of monitoring meter factors is maintaining a meter factor log which is a table for recording each meter factor and associated data in chronological order. This is applicable to all metering installations. An example of a meter log is shown in Table 3 which shows data from running a 12‐point meter curve followed by data from 36 daily proofs. The column titles for Table 3 are as shown in Table 2 immediately below:

DateTime Date and Time of the proof

Pm Average pressure at the meter during the proof

Pp Average pressure in the prover during the proof

SG Average Relative Density, (60/60) during the proof

Tm Average temperature at the meter during the proof

Tp Average temperature in the prover during the proof

%S&W Average S&W percentage during the proof

Rate Average Flow rate during the proof

r/r % dev Range % deviation of the trial factors

# runs Number of runs needed to get 5 consecutive runs meeting deviation limits

MF Meter factor

% crv Meter factor % deviation from curve

% prev Meter factor % deviation from previous meter factor

% baseline Meter factor % deviation from baseline

Table 2 – Meaning of Column Titles in Table 3

Logs can be maintained as a list on a piece of paper but are more useful in an electronic spreadsheet. An electronic spreadsheet can be used to easily create statistics or charts and, through the use of conditional formatting, can highlight data that exceed fixed limits. Note that a reported meter factor is actually the arithmetic mean of some number of trial meter factors. Additional information would be gained by logging the trial runs instead of or in addition to the meter factors themselves.

Another way to identify changes in meter factors is to calculate changes from a baseline meter factor. Baseline can be defined in many ways and what is appropriate for one installation can be inappropriate for another. The baseline could be defined as the first meter factor obtained after installation or major maintenance, but a more representative baseline might be the arithmetic mean of the first few meter factors obtained – “few” suggested as being at least five to get a good representation of standard operating conditions. Yet another reasonable baseline might be a rolling average of the previous five meter factors. All of these can be easily calculated and displayed in the meter factor log. The baseline factor in Table 3 is 1.00048. It was selected because it was the curve factor determined at the rate that is closest to the expected average flowrate of future proofs.

8

Table 3– Meter Factor Log

DateTime Pm Pp RD Tm Tp %S&W Rate r/r % dev # runs MF % crv % prev % baseline06/29 13:05 238 233 0.8812 143.1 141.8 0.211 274 0.013 5 1.00048 0.161 #N/A06/29 13:33 238 232 0.8807 143.3 142.3 0.211 325 0.006 5 1.00039 0.149 -0.00906/29 13:57 238 231 0.8809 143.2 142.3 0.223 375 0.013 5 1.00044 0.154 0.00506/29 14:32 238 229 0.8820 143.5 142.7 0.223 426 0.021 8 1.00048 0.158 0.00406/29 14:51 238 228 0.8819 143.7 143.0 0.223 475 0.021 5 1.00065 0.155 0.01706/29 15:12 238 226 0.8832 143.7 143.1 0.208 526 0.006 5 1.00069 0.149 0.00406/29 15:31 239 225 0.8816 143.3 142.8 0.208 580 0.003 5 1.00075 0.145 0.00606/29 15:59 268 252 0.8850 142.5 141.9 0.185 625 0.029 5 1.00073 0.123 -0.00206/29 16:18 265 246 0.8834 142.4 141.9 0.206 674 0.029 5 1.00092 0.112 0.01906/29 16:37 263 243 0.8818 141.7 140.8 0.170 730 0.016 5 1.00116 0.126 0.02406/29 16:56 278 255 0.8811 141.7 141.3 0.170 777 0.018 9 1.00112 0.132 -0.00406/29 17:15 310 284 0.8811 141.7 141.3 0.186 825 0.015 5 1.00129 0.139 0.01706/30 22:45 262 249 0.8842 142.7 142.0 0.203 549 0.022 7 1.00071 0.142 -0.058 0.02307/01 10:52 249 240 0.8833 142.2 141.5 0.188 444 0.035 10 1.00034 -0.017 -0.037 -0.01407/02 09:36 250 241 0.8898 143.8 143.0 0.175 439 0.042 5 1.00054 0.002 0.020 0.00607/03 10:05 249 242 0.8889 143.6 142.7 0.198 389 0.020 6 1.00041 -0.010 -0.013 -0.00707/04 09:52 248 241 0.8853 143.1 142.2 0.189 393 0.028 5 1.00033 -0.018 -0.008 -0.01507/05 09:08 248 241 0.8825 143.1 142.1 0.265 382 0.019 8 1.00045 0.006 0.012 -0.00307/06 09:32 248 237 0.8873 142.7 141.8 0.202 471 0.018 5 1.00051 -0.007 0.006 0.00307/07 08:46 248 239 0.8864 143.3 142.4 0.187 428 0.047 5 1.00038 -0.013 -0.013 -0.01007/09 03:45 250 237 0.8891 141.8 141.0 0.221 528 0.024 5 1.00024 -0.043 -0.014 -0.02407/09 10:44 247 238 0.8882 142.6 141.8 0.203 445 0.031 9 1.00018 -0.029 -0.006 -0.03007/10 09:53 239 229 0.8871 143.3 142.5 0.227 464 0.036 8 1.00052 -0.007 0.034 0.00407/11 09:27 238 230 0.8831 142.5 141.5 0.200 405 0.036 5 1.00051 0.004 -0.001 0.00307/12 10:42 237 228 0.8791 139.1 138.3 0.201 436 0.028 5 1.00050 0.001 -0.001 0.00207/13 11:55 238 230 0.8783 139.3 138.5 0.254 400 0.011 5 1.00047 -0.001 -0.003 -0.00107/14 09:46 238 228 0.8839 139.7 138.9 0.270 466 0.013 5 1.00057 -0.002 0.010 0.00907/15 09:23 237 228 0.8836 139.1 138.3 0.296 446 0.024 5 1.00055 0.004 -0.002 0.00707/16 15:28 238 228 0.8874 139.8 139.2 0.296 471 0.017 10 1.00058 -0.002 0.003 0.01007/17 10:09 241 232 0.9019 140.9 140.0 0.264 435 0.019 5 1.00057 0.013 -0.001 0.00907/18 09:34 241 233 0.9003 141.9 141.0 0.345 393 0.016 5 1.00060 0.012 0.003 0.01207/19 09:13 238 230 0.8968 141.6 140.8 0.360 400 0.008 5 1.00057 0.007 -0.003 0.00907/20 02:31 238 231 0.8890 142.0 141.2 0.411 383 0.011 5 1.00056 0.013 -0.001 0.00807/21 09:53 238 230 0.8826 139.9 139.1 0.246 404 0.021 8 1.00050 0.002 -0.006 0.00207/22 09:07 237 228 0.8828 139.1 138.3 0.268 431 0.017 5 1.00049 -0.001 -0.001 0.00107/23 09:37 238 230 0.8812 140.4 139.5 0.309 393 0.018 8 1.00058 0.010 0.009 0.01007/24 10:24 237 227 0.8807 140.1 139.4 0.240 478 0.020 9 1.00067 -0.005 0.009 0.01907/25 08:45 237 228 0.8811 139.3 138.5 0.180 451 0.008 5 1.00060 -0.002 -0.007 0.01207/26 12:25 237 230 0.8799 142.0 141.0 0.263 371 0.030 5 1.00075 0.037 0.015 0.02707/27 12:16 236 227 0.8747 142.7 141.8 0.250 453 0.017 5 1.00087 0.030 0.012 0.03907/28 14:06 236 228 0.8725 142.8 141.9 0.330 434 0.007 5 1.00088 0.042 0.001 0.04007/29 10:30 242 232 0.8762 142.7 142.0 0.279 492 0.016 5 1.00095 0.022 0.007 0.04707/30 08:38 242 232 0.8755 143.1 142.2 0.295 472 0.029 5 1.00088 0.032 -0.007 0.04007/31 13:15 242 233 0.8737 142.9 142.0 0.366 449 0.018 5 1.00082 0.024 -0.006 0.03408/01 08:40 243 233 0.8774 141.4 140.5 0.275 463 0.008 5 1.00078 0.020 -0.004 0.03008/02 11:11 244 236 0.8825 142.4 141.4 0.302 391 0.012 5 1.00063 0.013 -0.015 0.01508/03 00:22 245 237 0.8934 143.8 142.9 0.249 398 0.017 5 1.00070 0.019 0.007 0.02208/03 10:52 245 238 0.8931 143.4 142.5 0.326 383 0.024 5 1.00075 0.034 0.005 0.027

9

8.3 Run Charting

A run chart is, in its basic form, a line graph of data with the variable of interest on the y‐axis plotted in chronological order and the associated ordinal numbers (first, second, third, etc.) on the x‐axis. Fixed limits can also be shown on a run chart on the y‐axis or the secondary y‐axis which provides visual indication of whether or not the process meets specification. The basis for a run chart used to monitor meter factors would be the data found on a meter factor log. As such, this method of monitoring is applicable to all operations. A run chart allows for easy identification of obvious trends or patterns but does not indicate whether or not the process is in control.

Figure 1 below shows three of many possible examples of patterns on run charts of meter factors that suggest further investigation into the metering/proving system.

Figure 1 – Three patterns that suggest further investigation

CAUTION: Care must be given to the selection of the chart type to prevent inadvertent visual distortion of the data. A line chart assumes equal increments on the x‐axis which make sense for data that is gathered at equally spaced time intervals (which is what ordinal numbers imply). See Figure 2 below for

10

a basic run chart of the first twenty meter factors from Table 3 as an example of this distortion. Note from the meter factor log that the first twelve factors were determined while running a meter curve (proof intervals of minutes) and the next eight meter factors were from scheduled proofs (proof intervals of days). The top plot in Figure 2 gives a distorted view of meter performance because the reader is induced to assume equal time intervals which would lead to the interpretation that the meter is steadily changing performance upward under typical circumstances for the first twelve proofs. This distortion can be corrected by substituting datetime for ordinal numbers on the x‐axis and using a scatter plot instead of a line chart. The bottom plot in Figure 2 shows the results of doing this using the same meter factors displayed in the top plot.

Figure 2 – Basic Run charts

Because data can be easily compared to fixed limits on a run chart, it can be useful to plot deviations from previous proof, deviations from baseline or deviations from meter curve on a run chart. Many operators have fixed limits for these statistics and it can be useful to create a run chart for each specification. Other data from the log can be plotted on the secondary y‐axis to help with interpreting the process. The analyst should experiment with chart formatting and what data to plot to derive the clearest exposition of meter performance including creating many different charts that can be viewed simultaneously.

0.9995

1.0000

1.0005

1.0010

1.0015

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20

MF (Line Chart)

MF

0.9995

1.0000

1.0005

1.0010

1.0015

06/29 06/30 07/01 07/02 07/03 07/04 07/05 07/06 07/07 07/08

MF (Scatter Plot)

MF

11

Figure 3 shows a scatter plot example of a run chart that displays percent deviation from curve with fixed deviation limits (company policy) of ±0.15% on the primary y‐axis. Relative density is plotted on the secondary y‐axis. The data is from Table 3.

Figure 3 – Run Chart of deviations from the curve with fixed limits of ±0.15% deviation from the curve on the primary y‐axis and relative density on the secondary y‐axis

Note that other related plots can be created by substituting meter temperature, S&W % or flow rate for relative density in Figure 3 and be using the underlying meter factor instead deviation from curve.

8.4 Univariate Control Charting

A univariate (one‐dimensional) control chart is the next step in monitoring meter factors. This method of monitoring is useful only to operations in which the underlying data is available and in which the underlying process is judged to be controllable. Control charting, when correctly done, will indicate whether or not this process is in control. For reasons explained in this section, control charting may or may not be useful for a given meter installation. If control charting is not indicated, run charting will yield the same information as control charting with less effort. Control charting can be easily done using an electronic spreadsheet.

The term univariate is used because only one variable, meter factor, is charted. See the next section for multivariate control charts. Figures 4 – 7 show four univariate control charts developed from the same data in Table 3. They are presented in order of fewest assumptions (shortcuts) to most assumptions made.

There are many other univariate control charts that can be developed and most assume normal data. Crucial assumptions in control charting are that all the data is representative of an unchanging process AND the next data point will be a random sample from the same process.

The techniques used to create Figures 4 – 7 assume the data are normally distributed but they will work for data that are “nearly normal”. See Annex A for details on normality and tests for normality. Annex B shows a univariate control charting technique that doesn’t require normal data plus other charts that could be created from the Table 3 data.

Univariate control charts were developed by Walter Shewhart and explained in his 1931 book, “Economic Control of Quality of Manufactured Product”. Despite his careful exposition, univariate

0.870

0.875

0.880

0.885

0.890

0.895

0.900

0.905

‐0.20

‐0.15

‐0.10

‐0.05

0.00

0.05

0.10

0.15

0.20

06/29 07/04 07/09 07/14 07/19 07/24 07/29 08/03

Relative Density

% Deviation

Recent Meter xxxx Proof Deviations

% crv LL UL RD

12

control charts are often created or used improperly by people and computer programs. Part of the problem is his antiquated language and the use of the word control which has unfortunate connotations. Using a control chart for process data will not enable the analyst to control a process; a control chart indicates whether or not a process is in control within limits. A modern interpretation of control is predictable. Accordingly, a process that is in control within limits is predictable within the same limits; that is, the next data point gathered will probably be within those limits.

Note: Henceforth in this standard, the words “in control” and “predictable” will be used to mean “in control within limits” and “predictable within limits” respectively.

Shewhart outlined creating univariate control charts as follows: 1. Divide the data into rational subgroups. 2. Compute “measures of location” and “measures of dispersion” for these data which, “if the

quality is not predictable, will be most likely to indicate the presence of trouble.” 3. Construct univariate control charts with limits of the form: Average ± 3 sigma 4. If an observed point falls outside the limits of this chart, take this “as an indication of trouble or

a lack of control.”

The forming of subgroups so that the variation within the subgroup is minimized and the variation between the subgroups is maximized is what Shewhart meant by rational. In other words, a rational subgroup is a set of measurements produced under repeatability conditions. Rational subgroups are meant to represent a “snapshot of the process”. The variation within the subgroups represents the common cause variation in the process at any given time. Consider a set of meter factors which are calculated as the arithmetic mean of 5 consecutive trial factors that agree to within 0.05%. The data is the set of all trial factors. The rational subgroups would be the reported meter factors, which are, by design, produced under repeatability conditions.

Two important points are that a process can be predictable but not meet specifications and a process can meet specifications and not be predictable. The latter is often the case for meter factors from meters in crude oil service because of the wide variation of many aspects of the crude oil – the next meter factor will not be predictable even if the metering equipment and procedures are perfect.

The difference between a run chart and a control chart is that the limits displayed on a control chart come from statistics performed on the underlying data while the limits for a run chart come from company policy, manufacturer specifications or government regulations. Because of this, some of the discussion in the literature refers to run charts as control charts with fixed limits. To avoid confusion, this standard doesn’t use that nomenclature due to Shewhart’s definition – specifications cannot be used to determine limits on a control chart because it would not be a control chart any more. This standard calls such charts run charts. This is mentioned to aid the user in understanding the discussion in other sources. Note that even though a control chart gives more information than the run chart, the utility of both types of charts is anticipated to be the same for the typical user of this standard.

Below are some univariate control charts in order of fewer assumptions to more assumptions. The data for each chart and how the values are derived are found in the control logs in Annex C. In all of these charts and tables, “avg” means arithmetic mean of the meter factors and “sd” means sample standard deviation.

Figure 4 was created directly from Shewhart’s definition.

13

Figure 4 – Control Chart of Meter Factors using sd of Trial Factors

Assume that the trial factors are not available but the range % deviation of the trial factors is available for each meter factor. The range % can be used to set the limits.

Figure 5 – Control Chart of Meter Factors using range % of the Trial Factors.

Suppose an analyst does not have any information concerning the trial runs that were used to derive the meter factors in Table 3 and has only meter factors in the order that they were attained. The analyst could use an XmR chart which is very similar to the standard deviation approach but uses a moving range of two to calculate the control limits rather than the standard deviations of the trial factors. This is shown in Figure 6.

0.99960

0.99980

1.00000

1.00020

1.00040

1.00060

1.00080

1.00100

1.00120

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35

Limits from sd of Trial Factors

MF avg (MF) UL LL

0.99960

0.99980

1.00000

1.00020

1.00040

1.00060

1.00080

1.00100

1.00120

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35

Limits from Reported Run‐to‐Run Deviation

MF avg (MF) UL LL

14

Figure 6 – Control Chart of Meter Factors using moving range (mR) of the meter factors.

The XmR chart has two parts. The top part is where the individual measurements are analyzed and the bottom part is where the moving ranges are analyzed. The control limits are determined using factors that are rooted in well‐established theory that deals with the distribution of the average range. This technique uses the idea that the moving range is a subgroup of 2 that accurately reflects the routine variation in the run of measurements – in this example ‐ meter factors.

For a non‐technical explanation, see Wheeler, Donald J., “Making Sense of Data”.

Note: Figure 6 is technically incorrect because the limits were determined assuming that meter factors are individual values when, in fact, meter factors are actually averages. Figure 6 tells essentially the same story as Figures 4 and 5 because, for the data used for these particular charts, the variability of the minute‐to‐minute trial factors is much less than the variability of the day‐to‐day meter factors.

Thus far in this section, control charts have been created assuming a priori the existence of 36 meter factors to create the limits. This paragraph discusses how to “start out”; that is, how to monitor a meter that is newly installed or maintained. With no history, it is impossible to determine meaningful limits but as proofs are performed, the limits become more meaningful. This chart shows the common practice of re‐calculating the limits at each data point until seven points have gathered; fixing the limits

15

using the seven points; and then, after twenty points, using the twenty points to re‐calculate a new set of unchanging limits that will be useful until the process changes. These limits were determined using the same technique used to create Figure 5.

Figure 7 – Control Chart of Meter Factors Using Limits Calculated from Moving Averages

This standard cannot suggest when a re‐evaluation should occur because each installation is different but once limits are set they should be reevaluated from time to time. Below are three examples of some situations that that would require new limits for any of Figures 4 through 7.

Example 1: If the meter factors are from a PD meter, then the analyst is assuming the meter has not worn appreciably over the data period – only the analyst knows if that is a good assumption.

Example 2: If the 37th proof will be run on diesel when the first 36 proofs were run on gasoline, then the process will be different and the charts will require newly calculated limits.

Example 3: If the instrumentation for meter temperature was recalibrated after the 36th proof, then the process is different and the charts will require newly calculated limits.

Figures 4 through 7 show that the four different ways to create a control chart are equivalently valid. These figures also all indicate this process is out‐of‐control because the rate of out‐of‐control points far exceeds the 3 points in 1000 rate which is the expected rate to occur by chance alone. However, each of these figures also shows 36 consecutive meter factors all between 1.0002 and 1.0010 (±0.0004 from the average). How to interpret this depends on knowledge outside of the data in Table 3. For instance, if this was a meter used to measure the volume of product from a refinery tower to a storage tank, then considering only the run of meter factors, this performance would be troubling considering the supposed stability of the process – essentially the same fluid, same temperature, same flow rate, same concentration of contaminants, etc.; however, if this meter was in crude pipeline service where any of the crude characteristics can change significantly at any time, then this performance would be considered very good.

It would make sense to use control charting in the “refinery case” because the process is expected be in control and an analyst would be very interested in the times that it wasn’t in control so as to focus attention to improve measurement. In the “crude pipeline case” it wouldn’t make sense to use control charting because there is no expectation that the process would ever be in control. Run charts would be indicated for use in the crude pipeline case.

16

Once a process is predictable, analysts are often interested in increasing the sensitivity of their control charts by analyzing patterns observed in the data. See Annex D for more information. To summarize section 8.4:

1. Gather meter factor data in chronological order as shown in Table 3. 2. Create a control chart using one of the techniques discussed. 3. If the control chart has no out‐of‐control points, then the metering process can be considered in

control and the control chart can be used to monitor the metering system. See step 5 for how. 4. If the control chart has out‐of‐control points then the metering process is out of control. The

user of the standard should investigate each out‐of‐control point to determine each cause. a. If the cause is something that cannot be addressed, then using a control chart to

monitor the process is not indicated. The best tool to monitor such a process is the run chart technique discussed in section 8.3.

b. If all the causes are addressed, go back to step 2 and create a control chart with the new data.

5. If the control chart created in step 2 has no out‐of‐control points, plot new meter factors in this control chart as they are obtained without recalculating the mean or limits. The metering system should be considered in control if:

a. Subsequent meter factors are within the limits. b. Subsequent meter factors obey the runs rules detailed in Annex D. c. If subsequent meter factors violate 5a (out‐of‐control) or 5b (maybe out of control),

then the user should investigate. Depending on what is found, either continue using the control chart, or if the process has changed but is still in control, create a new control chart with the new data.

Note: Statistically speaking, a run of meter factors in control means any of one of them is just as accurate as any other. The control chart mean is the best estimate of the true meter factor and should be used in the volume calculations. The purpose of subsequent meter factors is to demonstrate the process is still in control. Before implementing this statistical interpretation, ensure this interpretation does not violate company policy, commercial agreements or regulations. Note: It is good practice to recalculate a new control chart every approximately every twenty meter factors by including all previous factors plus the new factors. The expectation is that the limits will narrow and the mean will stay virtually the same. If the new limits widen, this is cause to investigate even if the process is still in control.

8.5 Multivariate Control Charts for Meter Factors

The last statistical technique discussed in this standard that can be used to monitor meter factors is multivariate control charting. The power of multivariate control charting comes from the ability to monitor the relationships between multiple variables simultaneously. Although univariate control charts can be made for each variable, drawing conclusions on the process control status without considering their combined influence can be misleading. A multivariate control chart will account for the correlation of each variable which provides a more accurate indication of whether or not the process is in control. All variables of interest should be adequately modeled by a normal distribution. There are techniques for stepping away from normality, but they require customized construction for the process in question.

17

Multivariate statistical control charts are developed using matrix algebra to calculate the Hotelling’s T‐Squared statistic, which involves calculating the variance‐covariance matrix and mean vector of the variables of interest. If the T‐Squared statistic is in control, then the process is in control. Calculating this is intricate and involved; using commercially available software and expert statistical advice is strongly advised.

The mathematics for this exists for any number of variables but the technique is more easily explained using two variables. Using the Table 3 data, consider two variables: meter factor and relative density. In Figure 8 below the horizontal lines represent the control limits for meter factor and the vertical lines represent the control limits for relative density. The red ellipse represents the area of both variables being in‐control at the same time. The interpretation of this chart would be all relative density points and meter factors are in control when considered separately, but, when considered together, the fifteen points outside the red ellipse would be considered out of control.

Figure 8 – Generalized Multivariate Chart

Multivariate charts and univariate charts should be used in tandem. Multivariate charts will tell you only that the process as a whole is out of control, but not necessarily what variable caused it. Looking at the data in Table 3, the univariate and multivariate charts on the following page are constructed considering the four factors of meter factor, S&W%, flow rate and Relative Density.

The software used to create the multivariate control chart was set to show the relative contribution of the four factors in the process to the T‐Squared statistic for a given point. Here the multivariate control chart would suggest checking the relative density at point 17 before it went out of control at point 18 in the univariate case. Noticing the huge change at point 27 in the Multivariate Control Chart due to meter factor shift might have caused a change to be made so the next 3 meter factors would have been in control. Notice these charts all work together to allow for a proper decision to be made.

18

Observation T-Squared MF %S&W Rate RD 18 17.9835 0.109296 1.17466 0.00104641 15.5251 19 19.2508 2.21995 3.50805 2.10896 11.074 27 17.2223 13.5488 1.95287 10.1206 4.03286 28 16.4037 10.9207 1.82353 1.09623 9.44458 29 24.3811 16.4591 4.22113 3.17485 13.7023 32 20.0874 12.8257 4.95711 1.3113 10.5758

Table 4 –Relative contribution of each component to the T‐Squared Statistic

19

Figure 9 –Multivariate Chart for Table 3 data and the associated Four Univariate Charts

0

5

10

15

20

25

30

0 5 10 15 20 25 30 35

T‐Squared

Hotelling's T2 ‐ Largest Contributor Labeled

UCL

Rate

RD

MF

%S&W

H. T2

300

500

700

0 5 10 15 20 25 30 35

Rate

Rate Control Chart

Rate

UCL

LCL

1.0000

1.0005

1.0010

0 5 10 15 20 25 30 35Meter Factor

Meter Factor Control Chart

MF

UCL

LCL

0.8600

0.8800

0.9000

0.9200

0 5 10 15 20 25 30 35Relative Density

Relative Density Control Chart

RD

UCL

LCL

0.000

0.200

0.400

0.600

0 5 10 15 20 25 30 35

%S&

W

%S&W Control Chart

%S&W

LCL

UCL

20

ANNEX A –Tests for Normality

The control charts discussed so far are made with the assumption that the observations follow a normal distribution. If there is a departure from normality, however, then the control limits given can be inappropriate and a run chart with fixed limits or a control chart created using the percentile technique discussed in Annex B would be suggested. It is always important to check the normality assumption when using a control chart of individual variables.

A simple way to perform this check is with the normal probability plot (aka QQ Plot) easily created using an electronic spreadsheet. Figure A.1 shows the normal probability plot for the Table 3 data. The line represents the standard normal with mean=0 and standard deviation=1. Since the observed points do not fall exactly on the line, the data is not normal; but, since they fall close to this line the data are said to be approximately normally distributed. The QQ plot is a visual test and interpretation of Figure A.1 shown below is that the data is close enough to normal for them for the use of a control chart to be appropriate. Non‐normality in a QQ Plot will often show the tails drifting away for the line or the plot data will have a curve like in Figure A.2. Figure A.2 shows data that is distributed from an exponential distribution (left) and a log normal distribution (right). Notice how the plot data does not fall on the line, therefore we cannot assume that a normal distribution would model either of the datasets pictured in Figure A.2.

Note: It is suggested that the QQ plot should be used together a numerical test such as one of the two tests explained later in this Annex as part of the decision to use control charts. All charts and calculations in Annex A were created using data from the last 36 proofs in Table 3.

Caution: No test for normality proves that a set of data is normally distributed – it only suggests it. These tests can prove that a set of data is not normally distributed. What these tests will probably show is that the set of data is not perfectly normal as it would be rare for any data set to be perfectly normal; judgment is required in each case as to whether or not the data is “close enough to normal” to make control charting (or any other statistical technique requiring normality) to be useful.

The set of data for Figure A.1 is on the next page.

Figure A.1 – Normal Probability Plot for Table 3 data

‐2.5

‐2.0

‐1.5

‐1.0

‐0.5

0.0

0.5

1.0

1.5

2.0

2.5

1.0000 1.0002 1.0004 1.0006 1.0008 1.0010

Std Deviation

Meter Factor

QQ Plot

21

Table A.1 – Data for the QQ Plot in Figure A.1 Where:

Ordinal # is the rank in the list

MF is the list of meter factors sorted minimum to maximum

Std MF is the Standardized MF. The Standardization or Normalization function uses inputs of the meter factor, data set mean and data set standard deviation to return the standard deviations from the mean for the given meter factor

Normal is the data that forms a line representing perfectly normal. The function used is the inverse of the standard normal cumulative distribution with input of (Ordinal #/Count)

Count 36 sd 0.00018Mean 1.00058 correlation 0.99

Ordinal # MF Std MF Normal 1 1.00018 -2.23533 -1.914512 1.00024 -1.90142 -1.593223 1.00033 -1.40056 -1.382994 1.00034 -1.34491 -1.220645 1.00038 -1.12230 -1.085326 1.00041 -0.95535 -0.967427 1.00045 -0.73274 -0.861638 1.00047 -0.62144 -0.764719 1.00049 -0.51014 -0.67449

10 1.00050 -0.45449 -0.5894611 1.00050 -0.45449 -0.5084912 1.00051 -0.39883 -0.4307313 1.00051 -0.39883 -0.3554914 1.00052 -0.34318 -0.2822215 1.00054 -0.23188 -0.2104316 1.00055 -0.17623 -0.1397117 1.00056 -0.12058 -0.0696818 1.00057 -0.06493 0.0000019 1.00057 -0.06493 0.0696820 1.00057 -0.06493 0.1397121 1.00058 -0.00928 0.2104322 1.00058 -0.00928 0.2822223 1.00060 0.10203 0.3554924 1.00060 0.10203 0.4307325 1.00063 0.26898 0.5084926 1.00067 0.49159 0.5894627 1.00070 0.65854 0.6744928 1.00071 0.71419 0.7647129 1.00075 0.93680 0.8616330 1.00075 0.93680 0.9674231 1.00078 1.10375 1.0853232 1.00082 1.32636 1.2206433 1.00087 1.60461 1.3829934 1.00088 1.66026 1.5932235 1.00088 1.66026 1.9145136 1.00095 2.04982 #NUM!

22

Figure A.2 – Normal Probability plots for non‐normal data

Statistical tests such as the Anderson‐Darling or Shapiro‐Wilk tests discussed below are considered more rigorous tests for normality than the QQ Plot. Other tests for normality exist and all should be considered equally applicable. These calculations are found in commercially available software and should be performed on data sets prior to using control charts that assume normality. For detailed information, consult any standard statistics textbook.

Anderson‐Darling Test

The Anderson‐Darling statistic is used to objectively test for normality, data independence, and adequacy of measurement resolution relative to the overall variation in the dataset. Two Anderson‐Darling (A‐D) statistics, A‐Drms/A^2 and A‐DMR/A^2 Modified, can be calculated via a software package. The A‐Drms uses a numerical estimate of the sample standard deviation(s) as per the RMS (root‐mean‐square) and the A‐DMR uses a moving range of two to perform the necessary calculations in order to get a test statistic. Many software packages produce both test statistics as the interpretation of the test relies on both. There are three cases that occur when analyzing data.

CASE 1: Both A‐Drms and A‐DMR are <<1.0 (very much less than 1.0). This is to be interpreted as “no compelling evidence to reject the hypotheses that the data is normal, independent, with adequate measurement resolution.” Proceed to construct a control chart.

CASE 2: Both A‐Drms and A‐DMR are >>1.0 (very much greater than 1.0) and the normal probability plot shows two to three “staircases,” which means that the data is stacking or is clustered into two or three distinct values. This is evidence that there is not enough variation in the data usually due to inadequate numerical resolution. (This is where a run chart becomes a useful tool with constant monitoring.) This case usually occurs when a process variable could be considered more of a constant rather than a variable. This can also occur if the variable experiences frequent periods of stability but has step changes between these periods.

CASE 3: A‐Drms is <<1.0, but A‐DMR>1.0. This indicates that the results are serially correlated, or not independent. This is usually caused by a cyclic effect due to the environment of the process, or moderate trending of data due to normal degradation of equipment. If these types of behavior are normal for the process, proceed to construct a control chart using standard deviations rather than the moving range.

If the software has the capability, a P‐value can be calculated based on comparing quantile values from the normal distribution through simulation and Monte Carlo methods. To interpret the P‐value, a comparison is made to the level of significance (usually being α=0.05 for 95% confidence or α=0.01 for

23

99% confidence). If the P‐value is greater than α, the data can be considered normal; if the P‐value is less than or equal to α then the data can be considered not to be normal. The Anderson‐Darling test results from the Table 3 data are shown below.

Statistic Value

A2/ A-Drms 0.379449

Modified Form/ A-DMR 0.388013

P-Value 0.386596

Table A.1 – Anderson‐Darling statistics for Table 3 data

The data show both statistics are <<1.0 so the data fall into CASE 1 stating the data are adequately modeled by a normal distribution. This conclusion is supported by the P‐value being greater than α=0.05.

Shapiro‐Wilk Test (from ASTM D6299 A1.4.2)

Shapiro‐Wilk Test is another procedure that can be used to test for normality. Commercially available software is used to calculate the statistic. For the data in Table 3 the Shapiro‐Wilk test results can been seen in Table A.2 below.

Statistic Value

W 0.97457

P-Value 0.64849

Table A.2 – Shapiro‐Wilk statistics for Table 3 Data

The interpretation of W depends on the underlying data; that is, there is no general threshold for W that suggests normality or non‐normality. In general, W = 1 means the data is perfectly normally distributed and W < 1 means the data is not perfectly normal. The further from 1 W is, the further the departure from normality. The software uses the W and P‐Value statistics together to assess normality. The P‐value is the same statistic discussed in the section on the Anderson‐Darling test above and is interpreted the same way. The software that generated Table A.2 indicated that the data was adequately modeled by a normal distribution.

24

Annex B – Other Charts

All charts and calculations in Annex B were created using data from the last 36 proofs in Table 3.

Figure B.1 – Run Chart using Policy Run‐to‐Run Limit of 0.05%

Figure B.1 shows a run chart where the limits are derived from a company policy that states that meter factors shall be averaged from 5 consecutive trial factors which agree to within 0.05%. This chart is built exactly like the one in Figure 5 except 0.05% was used in place of the reported r/r%. The interpretation of this chart would be the meter performance is well within company specification.

One use for this chart would be to monitor performance of a new or newly repaired meter until enough data is gathered to perform an analysis (compare to Figure 7). Another use would be if the analyst did not have run‐to‐run deviation data (compare to Figure 5).

0.99900

0.99950

1.00000

1.00050

1.00100

1.00150

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35

Limits Using Policy R/R Deviation = 0.05%

MF avg (MF) UL LL

25

Figure B.2 – Control Chart with limits calculated from Percentiles of the Meter Factors Control limits can also be established using meter factor percentiles. An advantage to using percentiles is the data being tracked does not need to come from a normal distribution which is an underlying assumption in the other control charting techniques discussed in this standard. A disadvantage is that at least 50 data points are needed to determine useful limits. Control limits based on percentiles can be easily calculated from a good electronic spreadsheet. Conceptually, the following is the technique:

Imagine a set of 100,000 meter factors

Sort the data from smallest to largest

The 99865th point is the +3 standard deviation limit (Upper Limit)

The 135th point is the ‐3 standard deviation limit (Lower Limit)

The average of the 50,000th and 50,001st point is the median and is graphed as the average MF

Note that 99865 and 135 are at the 99.865 and 0.135 percentiles respectively and that 99.865‐0.135 = 99.73 which is the range for ±3 standard deviations of a normal distribution (to four significant figures). Also note that using less than 100,000 data points requires some rounding and some sort of estimation to define the limits. This explains why experience indicates that at least 50 points (and more is better) are suggested to derive useful limits using this technique. Figure B.2 was created using an electronic spreadsheet that calculated the limits using Table 3 data. The limits are wider than the ones shown in Figures 4 – 7 but since there are only 36 points, these limits have greater uncertainty.

0.99960

0.99980

1.00000

1.00020

1.00040

1.00060

1.00080

1.00100

1.00120

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35

Limits from Percentiles of the Meter Factors

MF 50th %ile UL LL

26

Table C.2 – Data set for the Control Chart based on Percentiles

Where:

The 50th percentile is the result of an electronic spreadsheet percentile function that uses inputs of the data set and desired percentile (decimal between 0 and 1) to return the value at that percentile. In this case, the data set is the set of meter factors and the percentile is entered as 0.5

UL uses the same function but the percentile entered is 0.99865

LL uses the same function but the percentile entered is 0.00135

DateTime MF 50th %ile UL LL06/30 22:45 1.00071 1.00057 1.000947 1.00018307/01 10:52 1.00034 1.00057 1.000947 1.00018307/02 09:36 1.00054 1.00057 1.000947 1.00018307/03 10:05 1.00041 1.00057 1.000947 1.00018307/04 09:52 1.00033 1.00057 1.000947 1.00018307/05 09:08 1.00045 1.00057 1.000947 1.00018307/06 09:32 1.00051 1.00057 1.000947 1.00018307/07 08:46 1.00038 1.00057 1.000947 1.00018307/09 03:45 1.00024 1.00057 1.000947 1.00018307/09 10:44 1.00018 1.00057 1.000947 1.00018307/10 09:53 1.00052 1.00057 1.000947 1.00018307/11 09:27 1.00051 1.00057 1.000947 1.00018307/12 10:42 1.00050 1.00057 1.000947 1.00018307/13 11:55 1.00047 1.00057 1.000947 1.00018307/14 09:46 1.00057 1.00057 1.000947 1.00018307/15 09:23 1.00055 1.00057 1.000947 1.00018307/16 15:28 1.00058 1.00057 1.000947 1.00018307/17 10:09 1.00057 1.00057 1.000947 1.00018307/18 09:34 1.00060 1.00057 1.000947 1.00018307/19 09:13 1.00057 1.00057 1.000947 1.00018307/20 02:31 1.00056 1.00057 1.000947 1.00018307/21 09:53 1.00050 1.00057 1.000947 1.00018307/22 09:07 1.00049 1.00057 1.000947 1.00018307/23 09:37 1.00058 1.00057 1.000947 1.00018307/24 10:24 1.00067 1.00057 1.000947 1.00018307/25 08:45 1.00060 1.00057 1.000947 1.00018307/26 12:25 1.00075 1.00057 1.000947 1.00018307/27 12:16 1.00087 1.00057 1.000947 1.00018307/28 14:06 1.00088 1.00057 1.000947 1.00018307/29 10:30 1.00095 1.00057 1.000947 1.00018307/30 08:38 1.00088 1.00057 1.000947 1.00018307/31 13:15 1.00082 1.00057 1.000947 1.00018308/01 08:40 1.00078 1.00057 1.000947 1.00018308/02 11:11 1.00063 1.00057 1.000947 1.00018308/03 00:22 1.00070 1.00057 1.000947 1.00018308/03 10:52 1.00075 1.00057 1.000947 1.000183

27

Annex C – Data Tables for Charts in Main Body

Note that the numbering of the tables in this Annex is designed to correspond with its associated chart so there are no tables C‐1, C‐2 or C‐3. All calculated values are unrounded. The highlighted values are outside the control limits. All charts and calculations in Annex C were created using data from the last 36 proofs in Table 3.

28

Moving Range Deviation of Meter Factors

If only the meter factors in chronological order are available.

Table C‐6 – Underlying Data for Figure 6 Where:

MF is the meter factor

mR is absolute value of (current MF – previous MF)

UL is the upper limit and is equal to Average MF + 2.660 * Average mR.

LL is the lower limit and is equal to Average MF ‐ 2.660 * Average mR

ULmR is the upper limit for mR and is equal to 3.267 * Average mR

LLmR is understood to be zero since, by definition, mR cannot be less than zero.

DateTime MF mR avg (MF) UL LL avg (mR) ULmR

06/30 22:45 1.00071 #N/A 1.000582 1.00081 1.00035 #N/A #N/A07/01 10:52 1.00034 0.00037 1.000582 1.00081 1.00035 0.000086 0.0002807/02 09:36 1.00054 0.00020 1.000582 1.00081 1.00035 0.000086 0.0002807/03 10:05 1.00041 0.00013 1.000582 1.00081 1.00035 0.000086 0.0002807/04 09:52 1.00033 0.00008 1.000582 1.00081 1.00035 0.000086 0.0002807/05 09:08 1.00045 0.00012 1.000582 1.00081 1.00035 0.000086 0.0002807/06 09:32 1.00051 0.00006 1.000582 1.00081 1.00035 0.000086 0.0002807/07 08:46 1.00038 0.00013 1.000582 1.00081 1.00035 0.000086 0.0002807/09 03:45 1.00024 0.00014 1.000582 1.00081 1.00035 0.000086 0.0002807/09 10:44 1.00018 0.00006 1.000582 1.00081 1.00035 0.000086 0.0002807/10 09:53 1.00052 0.00034 1.000582 1.00081 1.00035 0.000086 0.0002807/11 09:27 1.00051 0.00001 1.000582 1.00081 1.00035 0.000086 0.0002807/12 10:42 1.00050 0.00001 1.000582 1.00081 1.00035 0.000086 0.0002807/13 11:55 1.00047 0.00003 1.000582 1.00081 1.00035 0.000086 0.0002807/14 09:46 1.00057 0.00010 1.000582 1.00081 1.00035 0.000086 0.0002807/15 09:23 1.00055 0.00002 1.000582 1.00081 1.00035 0.000086 0.0002807/16 15:28 1.00058 0.00003 1.000582 1.00081 1.00035 0.000086 0.0002807/17 10:09 1.00057 0.00001 1.000582 1.00081 1.00035 0.000086 0.0002807/18 09:34 1.00060 0.00003 1.000582 1.00081 1.00035 0.000086 0.0002807/19 09:13 1.00057 0.00003 1.000582 1.00081 1.00035 0.000086 0.0002807/20 02:31 1.00056 0.00001 1.000582 1.00081 1.00035 0.000086 0.0002807/21 09:53 1.00050 0.00006 1.000582 1.00081 1.00035 0.000086 0.0002807/22 09:07 1.00049 0.00001 1.000582 1.00081 1.00035 0.000086 0.0002807/23 09:37 1.00058 0.00009 1.000582 1.00081 1.00035 0.000086 0.0002807/24 10:24 1.00067 0.00009 1.000582 1.00081 1.00035 0.000086 0.0002807/25 08:45 1.00060 0.00007 1.000582 1.00081 1.00035 0.000086 0.0002807/26 12:25 1.00075 0.00015 1.000582 1.00081 1.00035 0.000086 0.0002807/27 12:16 1.00087 0.00012 1.000582 1.00081 1.00035 0.000086 0.0002807/28 14:06 1.00088 0.00001 1.000582 1.00081 1.00035 0.000086 0.0002807/29 10:30 1.00095 0.00007 1.000582 1.00081 1.00035 0.000086 0.0002807/30 08:38 1.00088 0.00007 1.000582 1.00081 1.00035 0.000086 0.0002807/31 13:15 1.00082 0.00006 1.000582 1.00081 1.00035 0.000086 0.0002808/01 08:40 1.00078 0.00004 1.000582 1.00081 1.00035 0.000086 0.0002808/02 11:11 1.00063 0.00015 1.000582 1.00081 1.00035 0.000086 0.0002808/03 00:22 1.00070 0.00007 1.000582 1.00081 1.00035 0.000086 0.0002808/03 10:52 1.00075 0.00005 1.000582 1.00081 1.00035 0.000086 0.00028

Averages 1.000582 0.0000863 sigma scaling factor (UL/LL) = 2.6603 sigma scaling factor (ULmR) = 3.267

29

Limits from Range % Deviation of Trial Factors

If the actual trial factors are not available but the range % of the five trial factors for each meter factor is available, an analyst can use the range % to estimate standard deviation. See Annex E of API MPMS 13.3 for details on d2.



(r/r)% is the reported range % deviation of the trial factors

(r/r) is the range of the trial factors and = (r/r)% * MF/100

(r/r) / d2 is the estimate of the sample standard deviation of the five trial factors

UL is the upper limit and is equal to avg (MF) + t(0.997,35)/sqrt(5)*average of (r/r) / d2

LL is the lower limit and is equal to avg (MF) ‐ t(0.997,35)/sqrt(5)* average of (r/r) / d2

t(0.997,35)/sqrt(5) is the Student t statistic at 3σ and (36‐1) dof divided by the square root of the number of values used to determine the meter factor (5).

DateTime MF (r/r)% (r/r) (r/r) / d2 UL LL avg (MF)06/30 22:45 1.00071 0.022 0.00022 0.000095 1.00071 1.00045 1.0005807/01 10:52 1.00034 0.035 0.00035 0.000151 1.00071 1.00045 1.0005807/02 09:36 1.00054 0.042 0.00042 0.000181 1.00071 1.00045 1.0005807/03 10:05 1.00041 0.020 0.00020 0.000086 1.00071 1.00045 1.0005807/04 09:52 1.00033 0.028 0.00028 0.000120 1.00071 1.00045 1.0005807/05 09:08 1.00045 0.019 0.00019 0.000082 1.00071 1.00045 1.0005807/06 09:32 1.00051 0.018 0.00018 0.000077 1.00071 1.00045 1.0005807/07 08:46 1.00038 0.047 0.00047 0.000202 1.00071 1.00045 1.0005807/09 03:45 1.00024 0.024 0.00024 0.000103 1.00071 1.00045 1.0005807/09 10:44 1.00018 0.031 0.00031 0.000133 1.00071 1.00045 1.0005807/10 09:53 1.00052 0.036 0.00036 0.000155 1.00071 1.00045 1.0005807/11 09:27 1.00051 0.036 0.00036 0.000155 1.00071 1.00045 1.0005807/12 10:42 1.00050 0.028 0.00028 0.000120 1.00071 1.00045 1.0005807/13 11:55 1.00047 0.011 0.00011 0.000047 1.00071 1.00045 1.0005807/14 09:46 1.00057 0.013 0.00013 0.000056 1.00071 1.00045 1.0005807/15 09:23 1.00055 0.024 0.00024 0.000103 1.00071 1.00045 1.0005807/16 15:28 1.00058 0.017 0.00017 0.000073 1.00071 1.00045 1.0005807/17 10:09 1.00057 0.019 0.00019 0.000082 1.00071 1.00045 1.0005807/18 09:34 1.00060 0.016 0.00016 0.000069 1.00071 1.00045 1.0005807/19 09:13 1.00057 0.008 0.00008 0.000034 1.00071 1.00045 1.0005807/20 02:31 1.00056 0.011 0.00011 0.000047 1.00071 1.00045 1.0005807/21 09:53 1.00050 0.021 0.00021 0.000090 1.00071 1.00045 1.0005807/22 09:07 1.00049 0.017 0.00017 0.000073 1.00071 1.00045 1.0005807/23 09:37 1.00058 0.018 0.00018 0.000077 1.00071 1.00045 1.0005807/24 10:24 1.00067 0.020 0.00020 0.000086 1.00071 1.00045 1.0005807/25 08:45 1.00060 0.008 0.00008 0.000034 1.00071 1.00045 1.0005807/26 12:25 1.00075 0.030 0.00030 0.000129 1.00071 1.00045 1.0005807/27 12:16 1.00087 0.017 0.00017 0.000073 1.00071 1.00045 1.0005807/28 14:06 1.00088 0.007 0.00007 0.000030 1.00071 1.00045 1.0005807/29 10:30 1.00095 0.016 0.00016 0.000069 1.00071 1.00045 1.0005807/30 08:38 1.00088 0.029 0.00029 0.000125 1.00071 1.00045 1.0005807/31 13:15 1.00082 0.018 0.00018 0.000077 1.00071 1.00045 1.0005808/01 08:40 1.00078 0.008 0.00008 0.000034 1.00071 1.00045 1.0005808/02 11:11 1.00063 0.012 0.00012 0.000052 1.00071 1.00045 1.0005808/03 00:22 1.00070 0.017 0.00017 0.000073 1.00071 1.00045 1.0005808/03 10:52 1.00075 0.024 0.00024 0.000103 1.00071 1.00045 1.00058

Averages 1.000582 0.000213 0.000092t(0.997,35)/sqrt(5) 1.426496 d2 for n=5 is 2.326

30

Limits from Moving Range Deviation of Meter Factors

If only the meter factors in chronological order are available.



mR is absolute value of (current MF – previous MF)

UL is the upper limit and is equal to Average MF + t(0.997,34)/sqrt(2)*sd of mR

LL is the lower limit and is equal to Average MF ‐ t(0.997,34)/sqrt(2)*sd of mR

t(0.997,34)/sqrt(2) is the Student t statistic at 3σ and (35‐1) dof divided by the square root of the number of values used to determine each mR

DateTime MF mR avg (MF) UL LL06/30 22:45 1.00071 #N/A 1.000582 1.00077 1.0003907/01 10:52 1.00034 0.00037 1.000582 1.00077 1.0003907/02 09:36 1.00054 0.00020 1.000582 1.00077 1.0003907/03 10:05 1.00041 0.00013 1.000582 1.00077 1.0003907/04 09:52 1.00033 0.00008 1.000582 1.00077 1.0003907/05 09:08 1.00045 0.00012 1.000582 1.00077 1.0003907/06 09:32 1.00051 0.00006 1.000582 1.00077 1.0003907/07 08:46 1.00038 0.00013 1.000582 1.00077 1.0003907/09 03:45 1.00024 0.00014 1.000582 1.00077 1.0003907/09 10:44 1.00018 0.00006 1.000582 1.00077 1.0003907/10 09:53 1.00052 0.00034 1.000582 1.00077 1.0003907/11 09:27 1.00051 0.00001 1.000582 1.00077 1.0003907/12 10:42 1.00050 0.00001 1.000582 1.00077 1.0003907/13 11:55 1.00047 0.00003 1.000582 1.00077 1.0003907/14 09:46 1.00057 0.00010 1.000582 1.00077 1.0003907/15 09:23 1.00055 0.00002 1.000582 1.00077 1.0003907/16 15:28 1.00058 0.00003 1.000582 1.00077 1.0003907/17 10:09 1.00057 0.00001 1.000582 1.00077 1.0003907/18 09:34 1.00060 0.00003 1.000582 1.00077 1.0003907/19 09:13 1.00057 0.00003 1.000582 1.00077 1.0003907/20 02:31 1.00056 0.00001 1.000582 1.00077 1.0003907/21 09:53 1.00050 0.00006 1.000582 1.00077 1.0003907/22 09:07 1.00049 0.00001 1.000582 1.00077 1.0003907/23 09:37 1.00058 0.00009 1.000582 1.00077 1.0003907/24 10:24 1.00067 0.00009 1.000582 1.00077 1.0003907/25 08:45 1.00060 0.00007 1.000582 1.00077 1.0003907/26 12:25 1.00075 0.00015 1.000582 1.00077 1.0003907/27 12:16 1.00087 0.00012 1.000582 1.00077 1.0003907/28 14:06 1.00088 0.00001 1.000582 1.00077 1.0003907/29 10:30 1.00095 0.00007 1.000582 1.00077 1.0003907/30 08:38 1.00088 0.00007 1.000582 1.00077 1.0003907/31 13:15 1.00082 0.00006 1.000582 1.00077 1.0003908/01 08:40 1.00078 0.00004 1.000582 1.00077 1.0003908/02 11:11 1.00063 0.00015 1.000582 1.00077 1.0003908/03 00:22 1.00070 0.00007 1.000582 1.00077 1.0003908/03 10:52 1.00075 0.00005 1.000582 1.00077 1.00039

Averages 1.000582sd of mR 0.000083t(0.997,34)/sqrt(2) 2.260422

31

Changing Limits as New Data are Developed



(r/r)% is the reported range % deviation of the trial factors

(r/r) is the range of the trial factors and = (r/r)% * MF/100

(r/r) / d2 is the estimate of the sample standard deviation of the five trial factors

Rolling Avg MF is the average MF to date

Used Avg MF is the individual Avg MF for the first 7, fixed from 8‐19, re‐fixed from 20‐36

Rolling Avg sd is the average (r/r) / d2 to date

Used Avg sd is the individual Avg sd for the first 7, fixed from 8‐19, re‐fixed from 20‐36

Rolling Student t [t(0.997,run # ‐1) /sqrt(5)] is at 3σ and dof (number of runs – 1) divided by the square root of the number of values used to determine the meter factor (5).

Used Student t is the individual Student t for the first 7, fixed from 8‐19, re‐fixed from 20‐36

UL is the upper limit and is equal to Used Avg MF + Used Avg sd * Used Student t

LL is the lower limit and is equal to Used MF Avg – Used Avg sd * Used Student t

(r/r) / d2 Rolling Used Rolling Used Rolling UsedRun # DateTime MF (r/r)% (r/r) (est sd) Avg MF Avg MF (Avg sd) (Avg sd) Student t Student t UL LL

1 06/30 22:45 1.00071 0.022 0.00022 0.00009 1.00071 1.00071 0.00009 0.000092 07/01 10:52 1.00034 0.035 0.00035 0.00015 1.00053 1.00053 0.00012 0.00012 94.90097 94.90097 1.01216 0.988893 07/02 09:36 1.00054 0.042 0.00042 0.00018 1.00053 1.00053 0.00014 0.00014 8.14658 8.14658 1.00169 0.999374 07/03 10:05 1.00041 0.020 0.00020 0.00009 1.00050 1.00050 0.00013 0.00013 3.97638 3.97638 1.00101 0.999995 07/04 09:52 1.00033 0.028 0.00028 0.00012 1.00047 1.00047 0.00013 0.00013 2.87775 2.87775 1.00083 1.000106 07/05 09:08 1.00045 0.019 0.00019 0.00008 1.00046 1.00046 0.00012 0.00012 2.40423 2.40423 1.00075 1.000187 07/06 09:32 1.00051 0.018 0.00018 0.00008 1.00047 1.00047 0.00011 0.00011 2.14673 2.14673 1.00071 1.000238 07/07 08:46 1.00038 0.047 0.00047 0.00020 1.00046 1.00047 0.00012 0.00011 1.98658 2.14673 1.00071 1.000239 07/09 03:45 1.00024 0.024 0.00024 0.00010 1.00043 1.00047 0.00012 0.00011 1.87792 2.14673 1.00071 1.00023

10 07/09 10:44 1.00018 0.031 0.00031 0.00013 1.00041 1.00047 0.00012 0.00011 1.79958 2.14673 1.00071 1.0002311 07/10 09:53 1.00052 0.036 0.00036 0.00015 1.00042 1.00047 0.00013 0.00011 1.74054 2.14673 1.00071 1.0002312 07/11 09:27 1.00051 0.036 0.00036 0.00015 1.00043 1.00047 0.00013 0.00011 1.69448 2.14673 1.00071 1.0002313 07/12 10:42 1.00050 0.028 0.00028 0.00012 1.00043 1.00047 0.00013 0.00011 1.65759 2.14673 1.00071 1.0002314 07/13 11:55 1.00047 0.011 0.00011 0.00005 1.00044 1.00047 0.00012 0.00011 1.62739 2.14673 1.00071 1.0002315 07/14 09:46 1.00057 0.013 0.00013 0.00006 1.00044 1.00047 0.00012 0.00011 1.60221 2.14673 1.00071 1.0002316 07/15 09:23 1.00055 0.024 0.00024 0.00010 1.00045 1.00047 0.00012 0.00011 1.58091 2.14673 1.00071 1.0002317 07/16 15:28 1.00058 0.017 0.00017 0.00007 1.00046 1.00047 0.00011 0.00011 1.56266 2.14673 1.00071 1.0002318 07/17 10:09 1.00057 0.019 0.00019 0.00008 1.00046 1.00047 0.00011 0.00011 1.54685 2.14673 1.00071 1.0002319 07/18 09:34 1.00060 0.016 0.00016 0.00007 1.00047 1.00047 0.00011 0.00011 1.53302 2.14673 1.00071 1.0002320 07/19 09:13 1.00057 0.008 0.00008 0.00003 1.00048 1.00048 0.00011 0.00011 1.52082 1.52082 1.00064 1.0003121 07/20 02:31 1.00056 0.011 0.00011 0.00005 1.00048 1.00048 0.00010 0.00011 1.50998 1.52082 1.00064 1.0003122 07/21 09:53 1.00050 0.021 0.00021 0.00009 1.00048 1.00048 0.00010 0.00011 1.50029 1.52082 1.00064 1.0003123 07/22 09:07 1.00049 0.017 0.00017 0.00007 1.00048 1.00048 0.00010 0.00011 1.49158 1.52082 1.00064 1.0003124 07/23 09:37 1.00058 0.018 0.00018 0.00008 1.00049 1.00048 0.00010 0.00011 1.48369 1.52082 1.00064 1.0003125 07/24 10:24 1.00067 0.020 0.00020 0.00009 1.00049 1.00048 0.00010 0.00011 1.47653 1.52082 1.00064 1.0003126 07/25 08:45 1.00060 0.008 0.00008 0.00003 1.00050 1.00048 0.00010 0.00011 1.46999 1.52082 1.00064 1.0003127 07/26 12:25 1.00075 0.030 0.00030 0.00013 1.00051 1.00048 0.00010 0.00011 1.46400 1.52082 1.00064 1.0003128 07/27 12:16 1.00087 0.017 0.00017 0.00007 1.00052 1.00048 0.00010 0.00011 1.45849 1.52082 1.00064 1.0003129 07/28 14:06 1.00088 0.007 0.00007 0.00003 1.00053 1.00048 0.00010 0.00011 1.45341 1.52082 1.00064 1.0003130 07/29 10:30 1.00095 0.016 0.00016 0.00007 1.00055 1.00048 0.00009 0.00011 1.44871 1.52082 1.00064 1.0003131 07/30 08:38 1.00088 0.029 0.00029 0.00012 1.00056 1.00048 0.00010 0.00011 1.44434 1.52082 1.00064 1.0003132 07/31 13:15 1.00082 0.018 0.00018 0.00008 1.00057 1.00048 0.00009 0.00011 1.44028 1.52082 1.00064 1.0003133 08/01 08:40 1.00078 0.008 0.00008 0.00003 1.00057 1.00048 0.00009 0.00011 1.43649 1.52082 1.00064 1.0003134 08/02 11:11 1.00063 0.012 0.00012 0.00005 1.00057 1.00048 0.00009 0.00011 1.43294 1.52082 1.00064 1.0003135 08/03 00:22 1.00070 0.017 0.00017 0.00007 1.00058 1.00048 0.00009 0.00011 1.42962 1.52082 1.00064 1.0003136 08/03 10:52 1.00075 0.024 0.00024 0.00010 1.00058 1.00048 0.00009 0.00011 1.42650 1.52082 1.00064 1.00031

d2 for n=5 is 2.326

32

Annex D – Runs Rules

When a control chart is created for a process and once the process is predictable, then analysts often want to increase the sensitivity of the control chart. This increased sensitivity allows for the identification and correction of problems before the 3 standard deviation limits are reached. There are many “named” runs rules used to increase the sensitivity that are cited in the literature but the most widely known set is the Western Electric (WECO) rules which is shown below:

1. One statistic more than 3 standard deviations from the central line should be taken as a signal of the presence of an assignable cause which has a dominant effect.

2. Two out of three successive statistics falling more than 2 standard deviations from the central line should be taken as an indication of the presence of an assignable cause which has a moderate but sustainable effect.

3. Four out of five successive statistics falling more than 1 standard deviation from the central line should be taken as an indication of the presence of an assignable cause which has a moderate but sustainable effect.

4. Eight consecutive statistics on the same side of the central line should be taken as an indication of the presence of an assignable cause which has a weak but sustainable effect.

Note: Rule 4 was originally published using seven but subsequent experience indicated that eight resulted in fewer false positives.

CAUTIONS:

These rules are not applicable to a process that is not in control; that is, not predictable.

The other “named” rules are generally derived from the WECO rules and are usually developed to be applied to a particular process; accordingly, using other detection rules can increase the incidence of false positives if used to monitor meter performance.

Experience has shown that using WECO rules 2‐4 can increase the incidence of false positives.

33

Bibliography

[1] NIST/SEMATECH e‐Handbook of Statistical Methods, Chapter 6, http://www.itl.nist.gov/div898/handbook/

[2] Wheeler, Donald J., Probability Limits, Quality Digest, www.qualitydigest.com/inside/quality‐insider‐column/probability‐limits.html, March 2, 2015

[3] Wheeler, Donald J., “Making Sense of Data”, SPC Press, Knoxville, Tennessee, 2003

Manual of Petroleum Measurement Standards Chapter 13...

Documents

Transcript of Manual of Petroleum Measurement Standards Chapter 13...