Method Notes

2
Formative evaluation uses evaluation methods to improve the way a program is delivered. At the other end of this continuum is summative evaluation, which measures program outcomes and impacts during ongoing operations or after program completion.  The most common qualitative data collection met hods are interviews other than highly structured interviews, focus groups, and participant observation. Open - ended responses to survey questions can provide qualitative data as well. The most common sources of quantitative data are administrative records and structured surveys conducted via Internet and mail. i!ed - method approaches in evaluation are very common, and that means that both quantitative and qualitative data are used, and quantitative and qualitative data collection me thods are used in combination. "hen ma#ing causal inferences, evaluators must measure several elements$  The timing of the outcomes, to ens ure that observed outcomes occurred aft er the program was implemented  The e!tent to which t he changes in outcomes occur red after the program was implemented  The presence of confounding factors $ that is, factors that could also have a%ected desired outcomes It can be very di& cult to draw causal inferences. It may be desirable to use terms such as plausible attribution when drawing c onclusions about the e%ects of programs on intended behaviors.

Transcript of Method Notes

8/16/2019 Method Notes

http://slidepdf.com/reader/full/method-notes 1/1

Formative evaluation uses evaluation methods to improve the way a program is

delivered. At the other end of this continuum is summative evaluation, which

measures program outcomes and impacts during ongoing operations or after

program completion.

 The most common qualitative data collection methods are interviews other than

highly structured interviews, focus groups, and participant observation. Open -ended responses to survey questions can provide qualitative data as well. The most

common sources of quantitative data are administrative records and structured

surveys conducted via Internet and mail. i!ed - method approaches in evaluation

are very common, and that means that both quantitative and qualitative data are

used, and quantitative and qualitative data collection methods are used in

combination.

"hen ma#ing causal inferences, evaluators must measure several elements$

•  The timing of the outcomes, to ensure that observed outcomes occurred after

the program was implemented

•  The e!tent to which the changes in outcomes occurred after the program was

implemented

•  The presence of confounding factors$ that is, factors that could also have

a%ected desired outcomes

It can be very di& cult to draw causal inferences. It may be desirable to use terms

such as plausible attribution when drawing conclusions about the e%ects of

programs on intended behaviors.