In an after-only design the researcher knows that a population is being, or has been, exposed to an intervention and wishes to study its impact on the population. In this design, information on baseline (pre-test or before observation) is usually ‘constructed’ on the basis of respondents’ recall of the situation before the intervention, or from information available in existing records – secondary sources. The change in the dependent variable is measured by the difference between the ‘before’ (baseline) and ‘after’ data sets. Technically, this is a very faulty design for measuring the impact of an intervention as there are no proper baseline data to compare the ‘after’ observation with. Therefore, one of the major problems of this design is that the two sets of data are not strictly comparable. For example, some of the changes in the dependent variable may be attributable to the difference in the way the two sets of data were compiled. Another problem with this design is that it measures total change, including change attributable to extraneous variables; hence, it cannot identify the net effect of an intervention. However, this design is widely used in impact assessment studies, as in real life many programmes operate without the benefit of a planned evaluation at the programme planning stage (though this is fast changing) in which case it is just not possible to follow the sequence strictly – collection of baseline information, implementation of the programme and then programme evaluation. An evaluator therefore has no choice but to adopt this design. In practice, the adequacy of this design depends on having reasonably accurate data available about the prevalence of a phenomenon before the intervention is introduced. This might be the case for situations such as the impact of random breath testing on road accidents, the impact of a health programme on the mortality of a population, the impact of an advertisement on the sale of a product, the impact of a decline in mortality on the fertility of a population, or the impact of a change in immigration policy on the extent of immigration. In these situations it is expected that accurate records are kept about the phenomenon under study and so it may be easier to determine whether any change in trends is primarily because of the introduction of the intervention or change in the policy.
REFERENCES