Professional Documents
Culture Documents
talking point
point
F
ew issues in contemporary risk policy scientific certainty shall not be used as Most criticism of the precautionary prin-
are as momentous or contentious as a reason for postponing cost-effective ciple is based on unfavourable comparisons
the precautionary principle. Since measures to prevent environmental deg- with established ‘sound scientific’ methods
it first emerged in German environmental radation” (UN, 1992). This injunction has in the governance of risk. These include a
policy, it has been championed by envi- given rise to a wide range of criticisms: range of quantitative and/or expert-based
ronmentalists and consumer protection sound scientific techniques of risk assess- risk-assessment techniques, involving vari-
groups, and resisted by the industries they ment already offer a comprehensive and ous forms of scientific experimentation and
oppose (Raffensperger & Tickner, 1999). rational set of ‘decision rules’ for use in modelling, probability and statistical theory,
Various versions of the principle now pro- policy (Byrd & Cothern, 2000); these sci- cost–benefit and decision analysis, and
liferate across different national and inter- ence-based approaches yield a robust and Bayesian and Monte Carlo methods. These
national jurisdictions and policy areas practically operational basis for decision- conventional methods are assumed—often
(Fisher, 2002). From a guiding theme in making under uncertainty (Morris, 2000); implicitly—to offer a comprehensively rig-
European Commission (EC) environmen- the precautionary principle fails as a basis orous basis for informing decision-making
tal policy, it has become a general princi- for any similar operational type of deci- (Byrd & Cothern, 2000). In particular, they
ple of EC law (CEC, 2000; Vos & Wendler, sion rule in its own right (Peterson, 2006); are held to provide decision rules that are
2006). Its influence has extended from the the precautionary principle is of practical applicable, appropriate and complete
regulation of environmental, technological relevance only in risk management, and (Peterson, 2006). Therefore, when consider-
and health risks to the wider governance of not in risk assessment (CEC, 2000); and, if ing the relative strengths and weaknesses of
science, innovation and trade (O’Riordan & applied to assessment, the precautionary the precautionary principle, we must also
Cameron, 1994). principle threatens a rejection of useful and give equal attention to these conventional
well-established risk assessment techniques approaches to risk assessment.
… when considering the relative (Woteki, 2000).
A
Each of these involves strong assump- ll scientific approaches are based on
strengths and weaknesses of the
tions about the nature and standing of sci- the articulation of two fundamental
precautionary principle, we must entific rationality and rigour, the scope and parameters, which are then reduced
also give equal attention to… character of uncertainty, the applicability to an aggregated concept of risk. First are
conventional approaches to risk and limits of risk assessment, and the par- things that might happen: hazards, possibil-
assessment ticular implications of precaution. I hope to ities or outcomes. Second is the likelihood
contribute to a more measured debate on or probability associated with each. Either
these matters, and will briefly review each of these parameters might be subject to var-
An early classic formulation neatly of these arguments in turn. In the process, I iously complete or problematic knowledge,
encapsulates its key features. According will explore more constructive ways to sat- in ways that are outlined below. This yields
to Principle 15 of the Rio Declaration isfy imperatives for robustness, rationality, four logical permutations of possible states
on Environment and Development: “In rigour and precaution. of incomplete knowledge—of course, these
order to protect the environment, the are neither discrete nor mutually exclusive
precautionary approach shall be widely and typically occur together in varying
applied by States according to their capa-
… we might already see the value degrees in the real world (Fig 1; Stirling,
bilities. Where there are threats of seri- of the precautionary principle as a 1999). Conventionally, risk assessment
ous or irreversible damage, lack of full salutary spur to greater humility addresses each of these states essentially
©2007 EUROPEAN MOLECULAR BIOLOGY ORGANIZATION EMBO reports VOL 8 | NO 4 | 2007 309
science & society ta lki ng point
Knowledge about Knowledge about are judged to foster high confidence in both
PROBABILITIES OUTCOMES the possible outcomes and their respective
NOT problematic Problematic probabilities. In the strict sense of the term,
NOT problematic ■ RISK AMBIGUITY ■ this is the formal condition of risk and it is
■ Familiar systems Contested framings, questions, ■ under these conditions that the conven-
■ Controlled conditions assumptions, methods
Comparing incommensurables: ■
tional techniques of risk assessment offer a
■ Engineering failure apples and oranges
scientifically rigorous approach. However,
■ Known epidemics Disagreements between ■
it is also clear that this formal definition of
■ Transport safety specialists, disciplines risk also implies circumstances of uncer-
■ Flood Issues of behaviour, ■ tainty, ambiguity and ignorance under
(under normal conditions) trust and compliance which the reductive techniques of risk
Interest, language, meaning ■ assessment are not applicable.
Matters of ethics and equity ■ Under the condition of uncertainty
■ UNCERTAINTY IGNORANCE ■
(Fig 1), we can characterize possible out-
■ Complex, nonlinear, open systems Unanticipated effects ■
comes, but the available information or
■ Human element in causal models Unexpected conditions ■
analytical models do not present a definitive
■ Specific effects beyond boundaries Gaps, surprises, unknowns ■
basis for assigning probabilities. It is under
■ Flood under climate change Novel agents like TSEs ■
these conditions that “probability does not
310 EMBO reports VOL 8 | NO 4 | 2007 ©2007 EUROPEAN MOLECULAR BIOLOGY ORGANIZATION
talking p o int science & society
environmental issues were—at their out- Academic scientists Key
set—of this kind (Funtowicz & Ravetz, org org Each chart shows risk rankings
1990). In the early histories of stratospheric ipm ipm on a subjective interval scale of
cnv cnv ‘performance’
ozone depletion, bovine spongiform
gm1 gm1
encephalopathy and endocrine-disrupting High Low
gm2 gm2 risk risk
chemicals, for example, the initial problem gm3 gm3
was not so much divergent expert views or org Organic agricultural methods
mistakes over probability, but straightfor- Government advisers
ipm Integrated pest management
org org
ward ignorance about the possibilities them- cnv Conventional intensive farming
ipm ipm gm1 with segregation & labelling
selves. Again, it is irrational to represent cnv cnv gm2 with monitoring
ignorance as risk. gm1 gm1 gm3 with voluntary control
The picture summarized in Fig 1 is gm2 gm2
gm3 gm3
intrinsic to the scientific definition of risk
itself and is therefore difficult to refute in Public interest
these terms. Risk assessment offers a pow- org org org
erful suite of methods under a strict state ipm ipm ipm
of risk. However, these are not applicable cnv cnv cnv
gm1 gm1 gm1
under conditions of uncertainty, ambigu-
gm2 gm2 gm2
ity and ignorance. Contrary to the impres- gm3 gm3 gm3
sion given in calls for ‘science-based’ risk
assessment, persistent adherence to these Industry
reductive methods, under conditions other org org org
ipm ipm ipm
than the strict state of risk, are irrational,
cnv cnv cnv
unscientific and potentially misleading. gm1 gm1 gm1
gm2 gm2 gm2
F
rom these fundamental issues of scien- gm3 gm3 gm3
©2007 EUROPEAN MOLECULAR BIOLOGY ORGANIZATION EMBO reports VOL 8 | NO 4 | 2007 311
science & society ta lki ng point
I
tions (Table 1). The point is not that scien- be considered more or less robust than t is under these more intractable states
tific discipline carries no value. For any conventional methods of risk assessment? of incertitude that the precautionary
particular framing conditions, scientific The precautionary principle is not—and principle comes into its own (Stirling,
procedures offer important ways to make cannot properly claim to be—a complete 2003). The value here is not as a tightly pre-
analysis more systematic, transparent, decision rule at all. Unlike many of the scriptive decision rule—by definition, that
accountable and reproducible. The issue is techniques with which it is compared, is not scientifically possible under these
not that ‘anything goes’, but rather that, in it is, as its name suggests, more a general conditions. Instead, the precautionary prin-
complex areas, science-based techniques principle than a specific methodology. In ciple draws attention to a broader range of
rarely deliver a single robust set of findings. other words, it does not of itself purport to non-reductive methods, which avoid spuri-
To paraphrase an apocryphal remark by provide a detailed protocol for deriving a ous promises to determine ‘science-based’
Winston Churchill, the message is that sci- precise understanding of relative risks and policy (Fig 4; Stirling, 2006). The intention
ence is essential, but that it should remain uncertainties, much less justify particular is not to imply a neat one-to-one mapping
“on tap, not on top” (Lindsay, 1995). detailed decisions. Instead, it provides a of specific methods to individual states
general normative guide to the effect that of knowledge, but rather to illustrate the
S
o what does this mean for the pre- policy-making under uncertainty, ambigu- rich variety of alternatives that exist if risk
cautionary principle? As already ity and ignorance should give the benefit assessment is not properly applicable.
mentioned, its criticisms are typi- of the doubt to the protection of human In this light, we can appreciate that the
cally founded on unfavourable compari- health and the environment, rather than real failure as a decision rule is not that of
sons with ‘sound scientific’ methods of risk to competing organizational or economic the precautionary principle but the aspi-
assessment. The preceding discussion has interests. This, in turn, holds important ration to a reductive, ‘science-based’ risk
shown that—for all their strengths under implications for the level of proof required assessment beyond the narrow confines of
strict conditions of ‘risk’—these techniques to sustain an argument, the placing of the risk itself. If we seek simple rules to remove
are neither rational and rigorous nor practi- the need for subjectivity, argument, delib-
cally robust under conditions of uncertainty, … the precautionary principle eration and politics, then precaution offers
ambiguity and ignorance. It is on this basis no such promise. Instead, it points to a rich
draws attention to a broader
that we might already see the value of the array of methods that reveal the intrinsi-
precautionary principle as a salutary spur
range of non-reductive methods, cally normative and contestable basis for
to greater humility. However, there remain which avoid spurious promises to decisions, and the different ways in which
some significant questions. Does precaution determine ‘science-based’ policy our knowledge is incomplete. This is as
312 EMBO reports VOL 8 | NO 4 | 2007 ©2007 EUROPEAN MOLECULAR BIOLOGY ORGANIZATION
talking p o int science & society
good a ‘rule’ for decision-making as we Table 2 | Key features of a precautionary appraisal process (after Gee et al, 2001)
can reasonably get. Precaution ‘broadens out’ the inputs to appraisal beyond the scope that is typical in conventional
What is interesting about these impli- regulatory risk assessment, in order to provide for the following points.
cations of the precautionary principle is (i) Independence from vested institutional, disciplinary, economic and political interests
that they refute the often-repeated injunc- (ii) Examination of a greater range of uncertainties, sensitivities and possible scenarios
tion—even at the highest levels of policy- (iii) Deliberate search for ‘blind spots’, gaps in knowledge and divergent scientific views
making (CEC, 2000)—that precaution
(iv) Attention to proxies for possible harm, i.e. mobility, bioaccumulation and persistence
is relevant to risk management but not
(v) Contemplation of full life cycles and resource chains as they occur in the real world
risk assessment. Various methodological
responses to uncertainty, ambiguity and (vi) Consideration of indirect effects, such as additivity, synergy and accumulation
ignorance present alternative approaches (vii) Inclusion of industrial trends, institutional behaviour and issues of non-compliance
(Fig 4). Of course, each might be seen as a (viii) Explicit discussion over appropriate burdens of proof, persuasion, evidence and analysis
complement to risk assessment, rather than (ix) Comparison of a series of technology and policy options and potential substitutes
as a potential substitute. The point is that (x) Deliberation over justifications and possible wider benefits, as well as risks and costs
insisting that precaution relates only to risk (xi) Drawing on relevant knowledge and experience arising beyond specialist disciplines
management entirely misses its real value
(xii) Engagement with the values and interests of all stakeholders who stand to be affected
in highlighting more diverse ways to gather
(xiii) General citizen participation in order to provide independent validation of framing
relevant knowledge.
(xiv) A shift from theoretical modelling towards systematic monitoring and surveillance
P
olicy understandings of precaution (xv) A greater priority on targeted scientific research to address unresolved questions
are now moving away from rigid (xvi) Initiation at the earliest stages ‘upstream’ in an innovation, strategy or policy process
ideas of a decision rule that is appli- (xvii) Emphasis on strategic qualities such as reversibility, flexibility, diversity and resilience
cable only in risk management, towards
more broad processes of social appraisal
(Table 2; ESTO, 1999; Gee et al, 2001). In
many ways, these qualities are simply com-
mon sense. In an ideal world, they would COMMUNICATION
■ Engagement with the public and stakeholders■ Review individual cases
and could apply equally to the application ■ Feedback between stages ■ Frame and design process
of risk assessment. However, the incorpo-
ration of all these qualities as routine fea- SCREENING APPRAISAL
EVALUATION
MANAGEMENT
tures would be prohibitively demanding of Is there certainly PRESUMPTION OF PREVENTION
evidence, analysis, time and money. The
a serious and YES
unambiguous
■ Direct to restrictive management measures
question therefore arises as to how to iden- threat? ■ Relaxation only if strict societal consensus
on countervailing purpose or benefits
tify those cases in which it is justifiable to NO
adopt these approaches.
Is the threat PRECAUTIONARY APPRAISAL (cf: table 2)
©2007 EUROPEAN MOLECULAR BIOLOGY ORGANIZATION EMBO reports VOL 8 | NO 4 | 2007 313
science & society ta lki ng point
Table 3 | Illustrative criteria of seriousness, uncertainty and ambiguity (after Stirling et al, 2006) science, precaution offers a way to be more
Criteria of seriousness measured and rational about uncertainty,
Clear evidence of carcinogenicity, mutagenicity, or reprotoxicity in components/residues ambiguity and ignorance.
Clear evidence of virulent pathogens Of course, there remain unresolved
issues. Precautionary appraisal is inherently
Clear violation of risk-based concentration thresholds or standards
comparative; therefore it is as likely to spur
Criteria of uncertainty and ignorance favoured directions for innovation as to
Scientifically founded doubts on theory inhibit those that are disfavoured. Here, we
Scientific doubts on model sufficiency or applicability can expect—and should welcome—con-
Scientific doubts on data quality or applicability tinuing criticism, concern and debate
Novel, unprecedented features of the product through open policy discourse and demo-
Criteria of sociopolitical ambiguity cratic accountability. What is not tenable is
Divergent individual perceptions of risk that these inherently political issues be con-
cealed behind opaque, deterministic ideas
Institutional conflict between different agencies
of the role of science. In prompting more
Amplification effects in news media
rational, balanced and measured under-
Social/ethical concerns, distributional issues or political mobilization standings of ‘sound science’ rhetorics on
uncertainty, precaution has arguably made
its greatest contribution.
REFERENCES
T
… precaution need in no sense his article began with a series of
Arrow KJ (1963) Social Choice and Individual Values.
be seen as a blanket rejection of concerns about the precautionary New Haven, CT, USA: Yale University Press
principle. Taking each in turn, I have Byrd DM, Cothern CR (2000) Introduction to Risk
risk assessment shown that the ‘sound scientific’ methods Analysis: A Systematic Approach to Science-
of risk assessment—with which precau- Based Decision Making. Rockville, MD, USA:
Government Institutes
ambiguity (Table 3). When none of these tion is often compared—do not offer an
CEC (2000) Communication from the Commission
criteria is triggered, then the case in ques- unqualified rational, rigorous or robust on the Precautionary Principle. COM (2000)1
tion is subject to conventional risk assess- basis for decision-making under uncer- final. Brussels, Belgium: Commission of the
ment. Only when there is uncertainty or tainty, ambiguity or ignorance. It is true European Communities
ambiguity does the process initiate a more that the precautionary principle also fails Collingridge D (1980) The Social Control of
Technology. Milton Keynes, UK: Open
elaborate precautionary appraisal or delib- as a source of complete prescriptive ‘deci- University Press
erative process. Current work is refining sion rules’ under these challenging condi- de Finetti B (1974) Theory of Probability. New York,
the specific methodological, institutional tions. However, this failure is less acute in NY, USA: Wiley
and legal implications in the area of food the case of precaution because prescriptive ESTO (1999) On Science and Precaution in the
Management of Technological Risk. Brussels,
safety (Stirling et al, 2006). ‘decision rules’ are neither the aim nor the Belgium: European Science and Technology
Of course, from any point of view, claim of this general guidance. Observatory
the devil will always be in the detail. Although falling short of prescriptive Fisher E (2002) Precaution, precaution everywhere:
However, the main points to make here decision rules, the precautionary principle developing a ‘common understanding’ of the
precautionary principle in the European
are the following. First, the framework does suggest a range of more modest, open-
Community. Maastricht J Eur Comp Law 9: 7–28
as a whole is itself precautionary, in that ended, but nonetheless highly effective Funtowicz SO, Ravetz JR (1990) Uncertainty and
attention is given to ambiguity, uncertainty methodologies and general qualities, Quality in Science for Policy. Dordrecht, The
and ignorance. The default response to a which offer ways to complement and Netherlands: Kluwer Academic
certain, unambiguously serious threat is improve on conventional risk assessment. Gee D, Harremoes P, Keys J, MacGarvin M,
Stirling A, Vaz S, Wynne B (2001) Late Lesson
the immediate presumption of preventive As such, it is clear that—contrary to com- from Early Warnings: The Precautionary Principle
measures. Second, the framework does mon assertions—the precautionary princi- 1898–2000. Copenhagen, Denmark: European
not necessarily imply that the adoption ple is of practical relevance as much to risk Environment Agency
of precaution will automatically entail assessment as to risk management. Klinke A, Renn O (2002) A new approach to risk
evaluation and management: risk-based,
any particular measure, such as bans or Precaution does not automatically entail precaution-based, and discourse-based
phase-outs. Third, the framework shows bans and phase-outs, but instead calls for strategies. Risk Anal 22: 1071–1094
how adoption of the precautionary princi- deliberate and comprehensive attention Klinke A, Dreyer M, Renn O, Stirling A,
ple need not imply a blanket rejection of to contending policy or technology path- van Zwanenberg P (2006) Precautionary risk
regulation in European governance. J Risk Res 9:
risk assessment, still less of science itself. ways. Far from being in tension with
373–392
Instead, it involves a carefully measured Lindsay R (1995) Galloping gertie and the
and targeted treatment of different states of Far from being in tension with precautionary principle: How is environmental
knowledge. In this sense, this precaution- impact assessment assessed? In Science for the
science, precaution offers a Earth, T Wakeford, M Walters (eds), pp 44–57.
ary framework might be seen as more rig-
orous and rational—and potentially more
way to be more measured and London, UK: Wiley
Morris J (ed; 2000) Rethinking Risk and the
robust—than the indiscriminate use of rational about uncertainty, Precautionary Principle. Oxford, UK:
often-inapplicable methods. ambiguity and ignorance Butterworth-Heinemann
314 EMBO reports VOL 8 | NO 4 | 2007 ©2007 EUROPEAN MOLECULAR BIOLOGY ORGANIZATION
talking p o int science & society
O’Riordan T, Cameron J (1994) Interpreting the Stirling A, Mayer S (1999) Rethinking Risk: a Pilot
Precautionary Principle. London, UK: Earthscan Multi-criteria Mapping of a Genetically Modified
Publications Crop in Agricultural Systems in the UK. Sussex,
Peterson M (2006) The precautionary principle is UK: Science Policy Research Unit, University of
incoherent. Risk Anal 26: 595–601 Sussex
Raffensperger C, Tickner J (eds; 1999) Protecting Stirling A, Ely A, Renn O, Dreyer M, Borkhart K, Vos
Public Health and the Environment: E, Wendler F (2006) A General Framework for the
Implementing the Precautionary Principle. Precautionary and Inclusive Governance of Food
Washington, DC, USA: Island Safety: Accounting for Risks, Uncertainties and
Renn O, Dreyer M, Klinke A, Losert C, Stirling A, Ambiguities in the Appraisal and Management
van Zwanenberg P, Muller-Herold U, of Food Safety Threats. Stuttgart, Germany:
Morosini M, Fisher E (2003) The application University of Stuttgart Andrew Stirling is a professor in Science and
of the precautionary principle in the European Sundqvist T, Soderholm P, Stirling A (2004) Electric Technology Policy Research at the University
Union. Final document of the EU project power generation: valuation of environmental of Sussex, UK.
‘Regulatory Strategies and Research Needs to costs. In Encyclopedia of Energy, CJ Cleveland E-mail: a.c.stirling@sussex.ac.uk
Compose and Specify a European Policy on (ed), pp 229–243. Boston, MA, USA: Elsevier
the Application of the Precautionary Principle’ Academic doi:10.1038/sj.embor.7400953
(PrecauPri). Stuttgart, Germany: Centre of Thompson M, Warburton M (1985) Decision
Technology Assessment in Baden-Wuerttemberg making under contradictory certainties: how to
Stirling A (1999) Risk at a turning point? J Env Med save the Himalayas when you can’t find what’s
1: 119–126 wrong with them. J Appl Sys Anal 12: 3–33
Stirling A (2003) Risk, uncertainty and precaution: UN (1992) Report on the United Nations
some instrumental implications from the social Conference on Environment and Development.
sciences. In Negotiating Environmental Change, A/CONF.151/26 (Vol 1). New York, NY, USA:
F Berkhout, M Leach, I Scoones (eds), pp 33–76. United Nations
Cheltenham, UK: Edward Elgar Vos E, Wendler F (eds; 2006) Food Safety
Stirling A (2006) Uncertainty, precaution Regulation in Europe: A Comparative Institutional
For more discussion on this topic, see also
and sustainability: towards more reflective Analysis. Mortsel, Belgium: Intersentia
Renn O (2007) Precaution and analysis: two
governance of technology. In Reflexive Woteki C (2000) The Role of Precaution in Food
Governance for Sustainable Development, Safety Decisions. Washington, DC, USA: US
sides of the same coin? This issue p303.
JP Voss, D Bauknecht, R Kemp (eds), pp 225–272. Department of Agriculture Peterson M (2007) The precautionary principle
Cheltenham, UK: Edward Elgar Wynne B (2002) Risk and environment as should not be used as a basis for decision-
Stirling A, Gee D (2002) Science, precaution, and legitimatory discourses of technology: reflexivity making. This issue p305.
practice. Public Health Rep 117: 521–533 inside out? Curr Sociol 50: 459–477
©2007 EUROPEAN MOLECULAR BIOLOGY ORGANIZATION EMBO reports VOL 8 | NO 4 | 2007 315