Publication details for Professor Nancy CartwrightCartwright, N. (2007). Are RCTs the Gold Standard? BioSocieties 2(1): 11-20.
- Publication type: Journal Article
- ISSN/ISBN: 1745-8552, 1745-8560
- DOI: 10.1017/S1745855207005029
- Keywords: Causal inference, External validity, Hypothetico-deductive method, Internal validity, Randomized controlled trials.
- Further publication details on publisher web site
- Durham Research Online (DRO) - may include full text
Author(s) from Durham
The claims of randomized controlled trials (RCTs) to be the gold standard rest on the fact that the ideal RCT is a deductive method: if the assumptions of the test are met, a positive result implies the appropriate causal conclusion. This is a feature that RCTs share with a variety of other methods, which thus have equal claim to being a gold standard. This article describes some of these other deductive methods and also some useful non-deductive methods, including the hypothetico-deductive method. It argues that with all deductive methods, the benefit that the conclusions follow deductively in the ideal case comes with a great cost: narrowness of scope. This is an instance of the familiar trade-off between internal and external validity. RCTs have high internal validity but the formal methodology puts severe constraints on the assumptions a target population must meet to justify exporting a conclusion from the test population to the target. The article reviews one such set of assumptions to show the kind of knowledge required. The overall conclusion is that to draw causal inferences about a target population, which method is best depends case-by-case on what background knowledge we have or can come to obtain. There is no gold standard.
Also as "Technical Report 01/07" (2007), Contingency and Dissent in Science Series, CPNSS, LSE.
Also in N. Cartwright (2007), Causal Powers.