Search tips
Search criteria 


Logo of procascamcLink to Publisher's site
Proc Annu Symp Comput Appl Med Care. 1991 : 3–7.
PMCID: PMC2247484

Field trials of medical decision-aids: potential problems and solutions.


Only clinical trials can assess the impact of prototype medical decision-aids, but they are seldom performed before dissemination. Many problems are encountered when designing such studies, including ensuring generality, deciding what to measure, feasible study designs, correcting for biases caused by the trial itself and by the decision-aid, resolving the "Evaluation Paradox", and potential legal and ethical doubts. These are discussed in this paper.

Full text

Full text is available as a scanned copy of the original print version. Get a printable copy (PDF file) of the complete article (972K), or click on a page image below to browse page by page. Links to PubMed are also available for Selected References.

Selected References

These references are in PubMed. This may not be the complete list of references from this article.
  • Shortliffe EH. Computer programs to support clinical decision making. JAMA. 1987 Jul 3;258(1):61–66. [PubMed]
  • Lundsgaarde HP. Evaluating medical expert systems. Soc Sci Med. 1987;24(10):805–819. [PubMed]
  • Miller PL. The evaluation of artificial intelligence systems in medicine. Comput Methods Programs Biomed. 1986 Mar;22(1):5–11. [PubMed]
  • Wyatt J, Spiegelhalter D. Evaluating medical expert systems: what to test and how? Med Inform (Lond) 1990 Jul-Sep;15(3):205–217. [PubMed]
  • Donabedian A. Evaluating the quality of medical care. Milbank Mem Fund Q. 1966 Jul;44(3 Suppl):166–206. [PubMed]
  • Buck C, Donner A. The design of controlled experiments in the evaluation of non-therapeutic interventions. J Chronic Dis. 1982;35(7):531–538. [PubMed]
  • Fenyö G. Routine use of a scoring system for decision-making in suspected acute appendicitis in adults. Acta Chir Scand. 1987 Sep;153(9):545–551. [PubMed]
  • Adams ID, Chan M, Clifford PC, Cooke WM, Dallos V, de Dombal FT, Edwards MH, Hancock DM, Hewett DJ, McIntyre N, et al. Computer aided diagnosis of acute abdominal pain: a multicentre study. Br Med J (Clin Res Ed) 1986 Sep 27;293(6550):800–804. [PMC free article] [PubMed]
  • Spiegelhalter DJ. Evaluation of clinical decision-aids, with an application to a system for dyspepsia. Stat Med. 1983 Apr-Jun;2(2):207–216. [PubMed]
  • Pozen MW, D'Agostino RB, Selker HP, Sytkowski PA, Hood WB., Jr A predictive instrument to improve coronary-care-unit admission practices in acute ischemic heart disease. A prospective multicenter clinical trial. N Engl J Med. 1984 May 17;310(20):1273–1278. [PubMed]
  • Cornfield J. Randomization by group: a formal analysis. Am J Epidemiol. 1978 Aug;108(2):100–102. [PubMed]
  • Hart A, Wyatt J. Evaluating black-boxes as medical decision aids: issues arising from a study of neural networks. Med Inform (Lond) 1990 Jul-Sep;15(3):229–236. [PubMed]
  • Brahams D, Wyatt J. Decision aids and the law. Lancet. 1989 Sep 9;2(8663):632–634. [PubMed]

Articles from Proceedings of the Annual Symposium on Computer Application in Medical Care are provided here courtesy of American Medical Informatics Association