Search
1995 Volume 10
Article Contents
RESEARCH ARTICLE   Open Access    

Bias in human judgement under uncertainty?

More Information
  • Abstract: The claim is frequently made that human judgement and reasoning are vulnerable to cognitive biases. Such biases are assumed to be inherent in that they are attributed to the nature of the mental processes that produce judgement. In this paper, we review the psychological evidence for this claim in the context of the debate concerning human judgemental competence under uncertainty. We consider recent counter-arguments which suggest that the evidence for cognitive biases may be dependent on observations of performance on inappropriate tasks and by comparisons with inappropriate normative standards. We also consider the practical implications for the design of decision support systems.
  • 加载中
  • Arkes HR, Hackett C and Boehm L, 1989. “The generality of the relation between familiarity and validity” Journal of Behavioral Decision Making281–94.

    Google Scholar

    Ayton P, 1992. “On the competence and incompetence of experts” In: Wright G and Bolger F (eds.), Expertise and Decision Support, Plenum.

    Google Scholar

    Ayton P and Wright G, 1987. “Assessing and improving judgmental probability forecasts” OMEGA: International Journal of Management Science15191–196.

    Google Scholar

    Ayton P, Hunt A and Wright G, 1989. “Psychological conceptions of randomness” Journal of Behavioral Decision Making2221–238.

    Google Scholar

    Ayton P, Hunt A and Wright G, 1991. “Randomness and reality” Journal of Behavioral Decision Making4222–226.

    Google Scholar

    Bacon Fr, 1979. “Credibility of repeated statements: memory for trivia” Journal of Experimental Psychology: Human Learning and Memory5241–252.

    Google Scholar

    Bar-Hillel M, 1980. “The base-rate fallacy in probability judgements” Acta Psychologica44211–233.

    Google Scholar

    Beach LR and Braun G, 1994. “Laboratory studies of subjective probability: A status report” In: Wright G, and Ayton P (eds.), Subjective Probability, Wiley.

    Google Scholar

    Benson PG and Önkal D, 1992. “The effects of feedback and training on the performance of probability forecasters” Internaüonal Journal of Forecasting8559–573.

    Google Scholar

    Bolger F and Harvey N, 1993. “Context-sensitive heuristics in statistical reasoning” Quarterly Journal of Experimental Psychology46A 779–811.

    Google Scholar

    Bolger F and Wright G, 1994. “Assessing the quality of expert judgement: Issues and analysis” Decision Support Systems111–24.

    Google Scholar

    Cohen LJ, 1981. “Can human irrationality be experimentally demonstrated?” The Behavioral and Brain Sciences4317–370.

    Google Scholar

    Christcnsen-Szalanski JJJ and Bushyhead JB, 1981. “Physicians use of probabilistic information in a real clinical setting” Journal of Experimental Psychology, Human Perception and Performance7928–935.

    Google Scholar

    Cooper A, Woo C and Dunkelberger W, 1988. “Entrepreneurs' perceived chances for success” Journal of Business Venturing397–108.

    Google Scholar

    Cosmides L and Tooby J, in press. “Are humans good intuitive statisticians after all? Rethinking some conclusions from the literature on judgment under uncertainty” Cognition.

    Google Scholar

    Dalkey N, 1972. “An elementary cross impact model” Technological Forecasting and Social Changes3341–351.

    Google Scholar

    Dawes RM, 1980. “Confidence in intellectual judgments” In: Lantermann ED and Feger H (eds.), Similarity and Choice, Hans Huber.

    Google Scholar

    Dawes RM, 1988. Rational Choice in an Uncertain World. Harcourt.

    Google Scholar

    Dostoyevsky F, 1966. The Gambler, Penguin.

    Google Scholar

    DuCharme WM and Peterson CR, 1968. “Intuitive inference about normally distributed populations” Journal of Experimental Psychology78269–275.

    Google Scholar

    Duda RO, Hart PE and Nilsson NJ, 1976. “Subjective Bayesian methods for rule-based inference systems” Proc. Nat. Computer. Cong (AFIPS)451075–1082.

    Google Scholar

    Eddy DM, 1982. “Probabilistic reasoning in clinical medicine: Problems and opportunities” In: Kahneman D, Slovic P and Tversky A (eds.), Judgement under Uncertainty: Heuristics and biases, Cambridge University Press.

    Google Scholar

    Edwards W, 1954. “The theory of decision making” Psychological Bulletin51380–417.

    Google Scholar

    Edwards W, 1968. “Conservatism in human information processing” In: Kleinmuntz B (ed.), Formal Representation of Human Judgment, Wiley.

    Google Scholar

    Estes W, 1976. “The cognitive side of probability learning” Psychological Review8337–64.

    Google Scholar

    Ferrell WR and McGooey PJ, 1980. “A model of calibration for subjective probabilities” Organizational Behavior and Human Performance2632–53.

    Google Scholar

    Finke RA, 1984. “Strategies for being random” Bulletin of the Psychonomic Society2240–41.

    Google Scholar

    Fischhoff B and Beyth-Marom R, 1983. “Hypothesis evaluation from a Bayesian perspective” Psychological Review90239–260.

    Google Scholar

    Fischhoff B, Slovic P and Lichtenstein R, 1983. “Fault trees: Sensitivity of estimated failure probabilities to problem representation” Journal of Experimental Psychology: Human Perception and Performance4330–344.

    Google Scholar

    Fox J, 1994. “On the necessity of probability: Reasons to believe and grounds for doubt” In: Wright G and Ayton P (eds.), Subjective Probability, Wiley.

    Google Scholar

    Gigerenzer G, 1984. “External validity of laboratory experiments: The frequency-validity relationship” American Journal of Psychology97185–195.

    Google Scholar

    Gigerenzer G, 1994. “Why the distinction between single event probabilities and frequencies is important for Psychology and vice-versa” In: Wright G and Ayton P (eds.), Subjective Probability, Wiley.

    Google Scholar

    Gigerenzer G, Hell W and Blank H, 1988. “Presentation and content: The use of base rates as a continuous variable” Journal of Experimental Psychology: Human Perception and Performance14513–525.

    Google Scholar

    Gigerenzer G, Hoffrage U and Kleinbolting H, 1991. “Probabilistic mental models: A Brunswikian theory of confidence” Psychology Review98506–528.

    Google Scholar

    Goodwin P and Wright G, 1990. Decision Analysis for Business, Wiley.

    Google Scholar

    Hacking , 1975. The Emergence of Probability. Cambridge University Press.

    Google Scholar

    Hasher L, Goldstein D and Toppino T, 1977. “Frequency and the conference of referential validity” Journal of Verbal Learning and Verbal Behavior21127–141.

    Google Scholar

    Hasher L and Zacks RT, 1979. “Automatic and effortful processes in memory” Journal of Experimental Psychology: General108356–388.

    Google Scholar

    Hasher L and Zacks RT, 1984. “Automatic processing of fundamental information. The case of frequency of occurrence” American Psychologist391372–1388.

    Google Scholar

    Henrion M, 1990. “Towards Efficient Probabilistic Diagnosis in Multiply Connected Belief Network” In: Olivier RM and Smith JQ (eds.), Influence Diagrams. Belief Nets and Decision Analysis, Wiley.

    Google Scholar

    Jacob VS, Gaulteney LD and Salvendy G, 1986 “ Strategies and biases in human decision making and their implications for expert systems” Behaviour and information Technology5119–140.

    Google Scholar

    Juslin P, 1994. “The overconfidence phenomenon as a consequence of informal experimenter-guided selection of almanac items” Organizational Behavior and Human Decision Processes57226–246.

    Google Scholar

    Kahneman D, Slovic P and Tversky A (eds.), 1982, Judgement under Uncertainty: Heuristics and Biases, Cambridge University Press.

    Google Scholar

    Kahneman D and Tversky A, 1972. “Subjective probability: A judgement of representativeness” Cognitive Psychology3430–454.

    Google Scholar

    Kahneman D and Tversky A, 1973. “On the psychology of prediction” Psychological Review80237–251.

    Google Scholar

    Kahneman D and Tversky A, 1979. “Intuitive prediction: Biases and corrective procedures” Management Science12313–327.

    Google Scholar

    Kahneman D and Tversky A, 1982a. “On the study of statistical intuitions” In: Kahneman D, Slovic P and Tversky A (eds.), Judgement under Uncertainty: Heuristics and Biases, Cambridge University Press.

    Google Scholar

    Kahneman D and Tversky A, 1982b. “Judgements of and by representativeness” In: Kahneman D, Slovic P and Tversky A (eds.), Judgement under Uncertainty: Heuristics and Biases, Cambridge University Press.

    Google Scholar

    Kahneman D and Lovallo D, 1993. “Timid choices and bold forecasts. A cognitive perspective on risk taking” Management Science3917–31.

    Google Scholar

    Kareev Y, 1992. “Not that bad after all: Generation of random sequences” Journal of Experimental Psychology: Human Perception and Performance181189–1194.

    Google Scholar

    Keren GB, 1987. “Facing uncertainty in the game of bridge: A calibration study” Organizational Behavior and Human Decision Processes3998–114.

    Google Scholar

    Keren G, 1991. “Calibration and probability judgments: Conceptual and methodological issues” Acta Psychologica77217–273.

    Google Scholar

    Krause PJ and Clark DA, 1993. Representing Uncertain Knowledge: An Artificial Intelligence Approach, Intellect.

    Google Scholar

    Lenat DL, 1982. “AM: Discovery in mathematics as heuristic search” In: Davis R and Lenat D (eds.), Knowledge Based Systems in Artificial intelligence, McGraw Hill.

    Google Scholar

    Lichtenstein S, Fischhoff B and Phillips LD, 1982. “Calibration of probabilities: The state of the art to 1980” In: Kahneman D, Slovic P and Tversky A (eds.), Judgement under Uncertainty: Heuristics and Biases, Cambridge University Press.

    Google Scholar

    McClelland AGR and Bolger F, 1994. “The calibration of subjective probabilities: Theories and Models 1980–1994” In: Wright G and Ayton P (eds.), Subjective Probability, Wiley.

    Google Scholar

    Meehl PE, 1954. Clinical versus Statistical Prediction: A theoretical analysis and a review of the evidence, University of Minnesota Press.

    Google Scholar

    Meehl PE, 1986. “Causes and effects of my disturbing little book” Journal of Personality Assessment50370–375.

    Google Scholar

    Milburn MA, 1983. “Sources of bias in the prediction of future events” Organizational Behavior and Human Performance2117–26.

    Google Scholar

    Murphy AH and Brown BG, 1985. “A comparative evaluation of objective and subjective weather forecasters in the U.S.” In: Wright G (ed.), Behavioral Decision Making, Plenum.

    Google Scholar

    Murphy AH and Winkler RL, 1984. “Probability forecasting in meteorology” Journal of the American Statistical Association79489–500.

    Google Scholar

    Payne JW, 1982. “Contingent Decision Behavior” Psychological Bulletin92382–402.

    Google Scholar

    Pearl J, 1988. Probbilistic Reasoning in Intelligent Systems: Networks of plausible inference, Morgan Kaufmann.

    Google Scholar

    Phillips LD, 1987. “On the adequacy of judgmental probability forecasts” In: Wright G and Ayton P (eds.), Judgmental Forecasting, Wiley.

    Google Scholar

    Phillips LD and Edwards W, 1966. “Conservatism in simple probability inference tasks” Journal of Experimental Psychology72346–357.

    Google Scholar

    Pitz GF, 1974. “Subjective probability distributions for imperfectly known quantities” In: Gregg LW (ed), Knowledge and Cognition, Erlbaum.

    Google Scholar

    Nisbett R and Ross L, 1980. Human Inference: Strategies and Shortcomings, Prentice Hall.

    Google Scholar

    Peterson CR, Schneider RJ and Miller AJ, 1965. “Sample size and the revision of subjective probability” Journal of Experimental Psychology69522–527.

    Google Scholar

    Pitz GF, Downing L and Rheinold H, 1967. “Sequential effects in the revision of subjective probabilities” Canadian Journal of Psychology21381–393.

    Google Scholar

    Poulton EC, 1989. Bias in Quantifying Judgments, Erlbaum.

    Google Scholar

    Raiffa H, 1968. Decision Analysis, Addison-Wesley.

    Google Scholar

    Rapoport A and Budescu D, 1992. “Generation of random series in two-person strictly competitive games” Journal of Experimental Psychology: General121352–363.

    Google Scholar

    Savage LJ, 1954. The Foundation of Statistics, Wiley.

    Google Scholar

    Schwartz S and Griffin T, 1986. Medical Thinking: The Psychology of Medical Judgment and Decision Making, Springer-Verlag.

    Google Scholar

    Shortliffe EH and Buchanan BG, 1976. “A model of inexact reasoning in medicine” Mathematical Biosciences23351–379.

    Google Scholar

    Simon H, 1957. Models of Man: Social and Rational, Wiley.

    Google Scholar

    Slatter PE, 1987. “Cognitive emulation in expert system design” Knowledge Engineering Review227–42.

    Google Scholar

    Tiegen KH, 1994. “Variants of subjective probabilities: Concepts, norms and biases” In: Wright G and Ayton P (eds.), Subjective Probability, Wiley.

    Google Scholar

    Tvcrsky A and Kahneman D, 1971. “Belief in the law of small numbers” Psychological Bulletin76105–110.

    Google Scholar

    Tversky A and Kahneman D, 1983. “Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment” Psychological Review90293–315.

    Google Scholar

    van der Heijden C, 1994. “Probabilistic planning and scenario planning” In: Wright G and Ayton P (eds.), Subjective Probability, Wiley.

    Google Scholar

    von Wintcrfeldt D and W Edwards, 1986. Decision Analysis and Behavioral Research, Cambridge University Press.

    Google Scholar

    Wagenaar WA and Keren GB, 1986. “Does the expert know? The reliability of predictions and confidence ratings of experts” In: Hollnagel E, Mancini G and Woods DD (eds.), Intelligent Decision Support In Process Environments, Springer-Verlag.

    Google Scholar

    Winefield AH, 1966. “Negative recency and event dependence” Quarterly Journal of Experimental Psychology1847–54.

    Google Scholar

    Winkler RL and Murphy AM, 1973. “Experiments in the laboratory and the real world” Organizational Behavior and Human Performance20252–270.

    Google Scholar

    Wright G and Ayton P, 1992. “ Judgmental probability forecasting in the immediate and medium term” Organizational Behavior and Human Decision Processes51344–363.

    Google Scholar

    Yates JF, 1982. “External correspondence: decompositions of the mean probability score” Organizational Behavior and Human Performance30132–156.

    Google Scholar

    Yates JF, McDaniel LS and Brown ES, 1991. “Probabilistic forecasts of stock prices and earnings: The hazards of nascent expertise” Organizational Behavior and Human Decision Processes4060–79.

    Google Scholar

    Yousseff ZI and Peterson CR, 1973. Intuitive cascaded inferences” Organizational Behavior and Human Performance10349–358.

    Google Scholar

  • Cite this article

    Peter Ayton, Eva Pascoe. 1995. Bias in human judgement under uncertainty?. The Knowledge Engineering Review. 10:7244 doi: 10.1017/S0269888900007244
    Peter Ayton, Eva Pascoe. 1995. Bias in human judgement under uncertainty?. The Knowledge Engineering Review. 10:7244 doi: 10.1017/S0269888900007244

Article Metrics

Article views(16) PDF downloads(331)

Other Articles By Authors

RESEARCH ARTICLE   Open Access    

Bias in human judgement under uncertainty?

The Knowledge Engineering Review  10 Article number: 10.1017/S0269888900007244  (1995)  |  Cite this article

Abstract: Abstract: The claim is frequently made that human judgement and reasoning are vulnerable to cognitive biases. Such biases are assumed to be inherent in that they are attributed to the nature of the mental processes that produce judgement. In this paper, we review the psychological evidence for this claim in the context of the debate concerning human judgemental competence under uncertainty. We consider recent counter-arguments which suggest that the evidence for cognitive biases may be dependent on observations of performance on inappropriate tasks and by comparisons with inappropriate normative standards. We also consider the practical implications for the design of decision support systems.

    • Copyright © Cambridge University Press 19951995Cambridge University Press
References (89)
  • About this article
    Cite this article
    Peter Ayton, Eva Pascoe. 1995. Bias in human judgement under uncertainty?. The Knowledge Engineering Review. 10:7244 doi: 10.1017/S0269888900007244
    Peter Ayton, Eva Pascoe. 1995. Bias in human judgement under uncertainty?. The Knowledge Engineering Review. 10:7244 doi: 10.1017/S0269888900007244
  • Catalog

      /

      DownLoad:  Full-Size Img  PowerPoint
      Return
      Return