Search
1995 Volume 10
Article Contents
RESEARCH ARTICLE   Open Access    

A review of human linguistic probability processing: General principles and empirical evidence

More Information
  • Abstract: This article reviews research on how people use and understand linguistic expressions of uncertainty, with a view toward the needs of researchers and others interested in artificial intelligence systems. We discuss and present empirical results within an inductively developed theoretical framework consisting of two background assumptions and six principles describing the underlying cognitive processes.
  • 加载中
  • Anderson NH, 1991. Information Integration Theory, Erlbaum.

    Google Scholar

    Bass BM, Cascio WF and O'Connor EJ.1974. “Magnitude estimation of expressions of frequency and amount” Journal of Applied Psychology59313–320.

    Google Scholar

    Behn RD and Vaupel JW, 1982. Quick Analysis for Busy Decision Makers, Basic.

    Google Scholar

    Beyth-Marom R, 1982. “How probable is probable? A numerical translation of verbal probability expressions” Journal of Forecasting1257–269.

    Google Scholar

    Bonissone PP and Decker KS, 1987. “Selecting uncertainty calculi and granularity: An experiment in trading off precision and complexity” In: Kanal LN and Lemmer JF (eds.), Uncertainty and Artificial Intelligence, Elsevier.

    Google Scholar

    Bortolan G and Degani R, 1985. “A review of some methods for ranking fuzzy subsets” Fuzzy Sets and Systems151–19.

    Google Scholar

    Brackner JW, 1985. “How to report contingent losses in financial statements?” Journal of Business Forecasting413–18.

    Google Scholar

    Bradburn NM and Miles C, 1979. “Vague quantifiers” Public Opinion Quarterly4392–101.

    Google Scholar

    Brun W and Teigen KH, 1988. “Verbal probabilities: Ambiguous, context-dependent, or both?” Organizational Behavior and Human Decision Processes41390–404.

    Google Scholar

    Bryant and Norman , 1980. “Expressions of probability: Words and Numbers” New England Journal of Medicine302411.

    Google Scholar

    Budescu DV and Wallsten TS, 1985. “Consistency in interpretation of probabilistic phrases” Organizational Behavior and Human Decision Processes36391–405.

    Google Scholar

    Budescu DV and Wallsten TS1987. “Subjective estimation of precise and vague uncertainties In: Wright G and Ayton P. (eds.), Judgmental Forecasting, pp 63–81, Wiley.

    Google Scholar

    Budescu DV and Wallsten TS, 1990. “Dyadic decisions with verbal and numerical probabilities” Organizational Behavior and Human Decision Processes46240–263.

    Google Scholar

    Budescu DV and Wallsten TS (in press). “Processing linguistic probabilities: general principles and empirical evidence” In: Busemeyer JR, Hastie R and Medin DL (eds.), Decision Making from the Perspective of Cognitive Psychology, Academic Press.

    Google Scholar

    Budescu DV, Weinberg S and Wallsten TS, 1988. “Decisions based on numerically and verbally expressed uncertainties” Journal of Experimental Psychology: Human Perception and Performance14281–294.

    Google Scholar

    Budescu DV, Zwick R, Wallsten TS and Erev I, 1990. “Integration of linguistic probabilities” International Journal of Man–Machine Studies33657–676.

    Google Scholar

    Camerer C and Weber M, 1992. “Recent developments in modeling preferences: Uncertainty and ambiguity” Journal of Risk and Uncertainty5325–370.

    Google Scholar

    Chesley GR, 1985. “Interpretation of uncertainty expressions” Contemporary Accounting Research2179–199.

    Google Scholar

    Clark DA, 1990. “Verbal uncertainty expressions: A review of two decades of research” Current Psychology: Research and Reviews9203–235.

    Google Scholar

    Clarke VA, Ruffin CL, Hill DJ and Beamen AL, 1992. “Ratings of orally presented verbal expressions of probability by a heterogeneous sample” Journal of Applied Social Psychology22638–656.

    Google Scholar

    Cliff N, 1959. “Adverbs as multipliers” Psychological Review6627–44.

    Google Scholar

    Cohen BL and Wallsten TS, 1992. “The effect of constant outcome value on judgments and decision making given linguistic probabilities” Journal of Behavioral Decision Making553–72.

    Google Scholar

    Curley SP and Yates JF, 1985. “The center and range of the probability interval as factors affecting ambiguity preferences” Organizational Behavior and Human Decision Processes36273–287.

    Google Scholar

    Degani R and Bortolan G, 1988. “The problem of linguistic approximation in clinical decision making” International Journal of Approximate Reasoning2143–162.

    Google Scholar

    DeGroot MH, 1970. Optimal Statistical Decisions, McGraw-Hill.

    Google Scholar

    Einhorn HJ and Hogarth RM, 1985. “Ambiguity and uncertainty in probabilistic inference” Psychological Review92433–461.

    Google Scholar

    Ellsberg D, 1961. “Risk, ambiguity, and the Savage axioms” Quarterly Journal of Economics75643–669.

    Google Scholar

    Erev I and Cohen BL, 1990. “Verbal versus numerical probabilities: Efficiency, biases, and the preference paradox” Organizational Behavior and Human Decision Processes451–18.

    Google Scholar

    Erev I, Wallsten TS and Budescu DV, 1994. “Simultaneous over- and underconfidence: The role of error in judgment processes” Psychological Review101519–527.

    Google Scholar

    Erev I, Wallsten TS and Neal M, 1991. “Vagueness, ambiguity, and the cost of mutual understanding” Psychological Science2321–324.

    Google Scholar

    Farkas A and Makai-Csasar M, 1988. “Communication or dialogue of deafs: Pitfalls of use of fuzzy quantifiers” In: Second Network Seminar of the International Union of Psychological Science, North- Holland.

    Google Scholar

    Fillenbaum S, Wallsten TS, Cohen B and Cox JA, 1991. “Some effects of vocabulary and communication task on the understanding and use of vague probability expressions” American Journal of Psychology10435–60.

    Google Scholar

    Gärdenfors P and Sahlin NE, 1982. “Unreliable probabilities, risk taking, and decision making” Synthese53361–386.

    Google Scholar

    González-Vallejo CC, Erev I and Wallsten TS, 1994. “Do decision quality and preference order depend on whether probabilities are verbal or numerical?” American Journal of Psychology107157–172.

    Google Scholar

    González-Vallejo CC and Wallsten TS, 1992. “Effects of probability mode on preference reversal” Journal of Experimental Psychology: Learning, Memory, ' Cognition18855–864.

    Google Scholar

    Grether DM and Plott CR, 1979. “Economic theory of choice and the preference reversal phenomenon” American Economic Review69623–638.

    Google Scholar

    Hamm RM, 1991. “Selection of verbal probabilities: A solution for some problems of verbal probability expression” Organizational Behavior and Human Decision Processes48193–223.

    Google Scholar

    Hammerton M, 1976. “How much is a large part?” Applied Ergonomics710–12.

    Google Scholar

    Holyoak KJ, 1978. “Comparative judgments with numerical reference points” Cognitive Psychology10203–243.

    Google Scholar

    Holyoak KJ and Glass AL, 1978. “Recognition confusions among quantifiers” Journal of Verbal Learning and Verbal Behavior17249–264.

    Google Scholar

    Jaffe-Katz A, Budescu DV and Wallsten TS, 1989. “Timed magnitude comparisons of numerical and nonnumerical expressions of uncertainty” Memory and Cognition17249–264.

    Google Scholar

    Johnson EM, 1973. “Numerical encoding of qualitative expressions of uncertainty” (Tech. paper No. 250), U.S. Army Research Institute for the Behavioral and Social Sciences.

    Google Scholar

    Johnson EM and Huber GP, 1977. “The technology of utility assessmentIEEE Translations oil Systems, Man and Cybernetics7311–325.

    Google Scholar

    Kadane JB, 1990. “Comment: Codifying chance” Statistical Science518–20.

    Google Scholar

    Keynes JM, 1921. A Treatise on Probability, Macmillan.

    Google Scholar

    Knight FH, 1921. Risk, Uncertainty, and Profit, University of Chicago Press.

    Google Scholar

    Kong A, Barnett GO, Mosteller F and Youtz C, 1986. “How medical professionals evaluate expressions of probability” The New England Journal of Medicine315740–744.

    Google Scholar

    Lichtenstein S, Fischhoff B and Phillips LD, 1982. “Calibration of probabilities: The state of the art to 1980” In: Kahneman D, Slovic P and Tversky A (eds.), Judgment under Uncertainty: Heuristics and Biases, pp 306–334, Cambridge University Press.

    Google Scholar

    Lichtenstein S and Newman JR, 1967. “Empirical scaling of common verbal phrases associated with numerical probabilities” Psychonomic Science9563–564.

    Google Scholar

    López de Mántaras R, Meseguer P, Sanz F, Sierra C and Verdaguer A, 1988. “A fuzzy logic approach to the management of linguistically expressed uncertainty” IEEE Transactions on Systems, Man and cybernetics144–151.

    Google Scholar

    Krause P and Clark D, 1993. Representing Uncertain Knowledge: An artificial intelligence approach, Intellect.

    Google Scholar

    Mapes , 1979. “Verbal and numerical estimates of probability terms” Journal of General Internal Medicine6237.

    Google Scholar

    Marshall E, 1986. “Feynman issues his own shuttle report, attacking NASA's risk estimates” Science2321596.

    Google Scholar

    Marshall E, 1988. “Academy panel faults NASA's safety analysis” Science2391233.

    Google Scholar

    Merz JF, Druzdzel MJ and Mazur DJ, 1991. “Verbal expressions of probability in informed consent litigation” Journal of Medical Decision Making11273–281.

    Google Scholar

    Moore PG, 1977. “The manager's struggle with uncertainty” Journal of the Royal Statistical Society140129–165.

    Google Scholar

    Moore PG and Thomas H, 1975. “Measuring uncertainty” The International Journal of Managememu Science3657.

    Google Scholar

    Mosier CI, 1941. “A psychometric study of meaning” Journal of Social Psychology3931–36.

    Google Scholar

    Mosteller F and Youtz C, 1990. “Quantifying probabilistic expressions” Statistical Science52–16.

    Google Scholar

    Moxey LM and Sanford AJ, 1993. Communicating Quantities: A Psychological Perspective, Lawrence Erlbaum.

    Google Scholar

    Mullet E, and Rivet I, 1991. “Comprehension of verbal probability expressions in children and adolescents” Language and Communication11217–225.

    Google Scholar

    Murphy AH and Brown BG, 1983. “Forecast terminology: Composition and interpretation of public weather forecasts” Bulletin of tile American Meteorological Society6413–22.

    Google Scholar

    Murphy AH, Lichtenstein S, Fischhoff B and Winkler RL, 1980. “Misinterpretations of precipitation probability forecasts” Bulletin of the American Meteorological Society61695–701.

    Google Scholar

    Nakao and Axelrod , 1983. “Numbers are better than words: Verbal specifications of frequency have no place in medicine” American Journal of Medicine741061.

    Google Scholar

    National Weather Service, 1984. Weather Service Operations Manual. National Oceanic and Atmospheric Administration.

    Google Scholar

    Newstead SE, 1988. “Quantifiers as fuzzy concepts” In: Zetenyl T (eds.), Fuzzy Sets in Psychology, pp 51–72, Elsevier Science.

    Google Scholar

    Norwich AM and Turksen IB, 1984. “A model for the measurement of membership and the consequences of its empirical implementation” Fuzzy Sets and Systems121–25.

    Google Scholar

    Parciucci A, 1968. “How often is often” American Psychologist23828.

    Google Scholar

    Pepper S, 1981. “Problems in the quantification of frequency expression” In: Fiske DW (ed.), New Directions for Methodology of Social and Behavioral ScienceJossey- Bass.

    Google Scholar

    Pepper S and Prytulak LS, 1974. “Sometimes frequently means seldom: Context effects in the interpretation of quantitative expressionsJournal of Research in Personality895–101.

    Google Scholar

    Rapoport A, Wallsten TS and Cox JA, 1987. “Direct and indirect scaling of membership functions of probability phrases” Mathematical Modelling9397–417.

    Google Scholar

    Rapoport A, Wallsten TS, Erev I and Cohen BL, 1990. “Revision of opinion with verbally and numerically expressed uncertainties” Acta Psychologica7461–79.

    Google Scholar

    Reagan RT, Mosteller F and Youtz C, 1989. “Quantitative meanings of verbal probability expressions” Journal of Applied Psychology74433–442.

    Google Scholar

    Reyna VF, 1981. “The language of possibility and probability: Effects of negation on meaning” Memory ' Cognition9642–650.

    Google Scholar

    Rubin DC, 1979. “On measuring fuzziness: A comment on 'a fuzzy set approach to modifiers and vagueness in natural language” Journal of Experimeiital Psychology: General108486–489.

    Google Scholar

    Schkade DA and Kleinmuntz DN, 1994. “Information displays and choice processes: Differential effects of organization, form, and sequence” Organizational Behavior and Human Decision Processes57319–337.

    Google Scholar

    Shapiro AJ and Wallsten TS, 1994. “Base rate effects on interpreting verbally and numerically communicated probabilities” Working paper.

    Google Scholar

    Simpson RH, 1944. “The specific meanings of certain terms indicating differing degrees of frequencyQuarterly Journal of Speech30328–330.

    Google Scholar

    Stone DN and Schkade DA, 1991. “Numeric and linguistic information representation in multiattribute choice” Organizational Behavior and Human Decision Processes4942–59.

    Google Scholar

    Sutherland HJ, Lockwood GA, Tritchler DL and Scm F, 1991. “Communicating probabilistic information to cancer patients: Is there ‘noise’ on the line?” Social Science and Medicine32725–731.

    Google Scholar

    Svenson O and Karlson G, 1986. “Attractiveness of decision alternatives characterized by numerical and non-numerical informationScandinavian Journal of Psychology2774–84.

    Google Scholar

    Teigen KH, 1988a. “When are low-probability events judged to be ‘probable’? Effects of outcome-set characteristics on verbal probability estimates” A cta Psychologica67157–174.

    Google Scholar

    Teigen KH, 1988b. “The language of uncertainty” Ada Psychologica6827–38.

    Google Scholar

    Teigen KH and Brun W, 1993. “Yes, but it is uncertain: Direction and communicative intention of verbal probabilistic terms” SPUDM-14, Aix-en Provence, France.

    Google Scholar

    Tsao CJ and Wallsten TS, 1994. “Effects of the number of outcomes on the interpretation and selection of verbal and numerical probabilities in dyadic decisions”. Working paper.

    Google Scholar

    Tversky A, Sattath S and Slovic P, 1988. “Contingent weighting in judgment and choice” Psychological Review95371–384.

    Google Scholar

    Vesely WE and Rasmuson DM, 1984. “Uncertainties in nuclear probabilistic risk analysis” Risk Analysis4313–322.

    Google Scholar

    von Winterfeldt D and Edwards W, 1986. Decision Analysis and Behavioral Research, Cambridge University Press.

    Google Scholar

    Wallsten TS, 1971. “Subjectively expected utility theory and subjects' probability estimates: Use of measurement-free techniques” Journal of Experimental Psychology8831–40.

    Google Scholar

    Wallsten TS, 1990. “Measuring vague uncertainties and understanding their use in decision making” In: Furstenberg GM von (ed.), Acting under Uncertainty pp 377–398, Kluwer.

    Google Scholar

    Wallsten TS, Budescu DV and Erev I, 1988. “Understanding and using linguistic uncertainties” Acta Psychologica6839–52.

    Google Scholar

    Wallsten TS, Budescu DV, Rapoport A, Zwick R and Forsyth BH, 1986. “Measuring the vague meanings of probability terms” Journal of Experimental Psychology: General115348–365.

    Google Scholar

    Wallsten TS, Budescu DV and Tsao CJ, 1994. “Combining linguistic probabilities” Symposiumn on Qualitative Aspects of Decision Making, Regensburg, Germany, 07 20 1994.

    Google Scholar

    Wallsten TS, Budescu DV and Zwick R, 1993. “Comparing the calibration and coherence numerical and verbal probability judgments” Management Science39176–190.

    Google Scholar

    Wallsten TS, Budescu DV, Zwick R and Kemp SM, 1993. “Preference and reasons for communicating probabilistic information in numerical or verbal terms” Bulletin of the Psychonomnic Society31135–138.

    Google Scholar

    Wallsten TS, Filenbaum S and Cox JA, 1986. “Base rate effects on the interpretations of probability and frequency expressions” Journal of Memory and Language25571–587.

    Google Scholar

    Weber EU, 1988. “A descriptive measure of risk” Acta Psychologica69185–203.

    Google Scholar

    Weber EU and Bottom WP, 1989. “Axiomatic measures of perceived risk: Some tests and extensions” Journal of Behavioral Decision Making2113–131.

    Google Scholar

    Webber EU and Hilton DJ, 1990 “Contextual effects in the interpretations of probability words: Perceived base rate and severity of events” Journal of Experimental Psychology: Human Perception and Performance16781–789.

    Google Scholar

    Wright GN, Phillips LD, Whalley PC, Choo GT, Ng KO, Tan I and Wisudha A, 1978. “Cultural differences in probabilistic thinking” Journal of Cross-Cultural Psychology9285–299.

    Google Scholar

    Wyden P, 1979. Bay of Pigs, Simon & Schuster.

    Google Scholar

    Yager RR, 1981. “A procedure for ordering fuzzy sets on the unit interval” Information Sciences24143–161.

    Google Scholar

    Yates JF, Zhu Y, Ronis DL, Wang DF, Shinotsuka H and Toda M, 1989. “Probability judgment accuracy: China, Japan, and the United States” Organizational Behavior and Human Decision Processes43145–171.

    Google Scholar

    Zimmer AC, 1983. “Verbal vs. numerical processing of subjective probabilities” In: RW Scholz (ed.), Decision Making Under Uncertainty, Elsevier.

    Google Scholar

    Zwick R, 1987. “Combining stochastic uncertainty and linguistic inexactness: Theory kind experimental evaluation”. Doctoral dissertation, University of North Carolina at Chapel Hill.

    Google Scholar

    Zwick R, Budescu DV and Wallsten TS, 1988. “An empirical study of the integration of linguistic probabilities” In: Zetenyi T (ed.), Fuzzy Set Theory in Psychology, pp 91–125, North Holland.

    Google Scholar

    Zwick R, Carlstein E and Budescu DV, 1987. “Measures of similarity among fuzzy concepts: A comparative analysis” International Journal of Approximate Reasoning1221–242.

    Google Scholar

    Zwick R and Wallsten TS, 1989. “Combining stochastic and linguistic inexactness: Theory and experimental evaluation of four fuzzy probability models” International Journal of Man–Machine Studies3069–111.

    Google Scholar

  • Cite this article

    Thomas S. Wallsten, David V. Budescu. 1995. A review of human linguistic probability processing: General principles and empirical evidence. The Knowledge Engineering Review. 10:7256 doi: 10.1017/S0269888900007256
    Thomas S. Wallsten, David V. Budescu. 1995. A review of human linguistic probability processing: General principles and empirical evidence. The Knowledge Engineering Review. 10:7256 doi: 10.1017/S0269888900007256

Article Metrics

Article views(14) PDF downloads(217)

Other Articles By Authors

RESEARCH ARTICLE   Open Access    

A review of human linguistic probability processing: General principles and empirical evidence

The Knowledge Engineering Review  10 Article number: 10.1017/S0269888900007256  (1995)  |  Cite this article

Abstract: Abstract: This article reviews research on how people use and understand linguistic expressions of uncertainty, with a view toward the needs of researchers and others interested in artificial intelligence systems. We discuss and present empirical results within an inductively developed theoretical framework consisting of two background assumptions and six principles describing the underlying cognitive processes.

    • Copyright © Cambridge University Press 19951995Cambridge University Press
References (108)
  • About this article
    Cite this article
    Thomas S. Wallsten, David V. Budescu. 1995. A review of human linguistic probability processing: General principles and empirical evidence. The Knowledge Engineering Review. 10:7256 doi: 10.1017/S0269888900007256
    Thomas S. Wallsten, David V. Budescu. 1995. A review of human linguistic probability processing: General principles and empirical evidence. The Knowledge Engineering Review. 10:7256 doi: 10.1017/S0269888900007256
  • Catalog

      /

      DownLoad:  Full-Size Img  PowerPoint
      Return
      Return