Search
1992 Volume 7
Article Contents
RESEARCH ARTICLE   Open Access    

A unifying framework for concept-learning algorithms

More Information
  • Abstract: A unifying framework for concept-learning, derived from Mitchell's Generalization as Search-paradigm, is presented. Central to the framework is the generic algorithm Gencol. Gencol forms a synthesis of existing concept-learning algorithms as it identifies the key issues in concept-learning: the representation of concepts and examples, the search strategy and heuristics, and the operators that transform one concept-description into another one when searching the concept description space. Gencol is relevant for practical purposes as it offers a solid basis for the design and implementation of concept-learning algorithms. The presented framework is quite general as seemingly disparate algorithms such as TDIDT, AQ, MIS and version spaces fit into Gencol.
  • 加载中
  • Adé H, De Raedt L and Bruynooghe M, 1992. “Inverse resolution in an integrated inductive-deductive learning System” In: Proceedings of the lOth European Conference on Artifidal Intelligence,Wiley.

    Google Scholar

    Angluin D and Smith CS, 1983. “Inductive inference: theory and methods”, ACM Computing Surveys15237–269.

    Google Scholar

    Biermann A, 1986, “Fundamental mechanisms in machine learning and inductive inference” In: Bibel W and Jorrand P, editors, Fundamentals of Artifidal IntelligenceSpringer-Verlag.

    Google Scholar

    Bratko I, Mozetic I and Lavrač N, 1989. Kardio: a study in deep and qualitative knowledge for expert Systems, MIT Press.

    Google Scholar

    Buchanan BG and Mitchell TM, 1978. “Model-directed learning of production rules” In: Waterman DA and Hayes-Roth F, editors, Pattern-directed inference SystemsAcademic Press.

    Google Scholar

    Bundy A, Silver B and Plummer D, 1985. “An analytical comparison of some rule-learning programs” Artifidal Intelligence27137–181.

    Google Scholar

    Buntine W, 1988, “Generalized subsumption and its application to induction and redundancy” Artificial Intelligence36375–399.

    Google Scholar

    Causse K, Morik K, Sims P and Rouveirol C, 1990. “A comparative study of the representation languages used in the Machine Learning Toolbox” In: ESPRIT 90, Kluer.

    Google Scholar

    Cestnik B, Kononenko I and Bratko I, 1987. “Assistant 86: a knowledge-elicitation tool for sophisticated users” In Proceedings of the 2nd European Working Session on Learning, pp 31–45, Sigma Press.

    Google Scholar

    Cohen PR and Feigenbaum EA, editors, 1981. The handbook of Artificial intelligence vol. 3, Morgan Kaufmann.

    Google Scholar

    Declercq E, 1990. Een uitwerking van het generisch algoritme Gencol dat concepten leert, Master's thesis, Department of Computer Science, Katholieke Universiteit Leuven (in Dutch).

    Google Scholar

    De Raedt L, 1991. Interactive Concept-Learning PhD thesis, Department of Computer Science, Katholieke Universiteit Leuven.

    Google Scholar

    De Raedt L, 1992. Interactive Theory Revision: an inductive logic programming approach, Academic Press.

    Google Scholar

    De Raedt L and Bruynooghe M, 1992. “Interactive concept-learning and constructive induction by analogy” Machine Learning8107–150.

    Google Scholar

    De Raedt L, Krekels B, Bruynooghe M and Van Meir D, 1987. “Using Shapiro's model inference System for concept-learning”. In: Proceedings of the 4th international conference on Artificial Intelligence and Control Systems of Robots, pp 191–196, North Holland.

    Google Scholar

    Dietterich TG and Michalski RS, 1983. “A comparative review of selected methods for learning from examples”. In: Michalski RS, Carbonell JG and Mitchell TM, editors, Machine Learning: an Artificial intelligence approach, vol. 1, Tioga Publishing Co.

    Google Scholar

    Gams M and Lavrač N, 1987. “Review of five empirical learning Systems within a proposed schemata”. In Proceedings of the 2nd European Working Session on Learning pp 46–66, Sigma Press.

    Google Scholar

    Genesereth M and Nilsson N, Logical foundations of artificial intelligence, Morgan Kaufmann.

    Google Scholar

    Gold EM, 1987. “Language identification in the limit”, Information and control10447–474.

    Google Scholar

    Hayes-Roth F and McDermott J, 1978. An interference matching technique for inducing abstractions”, Communications of the ACM21401–410.

    Google Scholar

    Kalkanis G and Conroy GV, 1991. “Principles of induction and approaches to attribute based induction”, Knowledge Engineering Review 6.

    Google Scholar

    Kocabas S, 1991, “A review of learning” Knowledge Engineering Review 6.

    Google Scholar

    Kodratoff Y and Michalski RS, editors, 1990. Machine Learning: an artificial intelligence approach, Vol. 3, Morgan Kaufmann.

    Google Scholar

    Kodratoff Y, 1988. Introduction to Machine LearningPitman.

    Google Scholar

    Laird PD, 1988. “Inductive inference by refinement”. In: Proceedings of the 5th American Conference on Artificial Intelligence pp 472–476, Morgan.

    Google Scholar

    Langley P, 1987. “The terminology of machine learning” Machine Learning1141–144.

    Google Scholar

    Langley P and Carbonell JG, 1987. “Machine learning”. In: Shapiro S, editer, Encyclopedia of artificial intelligence, Wiley.

    Google Scholar

    Langley P, Gennari JH, and Iba W, 1987. “Hill-climbing theories of learning”. In: Proceedings of the 4th International Workshop on Machine Learning pp 312–323, Morgan Kaufmann.

    Google Scholar

    Lavrač N, Džeroski S and Grobelnik M, 1991, “Learning non-recursive definitions of relations with LINUS”. In: Kodratoff Y, editor, Proceedings of the 5th European Working Session on Learning, vol. 482 of Lecture Notes in Artificial IntelligenceSpringer-Verlag.

    Google Scholar

    Matheus CJ, 1989. “A constructive induction framework”. In: Proceedings of the 6th International Workshop on Machine Learning, pp 474–475, Morgan Kaufmann.

    Google Scholar

    Mehra P, Rendell LA and Wah BW, 1989. “Principled constructive induction”. In: Proceedings of the 11th International Joint Conference on Artificial Intelligence pp 651–657, Morgan Kaufmann.

    Google Scholar

    Michalski RS and Chilauski RL, 1980. “Learning by being told and learning from examples: an experimental comparison of the two methods of knowledge acquisition in the context of developing an expert System for soybean disease diagnosis”, Policy analysis and information Systems 4.

    Google Scholar

    Michalski RS, Carbonell JG and Mitchell TM, 1983. Machine Learning: an artificial intelligence approach, Vol. 1, Morgan Kaufmann.

    Google Scholar

    Michalski RS, Carbonell JG and Mitchell TM, 1986. Machine Learning: an artificial intelligence approach, Vol. 2, Morgan Kaufmann.

    Google Scholar

    Michalski RS, Davis JH, Bisht VS and Sinclair JB, 1985. “Plant/ds: an expert consulting System for the diagnosis of soy-bean diseases”. In: Steels L and Campbell JA, editors, Progress in Artificial IntelligenceEllis Horwood.

    Google Scholar

    Michalski RS, 1975. “Variable-valued logic and its applications to pattern recognition and machine learning”. In: Rine D, editor, Multiple-Valued Logic and Computer ScienceNorth-Holland.

    Google Scholar

    Michalski RS, 1983. “A theory and methodology of inductive learning”. In: Michalski RS, Carbonell JG and Mitchell TM, editors, Machine Learning: an artificial intelligence approach, vol 1, Morgan Kaufmann.

    Google Scholar

    Michalski RS, 1987. “Clustering”. In: Shapiro S, editor, Encyclopedia of artificial intelligenceWiley.

    Google Scholar

    Morik K, 1989. “Sloppy modeling”. In: Morik S, editor, Knowledge Representation and Organization in Machine Learning vol. 347 of Lecture Notes in Artificial IntelligenceSpringer-Verlag.

    Google Scholar

    Michalski RS and Stepp RE, 1983. “Learning from observation: conceptual clustering”. In: Michalski RS, Carbonell JG and Mitchell TM, editors, Machine Learning: an artificial intelligence approach, vol 1, Tioga Publishing Co.

    Google Scholar

    Mitchell TM, 1977. “Version spaces: a candidate elimination approach to rule learning”. In: Proceedings of the 5th International Joint Conference on Artificial IntelligenceMorgan Kaufmann.

    Google Scholar

    Mitchell TM, 1982. “Generalization as search”, Artificial Intelligence18203–226.

    Google Scholar

    Mitchell TM, Utgoff PE and Banerji R, 1983. “Learning by experimentation: acquiring and refining problem-solving heuristics”. In: Michalski RS, Carbonnel JG and Mitchell TM, editors, Machine Learning: an artificial intelligence approach pp 163–190, Tioga Publishing Co.

    Google Scholar

    Muggleton S and Buntine W, 1988. “Machine invention of first order predicates by inverting resolution”. In: Proceedings of the 5th International Conference on Machine Learning pp 339–351, Morgan Kaufmann.

    Google Scholar

    Nilsson NJ, 1980. Principles of Artificial IntelligenceTioga Publishing Co.

    Google Scholar

    Quinlan JR, 1986. “Induction of decision trees” Machine Learning181–106.

    Google Scholar

    Quinlan JR, 1987. “Generating production rules from decision trees”. In: Proceedings of the 10th International Joint Conference on Artificial Intelligence pp 304–307, Morgan Kaufmann.

    Google Scholar

    Quinlan JR, 1990, “Learning logical definition from relations” Machine Learning5239–266.

    Google Scholar

    Rendell L, 1986. “A general framework for induction and a study of selective induction” Machine Learning1177–226.

    Google Scholar

    Sablon G, Ade H, De Raedt L and Bruynooghe M, 1992. “Some thoughts on inverse resolution”. In: Muggleton S, editor, Inductive Logic ProgrammingAcademic Press.

    Google Scholar

    Sammut C and Banerji R, 1986. “Learning concepts by asking questions”, In: Michalski RS, Carbonell JG and Mitchell TM, editors, Machine Learning: an artificial intelligence approach vol. 2, pp 167–192, Morgan Kaufmann.

    Google Scholar

    Shapiro EY, 1981. “An algorithm that infers theories from facts”. In: Proceedings of the 7th International Joint Conference on Artificial Intelligence, pp 446–452, Morgan Kaufmann.

    Google Scholar

    Shapiro EY, 1983. Algorithmic Program DebuggingMIT Press.

    Google Scholar

    Subramanian D and Feigenbaum J, 1988. “Factorization in experiment generation”. In: Proceedings of the 5th American Conference On Artificial Intelligence, pp 518–522, Morgan Kaufmann.

    Google Scholar

    Tcheng D, Lamber B, SC Lu and Rendell L, 1989. “Building robust learning Systems by combining induction and optimization”, In: Proceedings of the 11th International Joint Conference on Artificial Intelligence pp 806–812, Morgan Kaufmann.

    Google Scholar

    Valiant L, 1984. “A theory of the learnable” Communications of the ACM271134–1142.

    Google Scholar

    Vere SA, 1975. “Induction of concepts in the predicate calculus”, In Proceedings of the 4th International Joint Conference on Artificial Intelligence pp 282–287, Morgan Kaufmann.

    Google Scholar

    Wrobel S, 1988. “Automatic representation adjustment in an observational discovery System”. In: Sleeman D, editor, Proceedings of the 3rd European Working Session on LearningPitman.

    Google Scholar

    Wrobel S, 1989. “Demand driven concept-formation”. In: Morik K, editor, Knowledge Representation and Organization in Machine Learning, vol. 347 of Lecture Notes in Artificial Intelligence, Springer-Verlag.

    Google Scholar

  • Cite this article

    Luc de Raedt, Maurice Bruynooghe. 1992. A unifying framework for concept-learning algorithms. The Knowledge Engineering Review. 7:6366 doi: 10.1017/S0269888900006366
    Luc de Raedt, Maurice Bruynooghe. 1992. A unifying framework for concept-learning algorithms. The Knowledge Engineering Review. 7:6366 doi: 10.1017/S0269888900006366

Article Metrics

Article views(16) PDF downloads(236)

Other Articles By Authors

RESEARCH ARTICLE   Open Access    

A unifying framework for concept-learning algorithms

The Knowledge Engineering Review  7 Article number: 10.1017/S0269888900006366  (1992)  |  Cite this article

Abstract: Abstract: A unifying framework for concept-learning, derived from Mitchell's Generalization as Search-paradigm, is presented. Central to the framework is the generic algorithm Gencol. Gencol forms a synthesis of existing concept-learning algorithms as it identifies the key issues in concept-learning: the representation of concepts and examples, the search strategy and heuristics, and the operators that transform one concept-description into another one when searching the concept description space. Gencol is relevant for practical purposes as it offers a solid basis for the design and implementation of concept-learning algorithms. The presented framework is quite general as seemingly disparate algorithms such as TDIDT, AQ, MIS and version spaces fit into Gencol.

    • Copyright © Cambridge University Press 19921992Cambridge University Press
References (59)
  • About this article
    Cite this article
    Luc de Raedt, Maurice Bruynooghe. 1992. A unifying framework for concept-learning algorithms. The Knowledge Engineering Review. 7:6366 doi: 10.1017/S0269888900006366
    Luc de Raedt, Maurice Bruynooghe. 1992. A unifying framework for concept-learning algorithms. The Knowledge Engineering Review. 7:6366 doi: 10.1017/S0269888900006366
  • Catalog

      /

      DownLoad:  Full-Size Img  PowerPoint
      Return
      Return