Validation of knowledge-based systems: Current trends and issues

Assuring the reliability of knowledge-based systems has become an important issue in the development of the knowledge engineering discipline. There has been a workshop devoted to these topics at most of the major AI conferences (IJCAI, AAAI and ECAI) for the last five years, and the 1994 European Conference on Artificial Intelligence (ECAI-94) in Amsterdam was no exception. The focus of the meeting was on validation techniques for KBS, where validation is defined as the process of determining if a KBS meets its users' requirements; implicitly, validation includes verification, which is the process of determining if a KBS has been constructed to comply with certain formally-specified properties, such as consistency and irredundancy. The Amsterdam workshop was an intimate meeting, and the fifteen attendees were predominantly from European institutions. In spite of—or perhaps because of—this intimacy, the workshop succeeded in highlighting many of the significant trends and issues within its area of concern. The purpose of this short article is to review the trends and issues in question, drawing upon the contributions made during the workshop.