Elsevier

Data & Knowledge Engineering

Volume 27, Issue 2, September 1998, Pages 115-138
Data & Knowledge Engineering

Paper
Verification of accuracy of rules in a rule based system

https://doi.org/10.1016/S0169-023X(98)00009-3Get rights and content

Abstract

Verification of Rule Based Systems has largely concentrated on checking the consistency, conciseness and completeness of the rulebase. However, the accuracy of rules vis-à-vis the knowledge that they represent, is not addressed, with the result that a large amount of testing has to be done to validate the system. For any reasonably-sized rulebase it becomes difficult to know the adequacy and completeness of the test-cases. In case a particular test-case is omitted the chances of an inaccurate rule remaining undetected increases. We discuss this issue and define a notion of accuracy of rules. We take the view that a rule represents a concept of the domain and in the scenario of Formal Concept Analysis, works on objects and attribute-value space. We then present a mechanism to measure the level of accuracy using the Rough Set Theory. In this framework, accuracy can be computed as a ratio of the objects definitely selected by the rule (the lower approximation) to the objects possibly selected by the rule (the upper approximation) with respect to the concept that it encodes. Our algorithm and its implementation for PROLOG clauses is discussed.

References (25)

  • N. Zlatareva et al.

    State of the art in automated validation of knowledge based systems

    Expert System with Applications

    (1994)
  • C. Anantaram et al.

    Verification of accuracy of rules in rule-based system

    (Sept. 1995)
  • C. Anantaram et al.

    Measuring the accuracy of a knowledge base in conventional and DAI frameworks

    Journal of the IETE

    (May–June 1996)
  • C. Anantaram et al.

    Accuracy and representational correctness of rule-based systems

  • T. Bench-Capon et al.

    Two aspects of the validation and verification of knowledge-based systems

    IEEE Expert

    (June 1993)
  • H. Boley et al.

    A survey of techniques for knowledge validation and exploration

  • P. Brezillon et al.

    Using knowledge in its context: Report on the IJCAI-93 workshop

  • S. Buvac et al.

    Propositional logic of context

  • R. Evertsz, The automated anlysis of rule-based systems, based on their procedural semantics, IJCAI- 1991 Proc., Vol....
  • R. Greiner et al.

    Measuring and improving the effectiveness of representations

  • Russell Greiner

    The complexity of theory revision

  • G. Guida et al.

    Evaluating performance & quality of knowledge-based systems: Foundations and methodology

    IEEE Trans. on Knowledge and Data Engineering

    (April 1993)
  • Cited by (6)

    • Bayesian rough set model: A further investigation

      2012, International Journal of Approximate Reasoning
    • KJ3 - A tool assisting formal validation of knowledge-based systems

      2002, International Journal of Human Computer Studies
    View full text