Elsevier

Expert Systems with Applications

Volume 39, Issue 3, 15 February 2012, Pages 3717-3730
Expert Systems with Applications

The combination of dependence-based interval-valued evidential reasoning approach with balanced scorecard for performance assessment

https://doi.org/10.1016/j.eswa.2011.09.069Get rights and content

Abstract

The evidential reasoning (ER) approach can model multiple attribute decision analysis problems with both quantitative and qualitative attributes under the uncertain environment. In real situations, however, giving precise (crisp) assessments for alternatives is often too restrictive and difficult for experts, due to the incompleteness or the lack of information, knowledge and data. And there may be dependence among attributes which is difficult to mathematically model or ill known. To deal with these situations, this paper develops a dependence-based interval-valued ER (shortly called DIER) approach based on Denoeux’s cautious conjunctive rule which is an operator to combine belief functions from dependent sources. A pair of nonlinear optimization problems considering the relative weights of attributes is constructed based on the cautious rule to aggregate dependent attributes. Furthermore, due to the dependence of balanced scorecard (BSC) perspectives, the combination of DIER approach with BSC, called the DIER-BSC, is formed to implement the performance assessment under the uncertain environment. Finally, the performance assessment of the sensors department in a manufacturing company, which provides oxygen supplying and cooling devices for aviation, is demonstrated as an example to verify the validity and usefulness of DIER-BSC.

Highlights

► Dependence-based interval-valued evidential reasoning (DIER) approach. ► Nonlinear optimization problems to aggregate dependent attributes. ► DIER-balanced scorecard to implement performance assessment. ► The performance assessment of sensors department in a manufacturing company.

Introduction

As a practical method of modeling multiple attribute decision analysis (MADA) problems with both quantitative and qualitative attributes under the uncertain environment, the evidential reasoning (ER) approach has been developed in the 1990s and in recent years (Chin et al., 2009, Guo et al., 2007, Wang et al., 2006, Yang and Sen, 1994, Yang and Sen, 1997, Yang and Singh, 1994, Yang and Xu, 2002a, Yang and Xu, 2002b).

However, due to the incompleteness or the lack of information, knowledge and data, experts or decision makers may often feel too restrictive and difficult in some situations to give precise (crisp) assessments which results in partial or total ignorance. To deal with these situations, experts are encouraged to give interval-valued assessments which are interval-valued belief structures (IBSs) (Denoeux, 1999, Lee and Zhu, 1992, Wang et al., 2006, Wang et al., 2007, Yager, 2001). Correspondingly, the ER approach is extended as the interval-valued ER (shortly called IER) approach (Wang, Yang, Xu, & Chin, 2006).

Although the IER approach can effectively deal with conflicting attributes by considering the relative weights of attributes, it is incapable of handling dependent attributes. That is to say, it cannot avoid that some common parts on different attributes are counted twice, which is naturally difficult to describe, as demonstrated by Dempster (1967).

When the interaction between items of evidence can be modeled mathematically (e.g., Dubois and Prade, 1986, Smets, 1986, Wu et al., 1996), Dempster’s rule or the conjunctive rule of transferable belief model can be extended to apply in the IER approach. However, due to the fact that the interaction between items of evidence is usually ill known, or almost impossible to describe in practice, sometimes it cannot be modeled mathematically (Denoeux, 2008).

An operator proposed by Denoeux, called the cautious conjunctive rule, provides a feasible basis to implement the aggregation of dependent attributes in the IER approach, whether the interaction between interval-valued assessments can be modeled mathematically or not. The operator is commutative, associative and idempotent simultaneously, unlike other existing operators. And it is suitable for ubiquitous cases instead of some special cases, such as simple belief functions (the simple belief function has at most two focal elements; and if it has two, the frame is one of them) and separable belief functions (Denoeux, 2008).

Additionally, although Kallel and Hegarat-Mascle extended the cautious conjunctive rule by parameterizing the non-distinctness with their generalized discounting in order to estimate the actual correlation between two belief functions (Kallel & Hegarat-Mascle, 2009), the extended rule is not suitable to be applied in the IER approach. First, it has no associativity property except the parameters {0, 1}. Second, precisely parameterizing the non-distinctness among attributes is not easy for the decision maker. Third, as they stated, their current work is not enough to practically handle three non-distinct sources and solve the conflict between sources.

Aiming at the MADA problems with dependent attributes under interval uncertainties, this paper extends the IER approach to a new dependence-based interval-valued ER (shortly called DIER) approach. A pair of nonlinear optimization problems based on the cautious conjunctive rule considering the relative weights of attributes is constructed to aggregate dependent attributes.

The consideration of the relative weights of attributes in the optimization problems certainly transforms the assessments on attributes to non-dogmatic ones (the frame is a focal element), which guarantees the prerequisite of applying the cautious conjunctive rule. The difference between the consideration of the relative weights of attributes and the discounting process is explained by introducing the ER nonlinear models for aggregating interval-valued assessments in Section 2.4.

To implement the performance assessment under the interval-uncertain and dependent environment, this paper combines the DIER approach with the balanced scorecard (BSC), which is a well performance assessment framework developed by Kaplan and Norton, 1992, Kaplan and Norton, 1993, Kaplan and Norton, 1996a, Kaplan and Norton, 1996b to provide a holistic consideration of financial and non-financial measures. The combination forms the DIER-BSC to effectively handle the intrinsic dependence among BSC perspectives. Its detailed necessity and process will be discussed in Section 4.

The rest of this paper is organized as follows. Section 2 reviews the relevant concepts. Section 3 introduces the DIER approach. Section 4 presents the necessity, modeling and procedure of DIER-BSC. The performance assessment of the sensors department in a manufacturing company, which provides oxygen supplying and cooling devices for aviation, is implemented as an example to demonstrate the validity and usefulness of DIER-BSC in Section 5. And this paper is concluded in Section 6.

Section snippets

Basics of Dempster–Shafer theory

Let Ω = {H1, H2,  , HN} be a collectively exhaustive and mutually exclusive set of propositions, referred to as a frame of discernment. A basic belief assignment (BBA) m, is defined as a mapping from 2Ω to 1 verifying AΩm(A)=1. In Shafer’s original definition, m is called a basic probability assignment (Shafer, 1976) with the condition m(∅) = 0. However, since the transferable belief model (TBM) was proposed as a model of uncertainty (Smets & Kennes, 1994), the condition m(∅) = 0 has been omitted.

The dependence-based interval-valued ER approach

The DIER approach is designed to solve MADA problems with dependent attributes. Sometimes, the assessment on one attribute has a great influence on the assessment on another attribute; the assessments on two attributes keep the underlying compatibility; or the interaction between two attributes is ill known or difficult to describe. These cases can be seen as dependent attributes, in which the ER nonlinear models described in Section 2.4 are not suitable for reasonably aggregating L basic

The necessity of dependence-based interval-valued ER-balanced scorecard

The BSC is a well performance assessment framework developed by Kaplan and Norton, 1992, Kaplan and Norton, 1993, Kaplan and Norton, 1996a, Kaplan and Norton, 1996b, which provides a holistic consideration of financial and non-financial measures. In both theoretical and applicable aspects, it has been investigated independently (Bhagwat and Sharma, 2007, Chand et al., 2005, Fernandes et al., 2006, Martinsons et al., 1999, Milis and Mercken, 2004, Wiersma, 2009) or dependently with other

The performance assessment of sensors department

In this section, the performance of the sensors department (SD) in a manufacturing company in Hefei, China, which provides oxygen supplying and cooling devices for aviation, is assessed by the DIER-BSC.

A self-developed solving system based on Matlab software package is used to effectively and efficiently implement the performance assessment.

The information related to the assessment tree in this example is collected by interacting with the manager of SD (decision maker) about the real

Conclusions

The DIER approach was extended from the ER approach to solve the uncertain MADA problems with dependent attributes and continuously interval-valued assessments due to the lack of information, knowledge and data. It was further combined with the BSC to form the DIER-BSC to implement the performance assessment under the uncertain environment. Furthermore, the performance assessment of the SD in the manufacturing company was implemented to demonstrate the validity and usefulness of DIER-BSC.

The

Acknowledgements

This research is supported by the National Natural Science Foundation of China (Nos. 70631003, 90718037 and 70871032), and the Specialized Research Fund for the Doctoral Program of Higher Education of MOE of China (No. 200803590007).

References (56)

  • T. Garcia-Valderrama et al.

    Relating the perspectives of the balanced scorecard for R&D by means of DEA

    European Journal of Operational Research

    (2009)
  • M. Guo et al.

    Evidential reasoning based preference programming for multiple attribute decision analysis under uncertainty

    European Journal of Operational Research

    (2007)
  • A. Kallel et al.

    Combination of partially non-distinct beliefs: The cautious-adaptive rule

    International Journal of Approximate Reasoning

    (2009)
  • A.H.I. Lee et al.

    A fuzzy AHP and BSC approach for evaluating performance of IT department in the manufacturing industry in Taiwan

    Expert Systems with Applications

    (2008)
  • E.S. Lee et al.

    An interval Dempster–Shafer approach

    Computers and Mathematics with Application

    (1992)
  • W. Liu

    Analyzing the degree of conflict among belief functions

    Artificial Intelligence

    (2006)
  • M. Martinsons et al.

    The balanced scorecard: A foundation for the strategic management of information systems

    Decision Support Systems

    (1999)
  • D. Mercier et al.

    Refined modeling of sensor reliability in the belief function framework using contextual discounting

    Information Fusion

    (2008)
  • K. Milis et al.

    The use of the balanced scorecard for the evaluation of information and communication technology projects

    International Journal of Project Management

    (2004)
  • A.I. Olcer et al.

    A new fuzzy multiple attributive group decision making methodology and its application to propulsion/manoeuvring system selection problem

    European Journal of Operational Research

    (2005)
  • V. Ravi et al.

    Analyzing alternatives in reverse logistics for end-of-life computers: ANP and balanced scorecard approach

    Computers and Industrial Engineering

    (2005)
  • L.E. Shirland et al.

    Determining attribute weights using mathematical programming

    Omega—International Journal of Management Science

    (2003)
  • P. Smets

    Analyzing the combination of conflicting belief functions

    Information Fusion

    (2007)
  • P. Smets et al.

    The transferable belief model

    Artificial Intelligence

    (1994)
  • E. Takeda et al.

    Estimating criterion weights using eigenvectors: A comparative study

    European Journal of Operational Research

    (1987)
  • H. Tanaka et al.

    Non-additive measures by interval probability functions

    Information Sciences

    (2004)
  • M.L. Tseng

    Implementation and performance evaluation using the fuzzy network balanced scorecard

    Computers and Education

    (2010)
  • Y.M. Wang et al.

    On the normalization of interval and fuzzy weights

    Fuzzy Sets and Systems

    (2006)
  • Cited by (25)

    • Representing uncertainty and imprecision in machine learning: A survey on belief functions

      2024, Journal of King Saud University - Computer and Information Sciences
    • A general evidential reasoning algorithm for multi-attribute decision analysis under interval uncertainty

      2017, European Journal of Operational Research
      Citation Excerpt :

      In this case, a precise number can neither exactly represent the opinions of decision makers nor accurately indicate the object's performance. Several researchers have adopted multi-attribute decision analysis (MADA) for the sake of rationality, wherein several complicated problems, involving both quantitative and qualitative attributes, as well as various types of uncertainty, such as incomplete information, utter ignorance, and fuzziness, are modeled using Analytic Hierarchy Process (AHP) (e.g., Büyüközkan, Çifçi, & Güleryüz, 2011; Chen, Hsieh, & Do, 2015; Entani and Sugihara, 2012; Ishizaka, & Nguyen, 2013; Shaw, Shankar, Yadav, & Thakur, 2012), Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) (e.g., Joshi & Kumar, 2016; Tsaur, 2011; Xu, & Zhang, 2013) and the evidential reasoning (ER) approach (e.g., Beynon, Cosker, & Marshall, 2001; Beynon, Curry, & Morgan, 2000; Fu & Yang, 2012a, 2012b; Wang, Yang, & Xu, 2006; Yang, 2001; Yang & Sen, 1994; Yang & Singh, 1994; Yang & Xu, 2002a, 2002b; Yang, Wang, Xu, & Chin, 2006; Zhang & Wang, 2015). The ER approach involves the following steps: (i) a set of well-organized grades are offered to evaluate attributes, (ii) a distributed framework is established to describe uncertain assessment using a belief structure, (iii) the Dempster–Shafer theory (DST), developed by Dempster (1967) and Shafer (1976), is used to aggregate the assessment information, and iv) the multi-attribute utility theory is applied to compare alternatives.

    View all citing articles on Scopus
    View full text