Business intelligence and organizational learning: An empirical investigation of value creation processes

https://doi.org/10.1016/j.im.2016.03.009Get rights and content

Highlights

  • This study develops and tests a research model of BI value creation.

  • The model incorporates both general-IT and specific-BI value creation mechanisms.

  • We initially assess the model with qualitative data collected in three organizations.

  • We then test the hypotheses with cross-sectional data collected from managers.

  • The findings demonstrate the value creation processes unique to BI resources.

Abstract

With the aim of bridging the gap between well-established research on information technology (IT) value creation and the emergent study of business intelligence (BI), this study develops and tests a model of BI value creation that is firmly anchored in both streams of research. The analysis draws on the resource-based view and on conceptualizations of organizational learning to hypothesize about the paths by which BI assets and BI capabilities create business value. The research model is first assessed in an exploratory analysis of data collected through interviews in three firms and then tested in a confirmatory analysis of data collected through a survey.

Introduction

The business value of information technology (IT) has been demonstrated repeatedly in the past decades [13], [36], [83]. However, a major shortcoming of this field of research has been its disposition to study the business value of overarching IT concepts instead of the value gained by specific classes of information systems. The primary goal of those general IT studies has been to capture the organizational effects attributed to all IT assets and capabilities available to the organization. Those studies have been complemented by specific IT studies, aimed at understanding the business value of specific platforms and systems, such as electronic commerce [105] and enterprise resource planning (ERP) [62], [66]. The contribution of the latter studies is based on the often implicit rationale that different technologies bring about different processes of value creation. Therefore, it is essential to understand the unique value creation mechanisms at play for each technology.

In terms of value creation, business intelligence (BI) appears to be among the most promising technologies in recent years, at least as reflected in the attitudes of IT executives [61]. However, despite this dramatic shift in investment patterns and value perceptions, little empirical research has addressed the value creation processes unique to BI systems (e.g., Refs. [33], [124]). Although some efforts have been made to capture how BI generates business value, it is safe to conclude that there is much to learn about the value creation processes induced by this dominant IT domain.

Against this backdrop, we seek to answer the following research question: What are the distinct mechanisms of value creation underlying the business value of BI? We argue in this paper that understanding the business value of BI requires the integration of general knowledge about the processes of IT value creation and specific knowledge about the features unique to BI deployment. We integrate the two by taking stock of well-established findings about IT value creation and adapting them to the context of BI value creation. In particular, general IT findings include the relationships observed in previous research among IT assets, IT capabilities, organizational resources, and business value [64], [79], [82], [102], whereas specific BI adaptations involve the distinction between operational and strategic BI capabilities and the moderating role of organizational learning [74]. We demonstrate that organizational learning is an important theoretical lens for understanding how BI creates business value, especially given that BI systems are deployed to facilitate decision support, environmental adaptation, and organizational innovation. Specifically, the framework of exploration and exploitation in organizational learning [76] is applied because of the conceptual fit between the two types of BI capabilities (operational and strategic) and the two mechanisms of organizational learning (exploitation and exploration). In concert with the resource-based view (RBV) of the firm [8], [122], these theoretical bases allow us to formulate a comprehensive research model of how the deployment of BI resources creates business value.

In this paper, we adopt the process view prevalent in the literature on general IT business value [64], [79], [80], [98], and we develop a research model that considers BI capabilities (operational and strategic) as mediating the effects of BI assets (BI infrastructure and BI team) on business value (operational and strategic). The research model also accounts for the moderating effects of exploration and exploitation on the relationships between assets and capabilities. The development of the research model is based on a comprehensive literature review, which shows that the diffusion of knowledge from the literature on IT value to that on BI value has been sporadic and inconsistent. A preliminary assessment of our research model relies on qualitative data collected in 11 interviews in three organizations. Subsequently, the model is tested with cross-sectional data collected from managers. Data analysis, using structural equation modeling (SEM), generally confirms the research model and shows that the lens of organizational learning and the distinction between operational and strategic BI capabilities are critical to understanding BI value creation.

The contribution of this study is attributed to our dual approach, which integrates insights gained from both general IT and specific BI research. The study therefore contributes to both streams of research. First, it contributes to BI research by providing a model of value creation specific to this domain, which, despite being a high-priority investment in many organizations, suffers from a lack of empirical grounding. BI research also suffers from insufficient theoretical development, and the present study demonstrates that organizational learning is a useful theoretical lens to further our understanding of BI value. Second, the study contributes to IT value research by showing that “opening the grey box of IS business value creation” [102,p. 149] may not be entirely possible unless value creation processes are grounded in a specific technological context. Finally, our dual approach is easily transferable to other technological domains, offering a promising avenue to advance research on domain-specific value creation processes.

This paper proceeds as follows: the next section provides the theoretical background, which leads to the development of the research model. The third section describes the research methodology used to test the research model, and the fourth section describes the data analysis and results. Finally, the concluding section discusses the key findings, contributions, limitations, and directions for future research.

Section snippets

Theoretical background and research model

The theoretical analysis begins with a short introduction of research on the business value of BI systems. We then present three consistent observations about the business value of IT; we also demonstrate, through a structured literature review, that the implications of these observations on the business value of BI have yet to be fully studied. This theoretical background is the foundation upon which the research model is constructed in the rest of this section.

Research methodology

The methodology for developing and testing the research model included two stages, exploratory and confirmatory. The first stage involved an exploratory analysis of the theoretical premises underlying the research model, in particular the relationships among BI assets, BI capabilities, and business value, as well as the distinction between operational and strategic BI capabilities. The moderating role of organizational learning was not explored at this stage because of the intricate nature of

Results

To analyze the collected data, we used covariance-based SEM techniques with the AMOS 20 software and maximum likelihood estimation (MLE). Although our sample size was close to the lower bound of the recommended sample size for covariance-based SEM [51], we preferred covariance-based SEM techniques over the partial least squares (PLS) techniques, because the former allows the assessment of the plausibility of the hypothesized research model through goodness-of-fit tests [46], [47]. The data were

Key findings

The findings of this study validate the reasoning that operational and strategic BI capabilities should be considered separately and that organizations may become ambidextrous in their BI capabilities in the same way they can become ambidextrous in their approach to organizational learning. The study advances the perception that business value is generated from BI assets via two parallel mechanisms, operational and strategic, based on two orthogonal sets of respective capabilities. This dual

Lior Fink is an associate professor at Ben-Gurion University of the Negev. He holds a bachelor’s degree in psychology and economics, a master’s degree in social-industrial psychology, and a Ph.D. degree in information systems from Tel Aviv University. Lior’s articles have been published in numerous journals including MIS Quarterly, European Journal of Information Systems, Information & Management, Information Systems Journal, Journal of the Association for Information Systems, Journal of

References (125)

  • A. Popovic et al.

    Towards business intelligence systems success: effects of maturity and culture on analytical decision making

    Decis. Support Syst.

    (2012)
  • A. Radhakrishnan et al.

    A process-oriented perspective on differential business value creation by information technology: an empirical investigation

    Omega

    (2008)
  • T. Ramakrishnan et al.

    Factors influencing business intelligence (BI) data collection strategies: an empirical investigation

    Decis. Support Syst.

    (2012)
  • K. Ramamurthy et al.

    An empirical investigation of the key determinants of data warehouse adoption

    Decis. Support Syst.

    (2008)
  • E. Rubin et al.

    The impact of business intelligence systems on stock return volatility

    Inf. Manag.

    (2013)
  • R.L. Ackoff

    Redesigning the Future: Systems Approach to Societal Problems

    (1974)
  • R. Amit et al.

    Strategic assets and organizational rent

    Strateg. Manag. J.

    (1993)
  • R. Anderson-Lehman et al.

    Continental Airlines flies high with real-time business intelligence

    MIS Q. Executive

    (2004)
  • J.C. Anderson et al.

    Structural equation modeling in practice: a review and recommended two-step approach

    Psychol. Bull.

    (1988)
  • S. Aral et al.

    IT assets, organizational capabilities, and firm performance: how resource allocations and organizational differences explain performance variation

    Organ Sci.

    (2007)
  • J.S. Armstrong et al.

    Estimating nonresponse bias in mail surveys

    J. Mark. Res.

    (1977)
  • J. Barney

    Firm resources and sustained competitive advantage

    J. Manag.

    (1991)
  • Y. Baruch et al.

    Survey response rate levels and trends in organizational research

    Hum. Relat.

    (2008)
  • G. Bassellier et al.

    Business competence of information technology professionals: conceptual development and influence on IT-business partnerships

    MIS Q.

    (2004)
  • M. Benaroch et al.

    Option-based risk management: a field study of sequential information technology investment decisions

    J. Manag. Inf. Syst.

    (2007)
  • M.J. Benner et al.

    Process management and technological innovation: a longitudinal study of the photography and paint industries

    Adm. Sci. Q.

    (2002)
  • A.S. Bharadwaj

    A resource-based perspective on information technology capability and firm performance: an empirical investigation

    MIS Q.

    (2000)
  • G.D. Bhatt et al.

    Types of information technology capabilities and their role in competitive advantage: an empirical study

    J. Manag. Inf. Syst.

    (2005)
  • J.S. Brown et al.

    Organizational learning and communities-of-practice: toward a unified view of working, learning, and innovation

    Organ Sci.

    (1991)
  • E. Brynjolfsson et al.

    Strength in numbers: how does data-driven decision-making affect firm performance?

  • T.A. Byrd et al.

    Measuring the flexibility of information technology infrastructure: exploratory analysis of a construct

    J. Manag. Inf. Syst.

    (2000)
  • H. Chen et al.

    Business intelligence and analytics: from big data to big impact

    MIS Q.

    (2012)
  • T.D. Clark et al.

    The dynamic structure of management support systems: theory development, research focus, and direction

    MIS Q.

    (2007)
  • E.K. Clemons et al.

    Sustaining IT advantage: the role of structural differences

    MIS Q.

    (1991)
  • B.L. Cooper et al.

    Data warehousing supports corporate strategy at First American Corporation

    MIS Q.

    (2000)
  • A. Counihan et al.

    Towards a framework for evaluating investments in data warehousing

    Inf. Syst. J.

    (2002)
  • D.A. Cowan

    The effect of decision-making styles and contextual experience on executives’ descriptions of organizational problem formulation

    J. Manag. Stud.

    (1991)
  • T.H. Davenport

    Competing on analytics

    Harv. Bus. Rev.

    (2006)
  • T.H. Davenport et al.

    Data scientist: the sexiest job of the 21 st century

    Harv. Bus. Rev.

    (2012)
  • J. Davis et al.

    Information Revolution: Using the Information Evolution Model to Grow Your Business

    (2006)
  • S. Devaraj et al.

    Information technology payoff in the health-care industry: a longitudinal study

    J. Manag. Inf. Syst.

    (2000)
  • R. Drazin et al.

    Alternative forms of fit in contingency theory

    Adm. Sci. Q.

    (1985)
  • N.B. Duncan

    Capturing flexibility of information technology infrastructure: a study of resource characteristics and their measure

    J. Manag. Inf. Syst.

    (1995)
  • W.W. Eckerson

    The Keys to Enterprise Business Intelligence: Critical Success Factors

    (2005)
  • W.W. Eckerson

    Pervasive Business Intelligence: Techniques and Technologies to Deploy Bi on an Enterprise Scale

    (2008)
  • M.Z. Elbashir et al.

    The role of oranizational absorptive capacity in the strategic use of business intelligence to support management control systems

    Acc. Rev.

    (2011)
  • D.F. Feeny et al.

    Core IS capabilities for exploiting information technology

    Sloan Manag. Rev.

    (1998)
  • L. Fink et al.

    Gaining agility through IT personnel capabilities: the mediating role of IT infrastructure capabilities

    J. Assoc. Inf. Syst.

    (2007)
  • L. Fink et al.

    The effect of organizational factors on the business value of IT: universalistic, contingency, and configurational predictions

    Inf. Syst. Manag.

    (2011)
  • C. Fornell et al.

    Evaluating structural equation models with unobservable variables and measurement error

    J. Mark. Res.

    (1981)
  • Cited by (138)

    View all citing articles on Scopus

    Lior Fink is an associate professor at Ben-Gurion University of the Negev. He holds a bachelor’s degree in psychology and economics, a master’s degree in social-industrial psychology, and a Ph.D. degree in information systems from Tel Aviv University. Lior’s articles have been published in numerous journals including MIS Quarterly, European Journal of Information Systems, Information & Management, Information Systems Journal, Journal of the Association for Information Systems, Journal of Information Technology, and Journal of Strategic Information Systems. Lior currently serves as a Senior Editor for The Data Base for Advances in Information Systems.

    Nir Yogev is a professional BI consultant for a company specializing in BI software and services. He holds a bachelor’s degree in industrial engineering and management and a master’s degree in information systems from Ben-Gurion University of the Negev. Nir’s research focuses on the business value of BI systems.

    Adir Even received his DBA degree from Boston University School of Management and serves as a senior lecturer at Ben-Gurion University of the Negev, Israel. He explores the contribution of data resources to value-gain and profitability from both theoretical and practical perspectives, and studies implications for data warehousing, business intelligence, and data quality management. His research has been published in journals such as IEEE/TDKE, CACM, CAIS, DSS, IJBIR, and Database.

    View full text