A new evaluation model of ERP system success
DOI:
https://doi.org/10.37380/jisib.v5i1.110Keywords:
ERP system, success, evaluation approaches, Evaluation Success FactorsAbstract
This article presents a literature review about the success evaluation in the information system, and proposes a new evaluation success model suited to the ERP software. In the first part we present approaches, frameworks and models of the evaluation success previously used and empirically validated by researchers in the IS field. Then, we present our Evaluation Success Model, highlighting its three main theoretical foundations: Mathematical theory of communication, diffusion of innovation theory and adaptive structuration theory in the one hand, and we expose the main construct of this model named the ESF (Evaluation Success Factors) on the other hand. These factors are classified in three categories: technological, environmental and organizational evaluation factors. This work analyses articles published in the last decade about the success evaluation and delineates ten ESF’s widely used to evaluate the success of the ERP system project.References
Al-Mashari, M., Al-Mudimigh, A., Zairi, M., 2003. Enterprise resource planning: A taxonomy of critical factors. European Journal of Operational Research 146, 352–364. DOI: https://doi.org/10.1016/S0377-2217(02)00554-4
Amoako-Gyampah, K., 2007. Perceived usefulness, user involvement and behavioral intention: an empirical study of ERP implementation. Computers in Human Behavior 23, 1232–1248. DOI: https://doi.org/10.1016/j.chb.2004.12.002
Bandura, A., 1999. Social cognitive theory: An agentic perspective. Asian Journal of Social Psychology 2, 21–41. DOI: https://doi.org/10.1111/1467-839X.00024
Bellaaj, M., 2010. Technologies de l’information et performance organisationnelle : différentes approches d’évaluation. (Manuscrit).
Bernroider, E.W.N., 2008. IT governance for enterprise resource planning supported by the DeLone–McLean model of information systems success. Information & Management 45, 257–269. DOI: https://doi.org/10.1016/j.im.2007.11.004
Bernroider, E.W.N., Wong, C.W.Y., Lai, K., 2014. From dynamic capabilities to ERP enabled business improvements: The mediating effect of the implementation project. International Journal of Project Management 32, 350–362. DOI: https://doi.org/10.1016/j.ijproman.2013.05.006
Bradford, M., Florin, J., 2003. Examining the role of innovation diffusion factors on the implementation success of enterprise resource planning systems. International Journal of Accounting Information Systems 4, 205–225. DOI: https://doi.org/10.1016/S1467-0895(03)00026-5
Brynjolfsson E. et Hitt L. (1996), “Paradox lost? Firm-level evidence on the returns to information systems spending”, Management Science, 42, 541-558 DOI: https://doi.org/10.1287/mnsc.42.4.541
Candra, S., 2012. ERP Implementation Success and Knowledge Capability. Procedia - Social and Behavioral Sciences 65, 141–149. DOI: https://doi.org/10.1016/j.sbspro.2012.11.103
Chand, D., Hachey, G., Hunton, J., Owhoso, V., Vasudevan, S., 2005. A balanced scorecard based framework for assessing the strategic impacts of ERP systems. Computers in Industry 56, 558–572. DOI: https://doi.org/10.1016/j.compind.2005.02.011
Chien, S.-W., Hu, C., Reimers, K., Lin, J.-S., 2007. The influence of centrifugal and centripetal forces on ERP project success in small and medium-sized enterprises in China and Taiwan. International Journal of Production Economics 107, 380–396. DOI: https://doi.org/10.1016/j.ijpe.2006.10.002
Choi, D.H., Kim, J., Kim, S.H., 2007. ERP training with a web-based electronic learning system: The flow theory perspective. International Journal of Human-Computer Studies 65, 223–243. DOI: https://doi.org/10.1016/j.ijhcs.2006.10.002
Chou, J.-S., Hong, J.-H., 2013. Assessing the impact of quality determinants and user characteristics on successful enterprise resource planning project implementation. Journal of Manufacturing Systems 32, 792–800. DOI: https://doi.org/10.1016/j.jmsy.2013.04.014
Chou, S.-W., Chang, Y.-C., 2008. The implementation factors that influence the ERP (enterprise resource planning) benefits. Decision Support Systems 46, 149–157. DOI: https://doi.org/10.1016/j.dss.2008.06.003
Chung, B.Y., J. Skibniewski, M., C. Lucas Jr, H., Kwak, Y.H., 2008. Analyzing Enterprise Resource Planning System Implementation Success Factors in the Engineering–Construction Industry. Journal of Computing in Civil Engineering 22, 373–382. DOI: https://doi.org/10.1061/(ASCE)0887-3801(2008)22:6(373)
Davenport, T.., 1998. Putting the Enterprise into the Enterprise System. Harvard Business Review 76, 121–131.
Davis, F.D., 1989a. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly 13, 318–340. DOI: https://doi.org/10.2307/249008
Davis, F.D., 1989b. User acceptance of computer technology: a comparison of two theoretical models. Management science 35, 982–1003. DOI: https://doi.org/10.1287/mnsc.35.8.982
DeLone, W.H., McLean, E.R., 1992. Information Systems Success: The Quest for the Dependent Variable. Information Systems Research 3, 6.–95. DOI: https://doi.org/10.1287/isre.3.1.60
DeLone, W.H., McLean, E.R., 2003. The DeLone and McLean Model of Information Systems Success: A Ten-Year Update. The D e Lone an D M c Lean Mo D e L of Infor M a TI on Sy ST e M Succe SS 9 Journal of Management Information Systems 19, 9–30. DOI: https://doi.org/10.1080/07421222.2003.11045748
DeSanctis, G., Poole, M.S., 1994. Capturing the Complexity in Advanced Technology Use: Adaptive Structuration Theory. Organization Science 15, 121–147. DOI: https://doi.org/10.1287/orsc.5.2.121
Dörr, S., Walther, S., Eymann, T., 2013. Information Systems Success - A Quantitative Literature Review and Comparison. Presented at the 11th International Conference on Wirtschaftsinformatik, Germany.
Ehie, I.C., Madsen, M., 2005. Identifying critical issues in enterprise resource planning (ERP) implementation. Computers in Industry 56, 545–557. DOI: https://doi.org/10.1016/j.compind.2005.02.006
Finney, S., Corbett, M., 2007. ERP implementation: a compilation and analysis of critical success factors. Business Process Management Journal 13, 329–347. DOI: https://doi.org/10.1108/14637150710752272
Gable, G.G., Sedera, D., Chan, T., 2003. Enterprise systems success: a measurement model, in: Proceedings of the 24th International Conference on Information Systems Association for Information Systems. Presented at the Proceedings of the 24th International Conference on Information Systems Association for Information Systems, Seattle, Washington, pp. 576–591.
Grant, D., Hwang, Y., Tu, Q., 2013. An empirical investigation of six levels of enterprise resource planning integration. Computers in Human Behavior 29, 2123–2133. DOI: https://doi.org/10.1016/j.chb.2013.05.008
Henderson, J.C., Venkatraman, N., 1993. Strategic alignement: Leveraging information technology for transforming organizations. IBM System Journal 38, 472–484. DOI: https://doi.org/10.1147/sj.382.0472
Hong, K.-K., Kim, Y.-G., 2002. The critical success factors for ERP implementation: an organizational fit perspective. Information & Management 40, 25–40. DOI: https://doi.org/10.1016/S0378-7206(01)00134-3
Ifinedo, P., 2011. Examining the influences of external expertise and in-house computer/IT knowledge on ERP system success. Journal of Systems and Software 84, 2065–2078. DOI: https://doi.org/10.1016/j.jss.2011.05.017
Ifinedo, P., Nahar, N., 2006. Quality, Impact and Success of ERP Systems: A Study Involving Some Firms in the Nordic-Baltic Region. Journal of Information Technology Impact 6, 19–46.
Ifinedo, P., Rapp, B., Ifinedo, A., Sundberg, K., 2010. Relationships among ERP post-implementation success constructs: An analysis at the organizational level. Computers in Human Behavior 26, 1136–1148. DOI: https://doi.org/10.1016/j.chb.2010.03.020
Irani, Z., 2002. Information systems evaluation: navigating through the problem domain. Information & Management 40, 11–24. DOI: https://doi.org/10.1016/S0378-7206(01)00128-8
Irani, Z., Love, P.E.D., 2008. Evaluating information systems Public and private sector. Elsevier. DOI: https://doi.org/10.4324/9780080570105
Irani, Z., Sharif, A., Kamal, M.M., Love, P.E.D., 2014. Visualising a knowledge mapping of information systems investment evaluation. Expert Systems with Applications 41, 105–125. DOI: https://doi.org/10.1016/j.eswa.2013.07.015
Kaplan, R.S., Norton, D.P., 1992. The Balanced Scorecard – Measures that Drive Business Perfomance. Harvard Business Review January-February, 71–79.
King, W.R., He, J., 2006. A meta-analysis of the technology acceptance model. Information & Management 43, 740–755. DOI: https://doi.org/10.1016/j.im.2006.05.003
Kronbichler, S.A., Ostermann, H., Staudinger, R., 2010. A comparison of ERP-Success measurment approaches. Journal of Information Systems and technologie Management 7, 281–310. DOI: https://doi.org/10.4301/S1807-17752010000200003
Kwahk, K.-Y., Lee, J.-N., 2008. The role of readiness for change in ERP implementation: Theoretical bases and empirical validation. Information & Management 45, 474–481. DOI: https://doi.org/10.1016/j.im.2008.07.002
Lapiedra, R., Alegre, J., Chiva, R., 2011. The importance of management innovation and consultant services on ERP implementation success. The Service Industries Journal 31, 1907–1917. DOI: https://doi.org/10.1080/02642069.2011.556189
Law, C.C.H., Ngai, E.W.T., 2007. ERP systems adoption: An exploratory study of the organizational factors and impacts of ERP success. Information & Management 44, 418–432. DOI: https://doi.org/10.1016/j.im.2007.03.004
Lyytinen, K., Hirschheim, R., 1987. Information systems failures - a survey and classification of the empirical literature. Oxford Surveys in Information Technology 4, 257–309.
Markus, M.L., Tanis, C., 2000. the enterprise system experience from adoption to success.
Mason, R.O., 1978. Measuring information output: A communication systems approach. Information & Management 1, 219–234. DOI: https://doi.org/10.1016/0378-7206(78)90028-9
Myers, B.L., Kappelman, L.A., Prybutok, V.R., 1997. A Comprehensive Model fo Assessing the Quality and Productivity of the Information System Function: Toward A Theory fo Information Systems Assessment. Information Recources Management Journal 10, 6–25. DOI: https://doi.org/10.4018/irmj.1997010101
Nicolaou, A.I., Bhattacharya, S., 2006. Organizational performance effects of ERP systems usage: The impact of post-implementation changes. International Journal of Accounting Information Systems 7, 18–35. DOI: https://doi.org/10.1016/j.accinf.2005.12.002
Porter, M., Millar, V., 1985. How Information Gives You Competitive Advantage. Harvard Business Review 149–160.
Ram, J., Corkindale, D., Wu, M.-L., 2013a. Implementation critical success factors (CSFs) for ERP: Do they contribute to implementation success and post-implementation performance? International Journal of Production Economics 144, 157–174. DOI: https://doi.org/10.1016/j.ijpe.2013.01.032
Ram, J., Wu, M.-L., Tagg, R., 2013b. Competitive advantage from ERP projects: Examining the role of key implementation drivers. International Journal of Project Management. DOI: https://doi.org/10.1016/j.ijproman.2013.08.004
Rogers, E.M., 1983. DIFFUSION OF INNOVATIONS, 3rd ed. Free Press, United States of America.
Rosemann, M., Wiese, J., 1999. Measuring the Performance of ERP Software – a Balanced Scorecard Approach, in: Proc. 10th Australasian Conference on Information Systems. Presented at the Proc. 10th Australasian Conference on Information Systems, pp. 773–784.
Scott, J.E., Walczak, S., 2009. Cognitive engagement with a multimedia ERP training tool: Assessing computer self-efficacy and technology acceptance. Information & Management 46, 221–232. DOI: https://doi.org/10.1016/j.im.2008.10.003
Seddon, P., 1997. A Respecification and Extension of the DeLone and McLean Model of IS Success. Information Systems Research 8, 240–253. DOI: https://doi.org/10.1287/isre.8.3.240
Sedera, D., Gable, G.G., 2010. Knowledge Management Competence for Enterprise System Success. The Journal of Strategic Information Systems 19, 296–306. DOI: https://doi.org/10.1016/j.jsis.2010.10.001
Shang, S., Seddon, B.P., 2002. Assessing and managing the benefits of enterprise systems: the business manager’s perspective. Information Systems Journal 12, 271–299. DOI: https://doi.org/10.1046/j.1365-2575.2002.00132.x
Shih, Y.-Y., Huang, S.-S., 2009. The Actual Usage of ERP Systems: An Extended Technology Acceptance Perspective. Journal of Research and Practice in Information Technology 41, 263–276.
Soh, C., Markus, M.L., 1995. How it creates business value: A process theory synthesis, in: Proc. International Conference on Information Systems. Presented at the Proc. International Conference on Information Systems.
Song, X., Letch, N., 2012. Research on IT/IS Evaluation: A25 Year Review. The Electronic Journal Information Systems Evaluation 15, 276–287.
Stefanou, C.J., C., 2001. A framework for the ex-ante evaluation of ERP software. European Journal of Information Systems 204–2015. DOI: https://doi.org/10.1057/palgrave.ejis.3000407
Sun, Y., Bhattacherjee, A., Ma, Q., 2009. Extending technology usage to work settings: The role of perceived work compatibility in ERP implementation. Information & Management 46, 351–356. DOI: https://doi.org/10.1016/j.im.2009.06.003
Tornatzky, L.G., Klein, K.J., 1982. Innovation Characteristics and Innovation Adoption-implementation: A Meta-analysis of findings. IEEE Transactions on engineering management 29, 28–43. DOI: https://doi.org/10.1109/TEM.1982.6447463
Tsai, W.-H., Hsu, P.-Y., Cheng, J.M.-S., 2006. An AHP approach to assessing the relative importance weights of ERP performance measures. International Journal of management & enterprise development 3, 351–375.Tsai, W.-H., Lee, P.-L., Shen, Y.-S., Lin, H.-L., 2012. A comprehensive study of the relationship between enterprise resource planning selection criteria and enterprise resource planning system success. Information & Management 49, 36–46. DOI: https://doi.org/10.1016/j.im.2011.09.007
Urbach, N., Smolnik, S., 2008. A Methodological Examination of Empirical Research on Information Systems Success: 2003 to 2007. Presented at the Proceedings of the Fourteenth Americas Conference on Information Systems, Toronto Canada.
Uwizeyemungu, S., Raymond, L., 2010. Linking the Effects of ERP to Organizational Performance: Development and Initial Validation of an Evaluation Method. Information Systems Management 27, 25–41. DOI: https://doi.org/10.1080/10580530903455122
Velcu, O., 2010. Strategic alignment of ERP implementation stages: An empirical investigation. Information & Management 47, 158–166. DOI: https://doi.org/10.1016/j.im.2010.01.005
Venkatesh, V., Davis, F.D., 2000. A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies. Management Science 46, 186–204. DOI: https://doi.org/10.1287/mnsc.46.2.186.11926
Venkatesh, V., Morris, M.G., Davis, G.B., Davis, F.D., 2003. USER ACCEPTANCE OF INFORMATION TECHNOLOGY: TOWARD A UNIFIED VIEW1. MIS Quarterly 27, 425–478. DOI: https://doi.org/10.2307/30036540
Wang, E.T.G., Chen, J.H.F., 2006. The influence of governance equilibrium on ERP project success. Decision Support Systems 41, 708–727. DOI: https://doi.org/10.1016/j.dss.2004.10.005
Wang, E.T.G., Shih, S.-P., Jiang, J.J., Klein, G., 2008. The consistency among facilitating factors and ERP implementation success: A holistic view of fit. Journal of Systems and Software 81, 1609–1621. DOI: https://doi.org/10.1016/j.jss.2007.11.722
Weaver, W., Shannon, C., 1949. The mathematical theorie of communication.
Wu, K., Zhao, Y., Zhu, Q., Tan, X., Zheng, H., 2011. A meta-analysis of the impact of trust on technology acceptance model: Investigation of moderating influence of subject and context type. International Journal of Information Management 31, 572–581. DOI: https://doi.org/10.1016/j.ijinfomgt.2011.03.004
Yoon, C., 2009. The effects of organizational citizenship behaviors on ERP system success. Computers in Human Behavior 25, 421–428. DOI: https://doi.org/10.1016/j.chb.2008.10.004
Zhu, Y., Li, Y., Wang, W., Chen, J., 2010. What leads to post-implementation success of ERP? An empirical study of the Chinese retail industry. International Journal of Information Management 30, 265–276. DOI: https://doi.org/10.1016/j.ijinfomgt.2009.09.007
Downloads
Published
Issue
Section
License
Copyright (c) 2015 Journal of Intelligence Studies in Business
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
