Revista de Investigaciones Universidad del Quindío,
34(S4), 62-76; 2022.
ISSN: 1794-631X e-ISSN: 2500-5782
Esta obra está bajo una licencia Creative Commons Atribución-NoComercial-SinDerivadas 4.0 Internacional.
MANAGEMENT INFORMATION SYSTEMS ERRORS. SCIENTOMETRIC ANALYSIS
ERRORES EN LOS SISTEMAS DE INFORMACIÓN DE GESTIÓN. ANÁLISIS CIENTOMÉTRICO
Lina María Castro-Benavides1 *; Yudy Celmira Castro-Benavides2
; Johnny Alexander Tamayo-Arias3
.
1. Universidad del Quindío y Universidad Nacional de Colombia, Colombia. lmcastro@uniquindio.edu.co
2. Universidad del Quindío, Colombia. yccastro@uniquindio.edu.co.
3. Universidad Nacional de Colombia, Colombia. jatamayoar@unal.edu.co
* Autor de correspondencia: Lina María Castro Benavides, e-mail: lmcastro@uniquindio.edu.co
ÁREA DE CONOCIMIENTO: Ciencias Naturales y Exactas
ABSTRACT
The purpose of this articles is to identify errors related to management information systems through a Scientometric analysis to divulge the dynamics of the research topic to the academic community. The study was carried out, between 1971 and January 30, 2021, using the Scopus database and VOSviewer software. As a result of the search string “management information system” and “error*” or “mistakes” were obtained 826 published scientific articles. The highest percentage of documents published are conference paper (53.3%), and Article (39.7%). The most productive countries are the United States and Austria (60% articles) and citations are focused on United States (65%). The chronological analysis revealed that the scientific production in the area showed a particular increase from 2006 to 2009. The Lecture Notes in Computer Science. Lecture notes in Artificial Intelligence and Lecture Notes in Bioinformatics was the most productive journal. The 32.7% of the literature was published in the Computer Science field. 6 clusters were identified, and 19 keywords related with errors or mistakes were recognized. The Scientometric analysis accomplished allowed a descriptive analysis and identification of the countries, journals, keywords, sponsors, most cited articles, clustering the results facilitating the visual representation of the study.
Keywords: Scientometric; management information systems; mistake; error; fault.
RESUMEN
El propósito de este artículo es identificar errores relacionados con los sistemas de información de gestión a través de un análisis cienciométrico para divulgar la dinámica del tema de investigación a la comunidad académica. El estudio se realizó, entre 1971 y el 30 de enero de 2021, utilizando la base de datos Scopus y el software VOSviewer. Como resultado de la cadena de búsqueda “sistema de información de gestión” y “error*” o “errores” se obtuvieron 826 artículos científicos publicados. El mayor porcentaje de documentos publicados son artículos de congresos (53,3%) y artículos (39,7%). Los países más productivos son Estados Unidos y Austria (60% artículos) y las citas se centran en Estados Unidos (65%). El análisis cronológico reveló que la producción científica en el área mostró un aumento particular de 2006 a 2009. Las Notas de Lectura en Ciencias de la Computación. Lecture Notes in Artificial Intelligence y Lecture Notes in Bioinformatics fue la revista más productiva. El 32,7% de la literatura se publicó en el campo de las Ciencias de la Computación. Se identificaron 6 clústeres y se reconocieron 19 palabras clave relacionadas con errores o desaciertos. El análisis cienciométrico realizado permitió un análisis descriptivo e identificación de los países, revistas, palabras clave, patrocinadores, artículos más citados, agrupando los resultados facilitando la representación visual del estudio.
Palabras clave: Cienciometría; sistemas de información; equivocación; error; falla.
Introduction
To estimate the state-of-the-art of a given topic, researchers can turn to Scientometric a quantitative study of the disciplines of science based on published literature and communication indicators, and one of the most important measures for the assessment of scientific productions (Schubert, 2015). This could include identifying emerging areas of scientific research, examining the development of research over time, or geographic and organizational distributions of research (Schubert, 2015).
The framework of this research occurs in the context of information, which, with the help of new technologies, has been managed, providing solutions to any organization through management information systems. Information systems have evolved, in such a way that they provide timely and reliable information generated through their use; its quality, and veracity, will result in support in decision-making at the managerial level in organizations (Patricio et al., 2017). As stated by Prifti et al. (2020) a management information system (MIS) is a computerized database organized and programmed in such a way that it produces regular reports on operations for each level of management in an enterprise, also it can generate special reports easily from the system. Besides it is an applied field concentrating on strategic, managerial, and operational usage of various types of information technologies at societal, organizational, and individual levels. Also, according to Mohnaty (2014), it draws upon several reference disciplines such as cognitive psychology, computer science, behavioral science, decision science, economics, operation management, organization theory and engineering. The information displayed by MIS shows the “real” data versus the “expected” results and the results from the previous year, it measures progress against goals. The main input to a MIS is data from enterprise units and functions (Prifti et al., 2020) and the limitations and deficiencies in the process of management information system performance are the main reason for diminishing the efficiency of decision-making process in the organization (Prifti et al., 2020). In this sense, for a MIS to add value to organizations, it must address errors or inconsistencies that arise within the building phases of the information system cycle: planning, analysis, design, and implementation.
Moreover, the probable causes that generate errors and impact the processes in an organization must be identified. The errors in the information systems can occur in any phase, however, the errors that are identified in the production phase after the implementation of the IS, possibly are more complex to solve if they are due to an analysis and/or design. However, those generated by human factors, could determine its roots in the operation process (Salazar & Campos, 2009).
On the other hand, as stated by the author Nasa & Space (2004) the cost of solving an error increase significantly as the development of the software advances in its life cycle. It is important to consider that errors are frequently due to mistakes committed in early building phases, the lack of adequate standards in the development of software or bad programming practices. Leading in such a way to failures in the results of one or more processes, resulting in economic, technological, and even human loss.
In order to study and analyze the scientific trends that have been published in the area of management information systems and the related errors, a Scientometric analysis has been carried out.
Methodology
This Scientometric research is a general, retrospective, objective, reliable description, and not a partial review of a convenience sample, of the scientific production on errors related to MIS published from 1971 to 2021.
The following steps were necessary to perform the analysis:
Purpose
The present study has been undertaken with the following objective, to identify errors related to management information systems through a Scientometric analysis to divulge the dynamics of the research topic to the academic community.
Data source
The search was carried out through the Scopus electronic database, as it is one of the most relevant scientific information platforms that access the scientific databases and the most significant publications in the different areas of knowledge. Regarding management information systems issues. Additionally, this database allows searches in advanced structures by means of logical operators that conform to the specifications of the revision proposed in this investigation. As well as filtering tools that provide valuable information to the analysis by allowing to track, analyze and visualize the results of the research search and subsequent Scientometric analysis.
Search strategy
One of the relevant moments of a Scientometric analysis is the structured search strategy, since it must allow filtering the information available in the databases, so that the selected articles respond to the questions posed in the research, and consequently the objective set.
Articles identified by electronic searches were selected based on title, abstract, and keywords.
The structured search used to search the articles was TITLE-ABS-KEY (“management information system*” ) AND ( TITLE-ABS-KEY ( “mistake*” ) OR TITLE-ABS-KEY ( “error*” )
Data extraction and information analysis
This data collection process was developed in two stages:
Information Extraction: Once the search string described in section 2.2 has been executed, the database provided by Scopus is exported in CVS Excel format, including in this step all the fields: Citation information, Bibliographical information, Abstract & keywords, Funding details, other information. Next, the database extracted from Scopus was imported into VOSviewer to build and visualize the Scientometric networks by author, country, and keywords.
Data analysis: This step was carried out using the Scopus Scientometric analysis, as well as the analysis tools provided by VOSviewer.
Data analysis and discussion
The document search was carried out in Scopus, on January 30, 2021. The search string used was TITLE-ABS-KEY (“management information system *”) AND (TITLE-ABS-KEY (“mistake *”) OR TITLE-ABS-KEY (“error *”)), obtaining a total of 826 articles.
The results obtained and their analysis will be detailed below.
Number of articles per year since 1971 - current
Publications in the area have been viewed since 1971. In general, the number of documents published annually ranges from 1 to 25. However, a significant increase occurred in 2007, 2007 and 2008, so exceptionally, 125 articles were published.
Figure 1 shows the annual evolution of the publication of articles related to management information systems.
Figure 1. Number of articles per year since 1971- current
Articles published annually by source.
The main sources of publication in the area are ACM International conference Proceeding Series, MIS Quarterly Management Information Systems, Studies in Health Technology and Informatics, Transportation Research Record, Lecture Notes in Computer Science Including Subseries. Lecture notes in Artificial Intelligence and Lecture Notes in Bioinformatics. It should be noted that this last journal made a significant contribution to publication in 2008, and since 2011 it has not registered publications. Additionally, since 2017 the publications in the journal ACM stand out from the other journals. See figure 2.
Figure 2. Articles published annually by source. Source Scopus
Percentage of documents published by type.
It is identified that the highest percentage of documents published are through Conference Paper with a participation of 53.3% (440 articles), with 39.7% being publications through Article (328 articles published), Review with 2.9% participation (24 articles), Conference Reviews with 1.8% shared participation (15 articles), Book Chapter, Short Survey, Book, Note, Erratum and Report with less than 1% participation each one (19 articles).
Figure 3 shows the percentage of participation of the different types of publication related to errors in management information systems.
Figure 3. Percentage of documents published by type. Source Scopus
Percentage of publication of Documents in the Knowledge Areas.
It is identified that 32.7% of the publications belong to Computer Science areas, being the largest producer, followed by 23.9% to engineering area, 6.8% to Medicine, 5.7% to Business Management, 5.4% to Mathematics area, 4.8% to Decision Science, 4.8% to Social Sciences, 4.5% to Environmental Science, 2.1% to Earth and planet, 1.8% to Materials Science and finally 10.3% to other areas of knowledge.
The following figure 4 shows the percentage of participation in the publication of documents that refer to errors in the MIS mentioned by different areas of knowledge.
Figure 4. Percentage of publication of Documents in the Knowledge Areas. Source Scopus
Documents published by countries or territories.
The 15 countries with the highest number of publications related to errors in information systems is the United States with a total of 240 article, China with a contribution of 80 article, 40 articles to Germany, 35 articles to United Kingdome, 30 articles to South Korea, 25 articles to Canada and Taiwan, 20 articles to Japan, 18 articles to India and 15 articles to France approximately.
Figure 5 shows the 15 countries with the highest number of publications related to errors and MIS.
Figure 5. Documents published by countries. Source Scopus
Main sponsors of the publications
The main sponsor to the publication of these articles is the National Science Foundation, with almost 17 publications. Followed by the European Commission with around 4 articles. Then, Deutche Forschungsgemeinschaft, Fundacao para a Ciencia a Tecnologia, National Aeronautics and Space Administration, Office of Naval Research, sponsoring 3 articles. Finally, Conselho nacional de Desenvolvimento, Coordinates of Aperfeicoamento, Horizon 2020 Framework Program, Natural Sciences and Engineering Research, supporting 2 articles. See figure 6.
Figure 6. Main sponsors of the publications. Source Scopus
Keywords
From the Scopus database were extracted the main 15 list of keywords, evidencing the occurrences and the link strength they present. For which the keyword “management information systems” obtained a total of 653 occurrences and a link strength of 4682, followed by “information systems” with an occurrence of 170 and a link strength of 1287. For the case of “error analysis” presented a total of 65 occurrences and a link strength of 585 are evidenced. See Table I to review other keywords.
Table I. Keywords. Source VOSViewer
|
Keyword |
Occurrences |
Total link strength |
|
Management information systems |
653 |
4682 |
|
Information systems |
170 |
1287 |
|
Information management |
144 |
1181 |
|
Administrative data processing |
108 |
1030 |
|
Human |
62 |
777 |
|
Article |
64 |
762 |
|
Humans |
54 |
740 |
|
Decision support systems |
65 |
677 |
|
Information systems |
65 |
654 |
|
Database systems |
82 |
629 |
|
Decision making |
62 |
628 |
|
Error analysis |
65 |
585 |
|
Systems analysis |
81 |
564 |
|
Artificial intelligence |
53 |
552 |
|
Information science |
70 |
503 |
|
Errors |
54 |
480 |
|
Computer networks |
51 |
472 |
|
Information use |
55 |
416 |
|
United states |
38 |
403 |
|
Organization and management |
33 |
381 |
The most frequently used terms are “management information systems”, “information systems”, “information management”, “administrative data processing”, “human”, “article”, “humans”, “decision support systems”, “information system”, “database systems”, “decision making”, “error analysis”. These topics are broadly part of the domain in information systems. See Figure 7.
Figure 7. Word cloud
Management Information systems, and mistakes or errors
The network features 410 keyword nodes (circles); 13418 links; 6 clusters represented by the strongest relationships between keywords (different colors). Among the clusters, those related to management information systems, the information systems applications mainly focused on the health area, administrative data processing, in decision-making, and industry 4.0-technology, stand out. The size of the circles and the font represents the weight of the keywords in the articles, the word “Management Information System” being of greater importance, see Figure 8 shows the clusters identified.
Figure 8. Keywords Network Visualization. VOSViewer
The overlay display in Figure 9 shows the same information as Figure 8, but the colors depend on the score based on the publication date of the article. Most of the keywords were included in articles between 2000 and 2015. The blue color of the keyword “Management information systems” corresponds to a year around 2005, while very few keywords correspond to recent years.
Figure 9. Keywords BD Web of science analysis Illustration. Source Vosviewer
This density map allows visualizing the terms that have been most related and addressed by the authors, standing out in the warm areas, in this case the yellow ones, the words “management information systems”, “information systems” “information science”, “administrative data processing”, “error analysis”, “human” among others. Additionally, the closeness of these terms shows the connection that has occurred between them in the different articles. The other areas represent terms that has less relationships in the articles and tend to lighter colors such as lemon green, in the case of words such as “information technology”, “risk assessment”, “computational complexity”, “quality control”, among others. Then, the blue tones indicate that there are very few articles that relate these keywords, for example, the case of “work simplification”, “data flow”, “medication errors”, “artificial neural network”, and “decision support”. See Figure 10.
Figure 10. Density map. Source Vosviewer
Citation of articles
The Table II and Figure 11 list the main countries that have contributed the largest number of articles to the body of knowledge and citations in the area. Although the first three places in the publication of articles are reserved for the United States, Austria, and China, these differ, except for the United States, of the countries with the highest number of citations, which are the United States, Canada, and Germany.
Table II. Publication and citation of articles by country
|
Países |
Artículos |
Citaciones |
|
United States |
238 |
9143 |
|
Canada |
26 |
1187 |
|
Germany |
41 |
1108 |
|
Netherlands |
11 |
657 |
|
Australia |
16 |
559 |
|
Taiwan |
24 |
336 |
|
Hong Kong |
10 |
249 |
|
United Kingdom |
36 |
206 |
|
China |
79 |
195 |
|
Greece |
9 |
175 |
|
Austria |
238 |
94 |
|
Switzerland |
9 |
86 |
|
France |
17 |
66 |
|
Brazil |
16 |
57 |
|
Portugal |
16 |
29 |
Figure 11. Article and citations percentage
Figure 12 displays the relationship that has occurred between countries thanks to the co-authorship presented in the different published articles. Co-authorship between the United States, Canada, Germany, and the Netherlands stands out.
Figure 12. List of publications between countries
The most cited article is Specification of formative constructs in information systems research: MIS Quarterly: Management Information Systems. Volume 31, Issue 4, December 2007, Pages 623-656. Petter, S. Straub, D. Rai, A. Information Systems and Quantitative Analysis.
The following Table III consolidates the most cited articles.
Table III The most cited articles. Source Scopus
|
Article |
Year of publication |
Total Citations |
|
Specifying formative constructs in information systems research |
2007 |
1760 |
|
The Identity Crisis Within the IS Discipline: Defining and Communicating the Discipline’s Core Properties |
2003 |
924 |
|
ADEPT Supporting dynamic changes of workflows |
1998 |
653 |
|
Discovering models of software processes from event-based data |
1998 |
650 |
|
In pursuit of moderation: Nine common errors and their solutions |
2003 |
370 |
|
Inheritance of Workflows: An Approach to Tackling Problems Related to Change |
2002 |
348 |
|
PLS: A silver bullet? |
2006 |
343 |
|
The Information Systems Identity Crisis: Focusing on High-Visibility and High-Impact Research |
2005 |
282 |
|
Identifying reasons for software changes using historic databases |
2000 |
278 |
|
High speed and robust event correlation |
1996 |
274 |
|
A comparison of spacing and headway control laws for automatically controlled vehicles |
1994 |
244 |
|
Total citations |
14060 |
The most cited article is Specifying formative constructs in information systems research. MIS Quarterly: Management Information Systems. Volume 31, Issue 4, December 2007, Pages 623-656, by Petter, S. Straub, D. Rai, in the Journal A. Information Systems and Quantitative Analysis.
Conclusions
The keywords that present the highest frequency and weight are management information systems, information systems, information management, administrative data processing, unlike errors, which although they appear related in the keywords, it is evident that there is still a lack of studies that analyze the relationship between these two concepts.
The country that has made the largest contribution to the body of knowledge on information management systems is the United States, both in its number of publications and citations.
The most cited article is “Specifying formative constructs in information systems research” (Article) (Open Access). MIS Quarterly: Management Information Systems. Volume 31, Issue 4, December 2007, Pages 623-656. Petter, S. Straub, D. Rai, A. Information Systems and Quantitative Analysis. Report 1760 citations.
Six clusters represented by the strongest relationships between keywords were consolidated. The clusters considered are the first cluster management information systems-computer science (116 items), the cluster health field (85 items), information systems and computational environment applications (76 items), administrative data processing (57 items), decision-making (38 items), and technology industry 4.0 (38 items). The relevant keywords associated with errors or mistakes are error correction, error detection, failure analysis, fault detection, fault tolerance, fault tolerant computer, human errors, medical error, medical errors, medication error, medication errors, error statistics, estimation errors, error analysis, error rate, error rates, errors, missing data, and human error.
The main contributor to the publication of these articles is the National Science Foundation.
The highest percentage of documents published are through conference paper with a participation of 53.3% (440 documents), with 39.7% being publications through Article (328 articles published).
About 55% of the published articles have been studied in the areas of Computer Science and Engineering. The other documents have been published in areas such as Medicine, Business Management, Mathematics, and Decision Science, Social Sciences, and Environmental science, Earth and planet, Materials Science with participation and other areas of knowledge.
It is important to consolidate the Scientometric analysis exploring other scientific databases.
REFERENCIAS
Mohanty, B. (2014). “Management Information Systems Quarterly (MISQ): A bibliometric study”. Library Philosophy and Practice, 2014(1)
Nasa, A., & Space, J. “Error Cost Escalation Through the Project Life Cycle”. Topics NASA Technical Reports Server (NTRS). https://ntrs.nasa.gov/api/citations/20100036670/downloads/20100036670.pdf. 2004.
Patricio, J., Fernández, T., Gustavo, J., Mendoza, G., Fernando, R., Alvear, H., Abcarius, J. J., Humberto, M., Páez, M., & Lorenzo, A. F. “Gestión de la información como herramienta para la toma de decisiones en salud : escenarios”. 2017.
Prifti, V., Markja, I., Dhoska, K., & Pramono, A. (2020). “Management of information systems, implementation and their importance in Albanian enterprises Management of information systems, implementation and their importance in Albanian enterprises”. December. https://doi.org/10.1088/1757-899X/909/1/012047
Salazar, J. B., & Campos, P. G. “Modelo para seguridad de la información en TIC. CEUR Workshop Proceedings”. 2009: 488, 234–253.
Schubert, A. (2015). “Scientometrics : The Research Field and Its Journal”. January 2001. https://doi.org/10.1007/978-94-010-0666-8