Towards a Methodology for Developing Evidence-Informed Management Knowledge by Means of Systematic Review
TL;DR: In this article, the authors evaluate the process of systematic review used in the medical sciences to produce a reliable knowledge stock and enhanced practice by developing context-sensitive research and highlight the challenges in developing an appropriate methodology.
Abstract: Undertaking a review of the literature is an important part of any research project. The researcher both maps and assesses the relevant intellectual territory in order to specify a research question which will further develop the knowledge hase. However, traditional 'narrative' reviews frequently lack thoroughness, and in many cases are not undertaken as genuine pieces of investigatory science. Consequently they can lack a means for making sense of what the collection of studies is saying. These reviews can he hiased by the researcher and often lack rigour. Furthermore, the use of reviews of the available evidence to provide insights and guidance for intervention into operational needs of practitioners and policymakers has largely been of secondary importance. For practitioners, making sense of a mass of often-contrad ictory evidence has hecome progressively harder. The quality of evidence underpinning decision-making and action has heen questioned, for inadequate or incomplete evidence seriously impedes policy formulation and implementation. In exploring ways in which evidence-informed management reviews might be achieved, the authors evaluate the process of systematic review used in the medical sciences. Over the last fifteen years, medical science has attempted to improve the review process hy synthesizing research in a systematic, transparent, and reproducihie manner with the twin aims of enhancing the knowledge hase and informing policymaking and practice. This paper evaluates the extent to which the process of systematic review can be applied to the management field in order to produce a reliable knowledge stock and enhanced practice by developing context-sensitive research. The paper highlights the challenges in developing an appropriate methodology.
Citations
More filters
TL;DR: In this paper, a cumulative body of knowledge about entrepreneurship orientation has been collected and used in the context of entrepreneurship research, with the focus on entrepreneurship orientation (EO) being one of the few areas in entrepreneurship research where a cumulative knowledge base is available.
Abstract: Entrepreneurial orientation (EO) has received substantial conceptual and empirical attention, representing one of the few areas in entrepreneurship research where a cumulative body of knowledge i ...
2,764 citations
TL;DR: This paper discusses literature review as a methodology for conducting research and offers an overview of different types of reviews, as well as some guidelines to how to both conduct and evaluate a literature review paper.
Abstract: Knowledge production within the field of business research is accelerating at a tremendous speed while at the same time remaining fragmented and interdisciplinary. This makes it hard to keep up with state-of-the-art and to be at the forefront of research, as well as to assess the collective evidence in a particular area of business research. This is why the literature review as a research method is more relevant than ever. Traditional literature reviews often lack thoroughness and rigor and are conducted ad hoc, rather than following a specific methodology. Therefore, questions can be raised about the quality and trustworthiness of these types of reviews. This paper discusses literature review as a methodology for conducting research and offers an overview of different types of reviews, as well as some guidelines to how to both conduct and evaluate a literature review paper. It also discusses common pitfalls and how to get literature reviews published.
2,729 citations
TL;DR: In this article, a systematic review of literature published over the past 27 years, synthesize various research perspectives into a comprehensive multi-dimensional framework of organizational innovation - linking leadership, innovation as a process, and innovation as an outcome.
Abstract: This paper consolidates the state of academic research on innovation. Based on a systematic review of literature published over the past 27 years, we synthesize various research perspectives into a comprehensive multi-dimensional framework of organizational innovation - linking leadership, innovation as a process, and innovation as an outcome. We also suggest measures of determinants of organizational innovation and present implications for both research and managerial practice.
2,414 citations
TL;DR: In this article, the authors introduce the bibliometric methods of citation analysis, co-citation analysis, bibliographical coupling, coauthor analysis, and co-word analysis for mapping research specialties.
Abstract: We aim to develop a meaningful single-source reference for management and organization scholars interested in using bibliometric methods for mapping research specialties. Such methods introduce a measure of objectivity into the evaluation of scientific literature and hold the potential to increase rigor and mitigate researcher bias in reviews of scientific literature by aggregating the opinions of multiple scholars working in the field. We introduce the bibliometric methods of citation analysis, co-citation analysis, bibliographical coupling, co-author analysis, and co-word analysis and present a workflow for conducting bibliometric studies with guidelines for researchers. We envision that bibliometric methods will complement meta-analysis and qualitative structured literature reviews as a method for reviewing and evaluating scientific literature. To demonstrate bibliometric methods, we performed a citation and co-citation analysis to map the intellectual structure of the Organizational Research Methods j...
1,916 citations
TL;DR: A comprehensive review on Industry 4.0 is conducted and presents an overview of the content, scope, and findings by examining the existing literatures in all of the databases within the Web of Science.
Abstract: Originally initiated in Germany, Industry 4.0, the fourth industrial revolution, has attracted much attention in recent literatures. It is closely related with the Internet of Things (IoT), Cyber Physical System (CPS), information and communications technology (ICT), Enterprise Architecture (EA), and Enterprise Integration (EI). Despite of the dynamic nature of the research on Industry 4.0, however, a systematic and extensive review of recent research on it is has been unavailable. Accordingly, this paper conducts a comprehensive review on Industry 4.0 and presents an overview of the content, scope, and findings of Industry 4.0 by examining the existing literatures in all of the databases within the Web of Science. Altogether, 88 papers related to Industry 4.0 are grouped into five research categories and reviewed. In addition, this paper outlines the critical issue of the interoperability of Industry 4.0, and proposes a conceptual framework of interoperability regarding Industry 4.0. Challenges and trends for future research on Industry 4.0 are discussed.
1,906 citations
References
More filters
Book•
01 Jan 1994
TL;DR: The authors argued that the ways in which knowledge is produced are undergoing fundamental changes at the end of the twentieth century and that these changes mark a distinct shift into a new mode of knowledge production which is replacing or reforming established institutions, disciplines, practices and policies.
Abstract: In this provocative and broad-ranging work, a distinguished team of authors argues that the ways in which knowledge scientific, social and cultural is produced are undergoing fundamental changes at the end of the twentieth century. They claim that these changes mark a distinct shift into a new mode of knowledge production which is replacing or reforming established institutions, disciplines, practices and policies. Identifying a range of features of the new moder of knowledge production reflexivity, transdisciplinarity, heterogeneity the authors show the connections between these features and the changing role of knowledge in social relations. While the knowledge produced by research and development in science and technology (both public and industrial) is accorded central concern, the authors also outline the changing dimensions of social scientific and humanities knowledge and the relations between the production of knowledge and its dissemination through education. Placing science policy and scientific knowledge in its broader context within contemporary societies, this book will be essential reading for all those concerned with the changing nature of knowledge, with the social study of science, with educational systems, and with the relations between R&D and social, economic and technological development.
7,486 citations
TL;DR: The meta-analysis of research as discussed by the authors is an important feature of the research and evaluation enterprise, and it has been widely used in the field of computer science and computer engineering, especially in the context of education.
Abstract: M y subject is data analysis at three levels. Primary analysis is the original analysis of data in a research study. It is what one typically imagines as the application of statistical methods. Secondary analysis is the re-analysis of data for the purpose of answering the original research question with better statistical techniques, or answering new questions with old data. Secondary analysis is an important feature of the research and evaluation enterprise. Tom Cook (1974) at Northwestern University has written about its purposes and methods. Some of our best methodologists have pursued secondary analyses in such grand style that its importance has eclipsed that of the primary analysis. We can cite with pride some state of the art documents: the MostellerMoynihan secondary analysis of the Coleman study; the Campbell-Erlebacher analysis of the Ohio-Westinghouse Headstart evaluation; and the Elashoff-Snow secondary analysis of Pygmalion in the Classroom, to name three. About all that can effectively be done to insure that secondary analyses of important studies are carried out is to see that the data from the original studies are preserved and that secondary analyses are funded. The preservation of original data could improve. Last month, one of our graduate students, Karl White, spent 15 hours and made 30 phone calls attempting to obtain from the government a copy of the data tapes for the Coleman study only to learn in the end that they had been irretrievably filed in unmarked tape cannisters with some 2,000 other unmarked data tapes. Tom Cook remarked in an Annual Meeting symposium on secondary analysis that you can get the data if you have chutzpah or if you're socio metrically well-connected. The whole business is too important to be treated so casually. On the other extreme, one can point with satisfaction to the ready availability to any researcher of the data tapes from Project TALENT or the National Assessment of Educational Progress. Others are advancing the practice of secondary analysis. My major interest currently is in what we have come to call—not for want of a less pretentious name—the meta-analysis of research. The term is a bit grand, but it is precise, and apt, and in the spirit of "metamathematics," "meta-psychology," and "meta-evaluation." Meta-analysis refers to the analysis of analyses. I use it to refer to the statistical analysis of a large collection of analysis results from individual studies for the purpose of integrating the findings. It connotes a rigorous alternative to the casual, narrative discussions of research studies which typify our attempts to make sense of the rapidly expanding research literature. The need for the meta-analysis of research is clear. The literature on dozens of topics in education is growing at an astounding rate. In five years time, researchers can produce literally hundreds of studies on IQ and creativity, or impulsive vs. reflective cognitive styles, or any other topic.
4,509 citations
Book•
01 Jan 2001
TL;DR: This book discusses the evolution of Science and Society, the transformation of Knowledge Institutions, and the role of Universities in Knowledge Production.
Abstract: Preface. Chapter 1: The Transformation of Society. Chapter 2: Beyond Modernity -- Breaching the Frontiers. Chapter 3: The Co--Evolution of Science and Society. Chapter 4: The Context Speaks Back. Chapter 5: The Transformation of Knowledge Institutions. Chapter 6: The Role of Universities in Knowledge Production. Chapter 7: How does Contextualization Happen?. Chapter 8: Weakly Contextualized Knowledge. Chapter 9: Strongly Contextualized Knowledge. Chapter 10: Contextualization in the Middle Range. Chapter 11: From Reliable Knowledge to Socially Robust Knowledge. Chapter 12: The Epistemological Core?. Chapter 13: Science Moves to the Agora. Chapter 14: Socially Distributed Expertise. Chapter 15: Re--Visioning Science. Chapter 16: Re--Thinking Science is not Science Re--Thought. References. Index
3,513 citations
TL;DR: Two views of how qualitative methods might be judged are outlined and it is argued that qualitative research can be assessed according to two broad criteria: validity and relevance.
Abstract: This is the first in a series of three articles
In the past decade, qualitative methods have become more commonplace in areas such as health services research and health technology assessment, and there has been a corresponding rise in the reporting of qualitative research studies in medical and related journals.1 Interest in these methods and their wider exposure in health research has led to necessary scrutiny of qualitative research. Researchers from other traditions are increasingly concerned to understand qualitative methods and, most importantly, to examine the claims researchers make about the findings obtained from these methods.
The status of all forms of research depends on the quality of the methods used. In qualitative research, concern about assessing quality has manifested itself recently in the proliferation of guidelines for doing and judging qualitative work.2–5 Users and funders of research have had an important role in developing these guidelines as they become increasingly familiar with qualitative methods, but require some means of assessing their quality and of distinguishing “good” and “poor” quality research. However, the issue of “quality” in qualitative research is part of a much larger and contested debate about the nature of the knowledge produced by qualitative research, whether its quality can legitimately be judged, and, if so, how. This paper cannot do full justice to this wider epistemological debate. Rather it outlines two views of how qualitative methods might be judged and argues that qualitative research can be assessed according to two broad criteria: validity and relevance.
#### Summary points
Qualitative methods are now widely used and increasingly accepted in health research, but quality in qualitative research is a mystery to many health services researchers
There is considerable debate over the nature of the knowledge produced by such methods and how such research should be judged
Antirealists argue …
3,075 citations
Book•
28 Dec 2001TL;DR: In this article, the authors discuss academic disciplines overlaps, boundaries and specialisms aspects of community life patterns of communication academic careers and the wider context implications for theory and practice in the context of communication.
Abstract: Points of departure academic disciplines overlaps, boundaries and specialisms aspects of community life patterns of communication academic careers the wider context implications for theory and practice. Appendix: research issues.
2,981 citations