scispace - formally typeset
Search or ask a question
Journal ArticleDOI

Quality in Interpretive Engineering Education Research: Reflections on an Example Study

01 Oct 2013-Journal of Engineering Education (John Wiley & Sons, Ltd)-Vol. 102, Iss: 4, pp 626-659
TL;DR: In this paper, the authors present reflections on challenges to research quality in an example interpretive engineering education study, and offer a quality framework that emerged from this study as a coherent, discipline-specific view on interpretive research quality.
Abstract: Background The emerging discipline of engineering education research is increasingly embracing a diverse range of interpretive research methods, whose adoption is characterized by a lack of coherent ways to conceptualize, communicate, and judge the quality of interpretive inquiries. Yet fields that have traditionally employed these methods do not offer a consensus about research quality. Purpose This article presents reflections on challenges to research quality in an example interpretive engineering education study, and offers a quality framework that emerged from this study as a coherent, discipline-specific view on interpretive research quality. Design/Method Analysis of the prior study of engineering students' competency formation by the author(s) is combined with a synthesis of the literature from the broad intellectual traditions of the interpretive paradigm to inform the development of a theoretical framework of research quality. Results Drawing on the engineering metaphor of quality management, we propose a systematic, process-oriented framework of research quality along two dimensions: a process model locates quality strategies throughout the research process, and a typology systemizes fundamental aspects of validation (theoretical, procedural, communicative, and pragmatic) and the concept of process reliability to explicate quality strategies in their fundamental contribution to substantiating knowledge claims. Conclusion The quality framework provides a way to develop and demonstrate overall research quality in the interpretive inquiry by shifting attention away from assessing the research quality of a final product. Rather, the framework provides guidance to systematically document and explicitly demonstrate quality considerations throughout the entire research process.
Citations
More filters
Posted Content
TL;DR: Deming's theory of management based on the 14 Points for Management is described in Out of the Crisis, originally published in 1982 as mentioned in this paper, where he explains the principles of management transformation and how to apply them.
Abstract: According to W. Edwards Deming, American companies require nothing less than a transformation of management style and of governmental relations with industry. In Out of the Crisis, originally published in 1982, Deming offers a theory of management based on his famous 14 Points for Management. Management's failure to plan for the future, he claims, brings about loss of market, which brings about loss of jobs. Management must be judged not only by the quarterly dividend, but by innovative plans to stay in business, protect investment, ensure future dividends, and provide more jobs through improved product and service. In simple, direct language, he explains the principles of management transformation and how to apply them.

9,241 citations

Journal ArticleDOI
TL;DR: In this article, the authors developed an expanded view of how STEAM might enrich engineering education in ways that more closely align with the pedagogical commitments of the arts, drawing on the first two authors' engagement in an interdisciplinary design studio.
Abstract: Background There is a growing interest in STEAM (STEM + the Arts) education as a means to enhance the creativity of STEM students and broaden interest in STEM fields. Many art educators, however, object to the instrumental justification for study in the arts as a way to improve student performance in other areas. Purpose Drawing on the first two authors' engagement in an interdisciplinary design studio, this study develops an expanded view of how STEAM might enrich engineering education in ways that more closely align with the pedagogical commitments of the arts. Design/Method This article is written as a collaborative autoethnography between the first two authors, educators in environmental engineering and art education, respectively. The study is grounded in the educational philosophy of arts advocate Maxine Greene, who views learning as an active, collaborative search for meaning, “wide-awakeness,” and social change. Results Our dialogue reveals the potential for STEAM to provide students and educators with opportunities to explore personally relevant connections between materials, design, society, and the natural environment and to critically engage with implicit and explicit facets of disciplinary identity. Conclusions This view of STEAM simultaneously complements and challenges current conceptions of this emerging educational movement that, almost without exception, are underpinned by calls for competitive economic growth and technological development. We hope future research will build on our perspectives to continue a conversation about STEAM that considers the diverse contributions of, and mutual benefits to, all parties involved.

101 citations


Cites background from "Quality in Interpretive Engineering..."

  • ...This flexible, yet purposeful and systematic process of iteratively developing both process and product was underpinned by our understanding of procedural validation (Walther et al., 2013), which served to promote the robustness and authenticity of our process of co-constructing a shared understanding of our experiences of teaching and learning in a STEAM setting....

    [...]

  • ...…some of the more vulnerable sides of our disciplinary and transdisciplinary selves, an effort that contributed to our capturing of “the full extent of the social reality . . . of interest” (Walther et al., 2013, p. 641), which Walther et al. describe as the foundation for theoretical validation....

    [...]

  • ...Specifically, we discussed at length ways to construct our findings within the “meaning conventions” (Walther et al., 2013, p. 646) of the engineering education research community (see discussion of communicative validation on pp. 645–647)....

    [...]

  • ...…purposeful and systematic process of iteratively developing both process and product was underpinned by our understanding of procedural validation (Walther et al., 2013), which served to promote the robustness and authenticity of our process of co-constructing a shared understanding of our…...

    [...]

BookDOI
01 Feb 2019
TL;DR: The Computer Education Handbook as mentioned in this paper describes the extent and shape of computing education research today and provides an authoritative introduction to the field and is essential reading for policy makers, as well as both new and established researchers.
Abstract: This Handbook describes the extent and shape of computing education research today. Over fifty leading researchers from academia and industry (including Google and Microsoft) have contributed chapters that together define and expand the evidence base. The foundational chapters set the field in context, articulate expertise from key disciplines, and form a practical guide for new researchers. They address what can be learned empirically, methodologically and theoretically from each area. The topic chapters explore issues that are of current interest, why they matter, and what is already known. They include discussion of motivational context, implications for practice, and open questions which might suggest future research. The authors provide an authoritative introduction to the field and is essential reading for policy makers, as well as both new and established researchers.

95 citations

Journal ArticleDOI
TL;DR: The authors explored the meaning in the relationship between engineering cultural practices and the funds of knowledge found in Latina/o adolescents' familial, community, and recreational settings, and developed a coding scheme that categorized the participants' funds as they related to engineering.
Abstract: Background According to a growing body of research, many Latinas/os experience dissonance between their everyday cultural practices and the cultural practices prevalent in engineering. This dissonance contributes to many Latinas/os' sense that engineering is “not for me.” Purpose This study sought to explore the meaning in the relationship between engineering cultural practices and the funds of knowledge found in Latina/o adolescents' familial, community, and recreational settings. Design/Method This ethnographic study followed seven groups of Latina/o adolescents as they identified problems in their communities and solved them through engineering design processes. Using a modified form of constant comparative analysis, we analyzed three data sources: individual interviews, observations of group meetings, and concurrent or retrospective protocols. We developed a coding scheme that categorized the participants' funds of knowledge as they related to engineering. Results The participants' everyday skills and bodies of knowledge aligned with engineering practices. Specifically, their familial, community, and recreational funds of knowledge mapped onto the application of engineering design processes, systems thinking, ethical and empathetic reasoning, knowledge of production and processing, use of communication and construction tools, scientific and mathematical knowledge, and teamwork. Conclusions Engineering instruction for Latina/o adolescents can be reconceptualized as a third space of learning and knowing where adolescents' everyday familial, community, and recreational practices are actively solicited and connected with the cultural practices of engineering.

90 citations


Cites methods from "Quality in Interpretive Engineering..."

  • ...To ensure quality during the first stage, the first author provided professional development on data collection methods (Walther et al., 2013) to the second and third authors, who were graduate Latina/o Adolescents’ Funds of Knowledge Related to Engineering 287...

    [...]

  • ...To ensure quality during the first stage, the first author provided professional development on data collection methods (Walther et al., 2013) to the second and third authors, who were graduate students at the time of the study....

    [...]

Book ChapterDOI
01 Feb 2019

83 citations

References
More filters
Book
12 Oct 2017
TL;DR: The Discovery of Grounded Theory as mentioned in this paper is a book about the discovery of grounded theories from data, both substantive and formal, which is a major task confronting sociologists and is understandable to both experts and laymen.
Abstract: Most writing on sociological method has been concerned with how accurate facts can be obtained and how theory can thereby be more rigorously tested. In The Discovery of Grounded Theory, Barney Glaser and Anselm Strauss address the equally Important enterprise of how the discovery of theory from data--systematically obtained and analyzed in social research--can be furthered. The discovery of theory from data--grounded theory--is a major task confronting sociology, for such a theory fits empirical situations, and is understandable to sociologists and laymen alike. Most important, it provides relevant predictions, explanations, interpretations, and applications. In Part I of the book, "Generation Theory by Comparative Analysis," the authors present a strategy whereby sociologists can facilitate the discovery of grounded theory, both substantive and formal. This strategy involves the systematic choice and study of several comparison groups. In Part II, The Flexible Use of Data," the generation of theory from qualitative, especially documentary, and quantitative data Is considered. In Part III, "Implications of Grounded Theory," Glaser and Strauss examine the credibility of grounded theory. The Discovery of Grounded Theory is directed toward improving social scientists' capacity for generating theory that will be relevant to their research. While aimed primarily at sociologists, it will be useful to anyone Interested In studying social phenomena--political, educational, economic, industrial-- especially If their studies are based on qualitative data.

53,267 citations


"Quality in Interpretive Engineering..." refers background or methods in this paper

  • ...Additionally, the various strategies of cross-checking to support the process of “constant comparison” (Glaser, 1969; Glaser & Strauss, 1967) were standardized and employed regularly in the development of the categories....

    [...]

  • ...The iterations of the constant comparative method include “(1) comparing incidents applicable to each category, (2) integrating categories and their properties, (3) delimitating the theory, and (4) writing the theory” (Glaser & Strauss, 1967, p. 105)....

    [...]

  • ...…several authors have suggested strategies such as “purposive sampling” (Lincoln & Guba, 1985, p. 40) or “theoretical sampling” (Flick, 2007; Glaser & Strauss, 1967) that increase “the likelihood that the full array of multiple realities will be uncovered” (Lincoln & Guba, 1985, p. 40)....

    [...]

  • ...Glaser and Strauss (1967) and Glaser (1969) formalize this process as the “constant comparative method” by which “researchers engage in detailed analytic processes that require repeated confirmations of potential explanatory patterns discovered in the data” (Hatch, 2002, p. 26)....

    [...]

Book
12 Jan 1994
TL;DR: This book presents a step-by-step guide to making the research results presented in reports, slideshows, posters, and data visualizations more interesting, and describes how coding initiates qualitative data analysis.
Abstract: Matthew B. Miles, Qualitative Data Analysis A Methods Sourcebook, Third Edition. The Third Edition of Miles & Huberman's classic research methods text is updated and streamlined by Johnny Saldana, author of The Coding Manual for Qualitative Researchers. Several of the data display strategies from previous editions are now presented in re-envisioned and reorganized formats to enhance reader accessibility and comprehension. The Third Edition's presentation of the fundamentals of research design and data management is followed by five distinct methods of analysis: exploring, describing, ordering, explaining, and predicting. Miles and Huberman's original research studies are profiled and accompanied with new examples from Saldana's recent qualitative work. The book's most celebrated chapter, "Drawing and Verifying Conclusions," is retained and revised, and the chapter on report writing has been greatly expanded, and is now called "Writing About Qualitative Research." Comprehensive and authoritative, Qualitative Data Analysis has been elegantly revised for a new generation of qualitative researchers. Johnny Saldana, The Coding Manual for Qualitative Researchers, Second Edition. The Second Edition of Johnny Saldana's international bestseller provides an in-depth guide to the multiple approaches available for coding qualitative data. Fully up-to-date, it includes new chapters, more coding techniques and an additional glossary. Clear, practical and authoritative, the book: describes how coding initiates qualitative data analysis; demonstrates the writing of analytic memos; discusses available analytic software; suggests how best to use the book for particular studies. In total, 32 coding methods are profiled that can be applied to a range of research genres from grounded theory to phenomenology to narrative inquiry. For each approach, Saldana discusses the method's origins, a description of the method, practical applications, and a clearly illustrated example with analytic follow-up. A unique and invaluable reference for students, teachers, and practitioners of qualitative inquiry, this book is essential reading across the social sciences. Stephanie D. H. Evergreen, Presenting Data Effectively Communicating Your Findings for Maximum Impact. This is a step-by-step guide to making the research results presented in reports, slideshows, posters, and data visualizations more interesting. Written in an easy, accessible manner, Presenting Data Effectively provides guiding principles for designing data presentations so that they are more likely to be heard, remembered, and used. The guidance in the book stems from the author's extensive study of research reporting, a solid review of the literature in graphic design and related fields, and the input of a panel of graphic design experts. Those concepts are then translated into language relevant to students, researchers, evaluators, and non-profit workers - anyone in a position to have to report on data to an outside audience. The book guides the reader through design choices related to four primary areas: graphics, type, color, and arrangement. As a result, readers can present data more effectively, with the clarity and professionalism that best represents their work.

41,986 citations


"Quality in Interpretive Engineering..." refers background in this paper

  • ...…above is, in principle, congruent to alternative criteria, and some authors suggest that a relatively clear mapping can be achieved between different types of validity and reliability and the concepts of confirmability, transferability, credibility, and dependability (Miles & Huberman, 1994)....

    [...]

  • ...The application of research results from one setting to another has been conceptualized as “transferability” (Miles & Huberman, 1994) or “applicability” (Lincoln & Guba, 1985)....

    [...]

  • ...For the purpose of establishing communicative validity with the respondents beyond the data-gathering situation, the literature offers various strategies for respondent validation (Maxwell, 2005; Miles & Huberman, 1994)....

    [...]

Book
01 Jan 1998
TL;DR: Creswell as mentioned in this paper explores the philosophical underpinnings, history and key elements of five qualitative inquiry traditions: biography, phenomenology, grounded theory, ethnography and case study.
Abstract: This book explores the philosophical underpinnings, history and key elements of five qualitative inquiry traditions: biography, phenomenology, grounded theory, ethnography and case study. John W Creswell relates research designs to each of the traditions of inquiry and compares each of the research strategies for theoretical frameworks, writing introduction to studies, collecting data, analyzing data, writing the narrative, and employing standards of quality and verifying results. Five journal articles in the appendix offer fascinating reading as well as examples of the five different qualitative designs.

23,020 citations


"Quality in Interpretive Engineering..." refers background or methods in this paper

  • ...…criteria may, however, be problematic if engineering education researchers were to implicitly strive for a quantifiable standard or if these concepts were translated into a toolbox approach that advocates the use of a minimum number of methods (Creswell, 1998; Leydens et al., 2004) to ensure rigor....

    [...]

  • ...In the example study, the natural setting (Lincoln & Guba, 1985), as a criterion for research quality, was achieved through strategies such as prolonged interaction with participants (Creswell, 1998) and the establishing of a good rapport (Glesne & Peshkin, 1992)....

    [...]

  • ...The adoption of alternative criteria may, however, be problematic if engineering education researchers were to implicitly strive for a quantifiable standard or if these concepts were translated into a toolbox approach that advocates the use of a minimum number of methods (Creswell, 1998; Leydens et al., 2004) to ensure rigor....

    [...]