National Science Education Standards

This paper is based on the premises that the purpose of engineering education is to graduate engineers who can design, and that design thinking is complex. The paper begins by briefly reviewing the history and role of design in the engineering curriculum. Several dimensions of design thinking are then detailed, explaining why design is hard to learn and harder still to teach, and outlining the research available on how well design thinking skills are learned. The currently most-favored pedagogical model for teaching design, project-based learning (PBL), is explored next, along with available assessment data on its success. Two contexts for PBL are emphasized: first-year cornerstone courses and globally dispersed PBL courses. Finally, the paper lists some of the open research questions that must be answered to identify the best pedagogical practices of improving design learning, after which it closes by making recommendations for research aimed at enhancing design learning.

Engineering Design Thinking, Teaching, and Learning

On Educational psychology: A cognitive view.

/pdf/engineering-design-thinking-teaching-and-learning-4yluxw1hth.pdf

Engineering design thinking, teaching, and learning

Engineering as a profession faces the challenge of making the use of technology ubiquitous and transparent in society while at the same time raising young learners' interest and understanding of how technology works. Educational efforts in science, technology, engineering, and mathematics (i.e., STEM disciplines) continue to grow in pre-kindergarten through 12th grade (P-12) as part of addressing this challenge. This article explores how engineering education can support acquisition of a wide range of knowledge and skills associated with comprehending and using STEM knowledge to accomplish real world problem solving through design, troubleshooting, and analysis activities. We present several promising instructional models for teaching engineering in P-12 classrooms as examples of how engineering can be integrated into the curriculum. While the introduction of engineering education into P-12 classrooms presents a number of opportunities for STEM learning, it also raises issues regarding teacher knowledge and professional development, and institutional challenges such as curricular standards and high-stakes assessments. These issues are considered briefly with respect to providing direction for future research and development on engineering in P-12.

/pdf/advancing-engineering-education-in-p-12-classrooms-2zzl113vgs.pdf

Advancing Engineering Education in P-12 Classrooms

This study examines the relationship between teacher knowledge and student learning for 9,556 students of 181 middle school physical science teachers. Assessment instruments based on the National Science Education Standards with 20 items in common were administered several times during the school year to both students and their teachers. For items that had a very popular wrong answer, the teachers who could identify this misconception had larger classroom gains, much larger than if the teachers knew only the correct answer. On items on which students did not exhibit misconceptions, teacher subject matter knowledge alone accounted for higher student gains. This finding suggests that a teacher’s ability to identify students’ most common wrong answer on multiple-choice items, a form of pedagogical content knowledge, is an additional measure of science teacher competence.

The Influence of Teachers’ Knowledge on Student Learning in Middle School Physical Science Classrooms

Engineering challenges that involve both the design and building of devices that satisfy constraints are increasingly employed in precollege science courses. We have experimented with exercises that are distinguished from those employed with elite students by reducing competition and increasing cooperation through the use of tests against nature, large dynamic ranges in performance, initial prototype designs, and alternative methods of recording and presenting results. We find that formulating easily understood goals helps engage students in fascinatingly creative processes that expose the need for a scientific methodology. Such challenges engage male and female students equally, helping to erase the gender disparity in familiarity with the technology and skills common to physical science.

/pdf/engineering-competitions-in-the-middle-school-classroom-key-3xyca6h2xc.pdf

Engineering Competitions in the Middle School Classroom: Key Elements in Developing Effective Design Challenges

We report on the development of an item test bank and associated instruments based on those K–12 national standards which involve astronomy and space science. Utilizing hundreds of studies in the science education research literature on student misconceptions, we have constructed 211 unique items that measure the degree to which students abandon such ideas for accepted scientific views. Piloted nationally with 7599 students and their 88 teachers spanning grades 5–12, the items reveal a range of interesting results, particularly student difficulties in mastering the NRC Standards and AAAS Benchmarks. Teachers generally perform well on items covering the standards of the grade level at which they teach, exhibiting few misconceptions of their own. Teachers dramatically overestimate their students’ performance, perhaps because they are unaware of their students’ misconceptions. Examples are given showing how the developed instruments can be used to assess the effectiveness of instruction and to evaluate the impact of professional development activities for teachers.

/pdf/the-astronomy-and-space-science-concept-inventory-4zt5xbbwaz.pdf

The Astronomy and Space Science Concept Inventory: Development and Validation of Assessment Instruments Aligned with the K-12 National Science Standards

We report on the development of an item test bank and associated instruments based on the National Research Council (NRC) K–8 life sciences content standards. Utilizing hundreds of studies in the science education research literature on student misconceptions, we constructed 476 unique multiple-choice items that measure the degree to which test takers hold either a misconception or an accepted scientific view. Tested nationally with 30,594 students, following their study of life science, and their 353 teachers, these items reveal a range of interesting results, particularly student difficulties in mastering the NRC standards. Teachers also answered test items and demonstrated a high level of subject matter knowledge reflecting the standards of the grade level at which they teach, but exhibiting few misconceptions of their own. In addition, teachers predicted the difficulty of each item for their students and which of the wrong answers would be the most popular. Teachers were found to generally overestimate their own students’ performance and to have a high level of awareness of the particular misconceptions that their students hold on the K–4 standards, but a low level of awareness of misconceptions related to the 5–8 standards.

Assessing the Life Science Knowledge of Students and Teachers Represented by the K–8 National Science Standards

The psychometrically sound development of assessment instruments requires pilot testing of candidate items as a first step in gauging their quality, typically a time-consuming and costly effort. Crowdsourcing offers the opportunity for gathering data much more quickly and inexpensively than from most targeted populations. In a simulation of a pilot testing protocol, item parameters for 110 life science questions are estimated from 4,043 crowdsourced adult subjects and then compared with those from 20,937 middle school science students. In terms of item discrimination classification (high vs. low), classical test theory yields an acceptable level of agreement (C-statistic = 0.755); item response theory produces excellent results (C-statistic = 0.848). Item response theory also identifies potential anchor items without including any false positives (items with low discrimination in the targeted population). We conclude that the use of crowdsourcing subjects is a reasonable, efficient method for the identifi...

Harold P. Coyle

Papers

The Influence of Teachers’ Knowledge on Student Learning in Middle School Physical Science Classrooms

Engineering Competitions in the Middle School Classroom: Key Elements in Developing Effective Design Challenges

The Astronomy and Space Science Concept Inventory: Development and Validation of Assessment Instruments Aligned with the K-12 National Science Standards

Assessing the Life Science Knowledge of Students and Teachers Represented by the K–8 National Science Standards

Identifying Promising Items: The Use of Crowdsourcing in the Development of Assessment Instruments.