Showing papers in "Educational and Psychological Measurement in 1992"
TL;DR: The Echelle de Motivation en Education (EMEME) as mentioned in this paper is based on the tenets of self-determination theory and is composed of 28 items subdivided into seven sub-scales assessing three types of intrinsic motivation (intrinsic motivation to know, to accomplish things, and to experience stimulation).
Abstract: A new measure of motivation toward education has been developed in French, namely the Echelle de Motivation en Education (EME). The EME is based on the tenets of self-determination theory and is composed of 28 items subdivided into seven sub-scales assessing three types of intrinsic motivation (intrinsic motivation to know, to accomplish things, and to experience stimulation), three types of extrinsic motivation (external, introjected, and identified regulation), and a motivation. The purpose of this investigation was to cross-culturally validate in English the EME. The EME was translated in English through appropriate methodological procedures and completed by university students. Results revealed that the English version of the scale renamed the Academic Motivation Scale (AMS), has satisfactory levels of internal consistency (mean alpha value = .81) and temporal stability over a one-month period (mean test-retest correlation = .79). In addition, results of a confirmatory factor analysis (LISREL) confirm...
2,327 citations
TL;DR: The reliability and validity data on an extensive study of the Suinn-Lew Asian Self-Identity Acculturation Scale (SL-ASIA) involving a sample of 324 adults were provided by as mentioned in this paper.
Abstract: The current report covers the reliability and validity data on an extensive study of the Suinn-Lew Asian Self-Identity Acculturation Scale (SL-ASIA) involving a sample of 324 adults. Concurrent validity results showed that the SL-ASIA scores were significantly correlated with demographic information hypothesized to reflect levels of Asian-American identity. For example, high SL-ASIA scores were found associated with having attended school in the U.S. over a longer period of time, during which time the subject's Asian identity would have been reduced. Factorial validity was determined by comparing factors obtained for the SL-ASIA with factors reported for a similar scale measuring ethnic identity of Hispanics, the ARSMA. Of the four interpretable factors reported for the ARSMA, three were identified for the SL-ASIA.
646 citations
TL;DR: In this article, a study with 263 employed persons, identification with a psychological group or organization (IDPG) is defined as the perception of sharing experiences of a focal group and sharing characteristics of the group's members.
Abstract: Identification with a psychological group or organization (IDPG) is defined as the perception of sharing experiences of a focal group and sharing characteristics of the group's members. IDPG is conceptually distinct from the related concept of organizational commitment. In the present study with 263 employed persons, IDPG was shown to be empirically distinct from organizational commitment. In addition, IDPG was shown to have significantly less overlap than commitment with three related concepts: job satisfaction, organizational satisfaction, and job involvement.
520 citations
TL;DR: The authors examined the discriminant validity of 30 facet scales from the Revised NEO Personality Inventory (NEO-PIR) to examine cross-observer validity of specific variance in the facet scales, partial correlations between self-reports and peer and spouse ratings on the facets were calculated, controlling for the five common factors.
Abstract: Two analyses were conducted to examine the discriminant validity of 30 facet scales from the Revised NEO Personality Inventory (NEO-PIR). To examine cross-observer validity of specific variance in the facet scales, partial correlations between self-reports and peer (N = 250) and spouse (N = 68) ratings on the facets were calculated, controlling for the five common factors. All 60 convergent partial correlations were positive, and 48 (80%) were significant. In the second analysis, Adjective Check List (Gough and Heilbrun, 1983) correlates of the facet scales were identified in a sample of 305 adults. Judges correctly matched scales to correlates in most cases, providing additional evidence for discriminant validity.
262 citations
TL;DR: A 38-item School Participant Empowerment Scale (SPES) was constructed by selecting marker items for each of the six dimensions as mentioned in this paper, and internal consistency estimates of reliability for the total scale was.94, and ranged from.81 to.89 for the six factor scales.
Abstract: Two hundred eleven teachers in public schools rated 68 beliefs about what makes them feel empowered in schools. The items were factor analyzed revealing six dimensions or subscales: (a) Decision Making, (b) Professional Growth, (c) Status, (d) Self-Efficacy, (e) Autonomy, and (f) Impact. A 38-item School Participant Empowerment Scale (SPES) was constructed by selecting marker items for each of the six dimensions. Obtained internal consistency estimates of reliability for the total scale was .94, and ranged from .81 to .89 for the six factor scales. Evidence of discriminant validity also was discussed.
255 citations
TL;DR: In this article, the authors tested two possible improvements in scoring procedures for ideational creativity tests, and found that both of them were unsatisfactory for many problems with the scoring techniques currently used with tests of creativity.
Abstract: There are several problems with the scoring techniques currently used with tests of ideational creativity. The present investigation tested two possible improvements in scoring procedures. The firs...
168 citations
TL;DR: Despite its relevance to a wide variety of situations, competitiveness is a personality characteristic that has not been widely studied as mentioned in this paper, and although some research in need for achievement, sports psych...
Abstract: Despite its relevance to a wide variety of situations, competitiveness is a personality characteristic that has not been widely studied. Although some research in need for achievement, sports psych...
162 citations
TL;DR: In this paper, a test for determining the significance of a suppressor effect is suggested, based on Velicer's definition of suppression, which is perhaps the least well known of the definitions and has several important practical advantages relative to the other definitions.
Abstract: Since Horst (1941) first discussed and defined the suppressor variable in multiple regression/correlation, a number of more nearly precise definitions has been offered (Cohen and Cohen, 1975; Conger, 1974; Darlington, 1968; Velicer, 1978). This paper compares the different approaches to defining suppression, and illustrates the differences among them. Velicer's definition, which is based on the semi-partial correlation coefficient or usefulness and which is perhaps the least well known of the definitions, is shown to have several important practical advantages relative to the other definitions. The paper extends Velicer's usefulness definition to the general multiple predictor case and to analysis of variance (ANOVA) applications of multiple regression. A test for determining the significance of a suppressor effect is suggested, which is based on Velicer's definition of suppression.
133 citations
TL;DR: In this paper, data collected from 693 university personnel were used to evaluate the factor structures and concurrent validity of the Computer Attitude Scale, the Computer Anxiety Rating Scale, and the Computer Self-Efficacy Scale Principal factor analyses for each of the three scales resulted in interpretable factor solutions with high alpha reliabilities.
Abstract: Data collected from 693 university personnel were used to evaluate the factor structures and concurrent validity of the Computer Attitude Scale, the Computer Anxiety Rating Scale, and the Computer Self-Efficacy Scale Principal factor analyses for each of the three scales resulted in interpretable factor solutions with high alpha reliabilities Intercorrelations among the derived factors demonstrated the concurrent validity of the three instruments
132 citations
TL;DR: In this paper, the reliability estimates obtained under the assumption of a well-fitting congeneric model were slightly higher than those obtained under an assumption of parallellity, but the differences were small.
Abstract: This paper demonstrates the use of confirmatory factor analysis by LISREL as an assumption-testing method when computing reliability coefficients. Formulae based on the LISREL estimates are presented for computing the coefficients under different measurement model assumptions. According to the empirical results, the reliability estimates obtained under the assumption of a well-fitting congeneric model were slightly higher than those obtained under the assumption of parallellity. However, the differences were small, an outcome which indicates that the reliability estimates are robust against departure from the assumption of parallellity of test items.
120 citations
TL;DR: Based on conceptualizing leader-member exchange quality as comprised of the three subdimensions of perceived contribution to the exchange, loyalty, and positive affect, a short (6-item) new LMX scale was developed (LMX-6).
Abstract: Based on conceptualizing leader-member exchange quality as comprised of the three subdimensions of perceived contribution to the exchange, loyalty, and positive affect, a short (6-item) new LMX scale was developed (LMX-6). Using data from two samples (N = 281 and 115), the three-dimensional structure of the new scale was confirmed by multiple maximum likelihood confirmatory factors analyses in each sample separately. The two-and one-week test-retest stability of the new scale was established in a third (N = 86) and fourth (N = 44) sample, and acceptable internal-consistency estimates of reliability obtained for all four samples. The LMX-6 scale showed a high (.82) and statistically significant (p < .001) correlation with a commonly-used measure of leader-member exchange in the fourth sample. Finally, in the first two samples, concurrent correlations with autocratic and delegative decision-making, job satisfaction, organizational commitment, and rated job performance supported the validity of the new scale...
TL;DR: In this paper, examinee item responses were simulated to contain differentially functioning items, and then were analyzed at five sample sizes to compare detection rates of the Mantel-Haenszel (MH) procedure.
Abstract: The Mantel-Haenszel (MH) procedure has become one of the most popular procedures for detecting differential item functioning. Valid results with relatively small numbers of examinees are one of the advantages typically attributed to this procedure. In this study, examinee item responses were simulated to contain differentially functioning items, and then were analyzed at five sample sizes to compare detection rates. Results showed the MH procedure missed 25 to 30% of the differentially functioning items when groups of 2000 were used. When 500 or fewer examinees were retained in each group, more than 50% of the differentially functioning items were missed. The items most likely to be undetected were those which were most difficult, those with a small difference in item difficulty between the two groups, and poorly discriminating items.
TL;DR: This article used regression coefficients to predict student's grades at the University of Pennsylvania from linear combinations of high school class rank (CLR), total scholastic-aptitude-test score (SAT), and average achievement test score (ACH), all of which are available in applications for admission to selective institutions.
Abstract: This study asked how well students' grades at the University of Pennsylvania could be predicted from linear combinations of high-school class rank (CLR), total scholastic-aptitude-test score (SAT), and average achievement-test score (ACH), all of which are available in applications for admission to selective institutions. Underrepresented minorities were not included in the main analysis. Consideration of multiple regression coefficients revealed that CLR and ACH added significantly to overall prediction, whereas SAT did not. This asymmetry in incremental validity was not easily explained by restricted range, self-selection, or nonlinear effects. SAT did add significantly to prediction of grades in some individual courses. Of the three variables, only CLR added significantly to prediction of attrition or number of uncompleted courses.
TL;DR: Two studies evaluating the psychometric properties of Andrews and Withey's (1976) overall job satisfaction questionnaire were performed as mentioned in this paper, and one study found that the questionnaire was more accurate than the others.
Abstract: Two studies evaluating the psychometric properties of Andrews and Withey's (1976) overall job satisfaction questionnaire were performed. Study 1 found that the Andrews and Withey questionnaire corr...
TL;DR: In this article, the authors examined the impact of correlated measurement error on parameter estimates in simple structural equation models and showed that ignoring positive between-construct correlated error overestimates the structural parameter linking the two constructs.
Abstract: The implications of ignoring correlated error on parameter estimates in some simple structural equation models are examined. Ignoring correlated measurement error not only affected the acceptability of a model based on goodness-of-fit measures, but also affected the parameter estimation. Ignoring within-construct correlated error does not affect the estimates of the structural parameter but overestimates the associated measurement parameters. It is shown analytically and empirically that ignoring positive between-construct correlated error overestimates the structural parameter linking the two constructs. The effects become more pronounced with decreasing reliability in measurement.
TL;DR: In this article, meta-analysis was used to examine the validity of the GRE in predicting "success" in graduate school, finding that less than 9% of the variance in the criterion was accounted for.
Abstract: Meta-analysis was used to examine the validity of the Graduate Record Examination (GRE) in predicting "success" in graduate school. Results are presented for studies conducted in Psychology/Counseling departments. Validity coefficients were demonstrated to come from a homogeneous population (variance across studies was due mostly to sampling error). Mean validity coefficients ranged from .03 to .37, with an average of .18. Most of the squared population validity coefficients indicate that less than 9% of the variance in the criterion was accounted for. When employing graduate grade point average (GGPA) as the criterion, the GRE did not demonstrate adequate predictive validity. The problem of criteria is discussed, and alternatives to GGPA are presented as potentially superior indicators of graduate school success. Recommendations are suggested for developing a criterion which better reflects what is meant by "success" in graduate school.
TL;DR: A measure of metacognitive comprehension monitoring ability (CMA) was developed to determine whether this ability was related to academic achievement, as measured by marks (GPA) in several high sch
Abstract: A measure of metacognitive comprehension monitoring ability (CMA) was developed to determine whether this ability was related to academic achievement, as measured by marks (GPA) in several high sch
TL;DR: In this article, it is suggested that although a three factor structure has been shown to be the most readily replicable, this result does not exhaust the number of possible replicable factors in the Maslach Burnout Inventory using six independent sets of data drawn from previous studies involving a variety of subjects.
Abstract: Three-factor first order analyses have been used in the most successful of previous attempts to define the factor and subscale structures of the Maslach Burnout Inventory It is suggested in the present paper that although a three factor structure has been shown to be the most readily replicable, this result does not exhaust the number of possible replicable factors in the Inventory Using six independent sets of data drawn from previous studies involving a variety of subjects, the present analysis revealed the somewhat doubtful status of the general factor underlying the total score on the 22 items of the Inventory In all six sets of data, the 22 items of the Inventory also divided between two clearly replicable factors, the larger of which was tentatively identified as the "Core of Burnout" Responses to the 14 items loading on this factor were subsequently found to divide in turn, into two equally replicable factors These two factors, together with that differentiated from the "Core of Burnout," were
TL;DR: In this paper, the Learning Style Inventory (LSI) was completed by 718 introductory accounting students and their scores were factor analyzed to assess the construct validity of the LSI instrument.
Abstract: Kolb's revised Learning Style Inventory (LSI) was completed by 718 introductory accounting students. Their scores were factor analyzed to assess the construct validity of the LSI instrument. Both 2...
TL;DR: The validity of the ASVAB subtests and composites for grades in 150 military technical schools was investigated as mentioned in this paper, and the Electronics composite or the General composite was the most valid composite.
Abstract: The validity of the ASVAB subtests and composites for grades in 150 military technical schools was investigated. Across all jobs and within the job categories of Mechanical, Administrative, General, and Electronics, after correction for range restriction, Arithmetic Reasoning was found to be the most valid subtest. Across all jobs and within the job categories, the Electronics composite or the General composite was the most valid composite.
TL;DR: In this article, the authors report on the Statistics Anxiety Scale (SAS) (an adapted version of the Mathematics Anxiety Scale) for a sample of South African students, and the results show that reliability and validity data are reported on the SAS.
Abstract: Normative, reliability, and validity data are reported on the Statistics Anxiety Scale (SAS) (an adapted version of the Mathematics Anxiety Scale) for a sample of South African students. The respon...
TL;DR: In this paper, the effect of the violation of the assumption of independence when combining correlation coefficients in a meta-analysis was investigated in a Monte Carlo simulation, and it was shown that correlation coefficients can be used to improve the performance of the meta analysis.
Abstract: The purpose of this study was to determine the effect of the violation of the assumption of independence when combining correlation coefficients in a meta-analysis. In this Monte Carlo simulation t...
TL;DR: The psychometric properties of the two halves of the Washington University Sentence Completion Test (SCT) Form 81 were examined by comparing the fit of structural equation models representing parallel, tau-equivalent, and congeneric properties.
Abstract: The psychometric properties of the two halves the Washington University Sentence Completion Test (SCT) Form 81 were examined by comparing the fit of structural equation models representing parallel, tau-equivalent, and congeneric properties. Data for these models were based on item-sum scores for the two halves of the SCT and eight measures of aspects of ego development, the construct purportedly measured by the SCT. The data were from a sample of 265 adults. The results suggest that the parallel model provides both a parsimonious and good fit for the data. These results provide empirical justification for those users of the SCe who have the need for shorter, interchangeable, and reliable forms of the test.
TL;DR: In this article, the authors compare several potential measures of the holistic-analytic dimension of individual differences in cognitive functioning, and conclude that the construct validity of the holist analytic dimension is supported by the divergence of measures assessing a dimension th...
Abstract: Recently, it has become more acceptable to assume two different types of cognitive processes: analytic, rule-based, and sequential versus holistic, episode-based, or simply "nonanalytic." Results of both educational research and cognitive laboratory research suggest the presence of a holistic-analytic continuum of individual differences in cognitive functioning. The present investigation was designed to compare several potential measures of the holistic-analytic dimension. Evidence for construct validity comes from the convergence of measures that should theoretically assess the holistic-analytic dimension (i.e., sensing, intuiting, judging, and perceiving on Myers-Briggs Type Indicator; the left and right hemispheric preferences of the Human Information Processing Survey; and the Fact Retention, Methodical Study, Holist and Serialist scales of the Inventory of Learning Processes). Construct validity of the holist-analytic dimension was also supported by the divergence of measures assessing a dimension th...
TL;DR: The authors examined the psychometric characteristics of the JDI and other inventories of job satisfaction across a sample of validation studies and suggested the need for collateral work on the further conceptual development of the job satisfaction construct.
Abstract: In spite of the fact that the JDI is one of the most widely used measures in the organizational sciences, there has been relatively little validation work done since Smith, Kendall, and Hulin's (1969) development of the JDI. This paper is an examination of the psychometric characteristics of the JDI and other inventories of job satisfaction across a sample of validation studies. Like most other measures in the behavioral sciences, the construct validity of these inventories is modest. Although this problem may minimize the applicability of certain statistical techniques with job satisfaction data, the problem can be corrected through the proper application of structural equation models. Although this problem may be corrected statistically, the need for collateral work on the further conceptual development of the job satisfaction construct is suggested.
TL;DR: A 25-item Likert-type survey scale which was constructed to measure teachers' attitudes toward mainstreaming was analyzed using item-response theory (IRT) and confirmatory factor analysis (LISREL) as mentioned in this paper.
Abstract: A 25-item Likert-type survey scale which was constructed to measure teachers' attitudes toward mainstreaming was analyzed using item-response theory (IRT) and confirmatory factor analysis (LISREL). A three-factor model was shown to fit the data well. It is suggested that both factor scores and IRT scores can be used in discriminant analyses.
TL;DR: For the Educators Survey, an inventory designed to assess teacher burnout in each of three scales representing constructs of Emotional Exhaustion, Depersonalization, and Personal Accomplishment, is presented in this article.
Abstract: For the Educators Survey, an inventory designed to assess teacher burnout in each of three scales representing constructs of Emotional Exhaustion, Depersonalization, and Personal Accomplishment, bo...
TL;DR: In this article, the efficacy of the F, K, L, F-K, and O-S scales of the MMPI-2 in detecting fake good, fake bad, and honest profiles was investigated.
Abstract: The efficacy of the F, K, L, F-K, and O-S scales of the MMPI-2 in detecting fake good, fake bad, and honest profiles was investigated. A total of 110 undergraduate educational psychology students were administered the MMPI-2 under instructions to fake good, fake bad, or respond honestly. Multiple analysis of variance resulted in a significant (p < .001) difference on all validity scale scores of the three groups of respondents.
TL;DR: In this paper, the construct validity and reliability of the Maslach Burnout Inventory (MBI) in a Non-Western setting, the instrument was administered to 223 Jordanian teachers and responses to the MBI were subjected to principal factors analysis.
Abstract: In order to assess the construct validity and reliability of the Maslach Burnout Inventory (MBI) in a Non-Western setting, the instrument was administered to 223 Jordanian teachers. Responses to the MBI were subjected to principal factors analysis. Three factors, rotated obliquely, accounted for 42% and 43% of the total variance of the frequency and intensity dimensions, respectively. The correlations between these two dimensions for each of the three subscales were rather large and ranged from .84 and .92. The findings tend to support the contention of past researchers that the Depersonalization subscale can be broken into two subscales. However, the support was only partial. Reliabilities were also cornputed for the subscales and found acceptable. They ranged from .71 to .84.
TL;DR: In this paper, the discriminant and concurrent validity of two factor-derived sub-scales, mathematics test anxiety (MTA) and numerical anxiety (NA), of the MARS were tested.
Abstract: Discriminant and concurrent validity of two factor-derived sub-scales, mathematics test anxiety (MTA) and numerical anxiety (NA), of the Mathematics Anxiety Rating Scale (MARS) were tested. Sixty-eight females and 44 males from the pre-service program of the Faculty of Education, the University of Western Ontario, completed the Mathematics Avoidance Behavior Test (MABT), the Test Anxiety Inventory (TAI), and the two MARS factor-derived subscales. A significant difference was found between the correlations of MTA and NA with the emotionality subscale of the TAI for the female group, but not for the male group. MTA scores correlated significantly with the scores on the MABT but the NA did not. Problems in these instruments and the implications for future research were discussed.