The effects of the medium of test administration-paper and pencil versus computerized-were examined for timed power and speeded tests of cognitive abilities for populations of young adults and adults. Meta-analytic techniques were used to estimate the cross-mode correlation after correcting for measurement error. A total of 159 correlations was meta-analyzed: 123 from timed power tests and 36 from speeded tests. The corrected cross-mode correlation was found to be.91 when all correlations were analyzed simultaneously. Speededness was found to moderate the effects of administration mode in that the cross-mode correlation was estimated to be.97 for timed power tests but only.72 for speeded tests. No difference in equivalence was observed between adaptively and conventionally administered computerized tests

https://psycnet.apa.org/journals/bul/114/3/449.pdf

Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis.

Background: Computers have been used for a number of years in neuropsychological assessment to facilitate the scoring, interpretation, and administration of a variety of commonly used tests. There has been recent interest in applying computerized technology to pediatric neuropsychological assessment, which poses unique demands based on the need to interpret performance relative to the child's developmental level.

Findings: However, pediatric neuropsychologists have tended to implement computers in the scoring, but not administration, of tests. This trend is changing based on the work of experimental neuropsychologists who frequently combine data obtained from test batteries with lesion or neuroimaging data allowing descriptions of brain–behavior relations to be made with increasing confidence. One such battery is the Cambridge Neuropsychological Testing Automated Battery (CANTAB), and current studies in which the CANTAB has been used to measure executive functions in children are reviewed.

Conclusions: Computerized batteries of this type can record aspects of performance that are difficult for psychometrists to achieve, and these may reflect activity in developing neural networks with more sensitivity than can be achieved with traditional tests. However, before computerized test administration becomes a routine part of pediatric neuropsychological assessment, several obstacles must be overcome. Despite these limitations, it is concluded that computerized assessment can improve the field by facilitating the collection of normative and clinical data.

Practitioner Review: Computerized assessment of neuropsychological function in children: clinical and research applications of the Cambridge Neuropsychological Testing Automated Battery (CANTAB)

The genetic relationship between lower (information processing speed), intermediate (working memory), and higher levels (complex cognitive processes as indexed by IQ) of mental ability was studied in a classical twin design comprising 166 monozygotic and 190 dizygotic twin pairs. Processing speed was measured by a choice reaction time (RT) task (2-, 4-, and 8-choice), working memory by a visual-spatial delayed response task, and IQ by the Multidimensional Aptitude Battery. Multivariate analysis, adjusted for test-retest reliability, showed the presence of a genetic factor influencing all variables and a genetic factor influencing 4- and 8-choice RTs, working memory, and IQ. There were also genetic factors specific to 8-choice RT, working memory, and IQ. The results confirmed a strong relationship between choice RT and IQ (phenotypic correlations: -0.31 to -0.53 in females, -0.32 to -0.56 in males; genotypic correlations: -0.45 to -0.70) and a weaker but significant association between working memory and IQ (phenotypic: 0.26 in females, 0.13 in males; genotypic: 0.34). A significant part of the genetic variance (43%) in IQ was not related to either choice RT or delayed response performance, and may represent higher order cognitive processes.

/pdf/genetic-covariance-among-measures-of-information-processing-2xo0femiql.pdf

Genetic covariance among measures of information processing speed, working memory, and IQ

Computer-based assessment (CBA) is yet to have a significant impact on high-stakes educational assessment, but the equivalence between CBA and paper-and-pencil (P&P) test scores will become a central concern in education as CBA increases. It is argued that as CBA and P&P tests provide test takers with qualitatively different experiences, the impact of individual differences on the testing experience, and so statistical equivalence of scores, needs to be considered. As studies of score equivalence have largely ignored individual differences such as computer experience, computer anxiety and computer attitudes, the purpose of this paper is to highlight the potential effects of these. It is concluded that each of these areas is of significance to the study of equivalence and that the often inconsistent findings result from the rapid changes in exposure to technology.

The impact of individual differences on the equivalence of computer-based and paper-and-pencil educational assessments

Although key to understanding individual variation in task-related brain activation, the genetic contribution to these individual differences remains largely unknown. Here we report voxel-by-voxel genetic model fitting in a large sample of 319 healthy, young adult, human identical and fraternal twins (mean ± SD age, 23.6 ± 1.8 years) who performed an n-back working memory task during functional magnetic resonance imaging (fMRI) at a high magnetic field (4 tesla). Patterns of task-related brain response (BOLD signal difference of 2-back minus 0-back) were significantly heritable, with the highest estimates (40–65%) in the inferior, middle, and superior frontal gyri, left supplementary motor area, precentral and postcentral gyri, middle cingulate cortex, superior medial gyrus, angular gyrus, superior parietal lobule, including precuneus, and superior occipital gyri. Furthermore, high test-retest reliability for a subsample of 40 twins indicates that nongenetic variance in the fMRI brain response is largely due to unique environmental influences rather than measurement error. Individual variations in activation of the working memory network are therefore significantly influenced by genetic factors. By establishing the heritability of cognitive brain function in a large sample that affords good statistical power, and using voxel-by-voxel analyses, this study provides the necessary evidence for task-related brain activation to be considered as an endophenotype for psychiatric or neurological disorders, and represents a substantial new contribution to the field of neuroimaging genetics. These genetic brain maps should facilitate discovery of gene variants influencing cognitive brain function through genome-wide association studies, potentially opening up new avenues in the treatment of brain disorders.

https://www.jneurosci.org/content/jneuro/31/30/10882.full.pdf

Marie Hetu

Papers

Computerized versus traditional administration of the multidimensional aptitude battery-verbal scale: An examination of reliability and validity