Definition: To what extent does the study allow us to draw conclusions about a causal effect between two or more constructs? Issues: Selection, maturation, history, mortality, testing, regression towrd the mean, selection by maturation, treatment by mortality, treatment by testing, measured treatment variables Increase: Eliminate the threats, above all do experimental manipulations, random assignment, and counterbalancing.

Reliability and validity

Resumo Instrumentos de medida desempenham um importante papel na pesquisa, na pratica clinica e na avaliacao de saude. Estudos sobre a qualidade desses instrumentos fornecem evidencias de como as propriedades de medida foram avaliadas, auxiliando o pesquisador na escolha da melhor ferramenta para utilizacao. A confiabilidade e a validade sao consideradas as principais propriedades de medida de tais instrumentos. Confiabilidade e a capacidade em reproduzir um resultado de forma consistente, no tempo e no espaco. Validade refere-se a propriedade de um instrumento medir exatamente o que se propoe. Neste artigo sao apresentados, discutidos e exemplificados os principais criterios e testes estatisticos empregados na avaliacao da confiabilidade (estabilidade, consistencia interna e equivalencia) e validade (conteudo, criterio e construto) de instrumentos. A avaliacao das propriedades de medida de instrumentos e util para subsidiar a selecao de instrumentos validos e confiaveis, de modo a assegurar a qualidade dos resultados dos estudos.

/pdf/psychometric-properties-in-instruments-evaluation-of-45oneeu666.pdf

Psychometric properties in instruments evaluation of reliability and validity.

Measurement instruments are an integral part of clinical practice, health evaluation and research. These instruments are only useful and able to present scientifically robust results when they are developed properly and have appropriate psychometric properties. Despite the significant increase of rating scales, the literature suggests that many of them have not been adequately developed and validated. The scope of this study was to conduct a narrative review on the process of developing new measurement instruments and to present some tools which can be used in some stages of the development process. The steps described were: I-The establishment of a conceptual framework, and the definition of the objectives of the instrument and the population involved; II-Development of the items and of the response scales; III-Selection and organization of the items and structuring of the instrument; IV-Content validity, V-Pre-test. This study also included a brief discussion on the evaluation of the psychometric properties due to their importance for the instruments to be accepted and acknowledged in both scientific and clinical environments.

/pdf/construcao-de-instrumentos-de-medida-na-area-da-saude-41yxirnq38.pdf

Construção de instrumentos de medida na área da saúde

Objective: to construct and validate the Educational Content Validation Instrument in Health. Method: methodological study that includes the establishment of the conceptual structure; definition of objectives and population; construction of items and response scale; selection and arrangement of items; instrument structuring; opinion of experts; pre-test and content validation. Results: an instrument with 15 items was constructed and, after expert evaluation, eighteen items were obtained, divided into three domains: objectives (four), structure/presentation (nine), and relevance (two). Six items were modified since they presented a percentage of agreement below 0.8. Items of the total instrument presented good internal consistency (0.877) regarding domains. Conclusion: an Educational Content Validation Instrument in Health was elaborated and validated, presenting good reliability, and may contribute to the practice of researchers and health professionals in the development of educational content.

/pdf/construction-and-validation-of-an-educational-content-ro9n7wtzli.pdf

Construction and validation of an Educational Content Validation Instrument in Health.

Góes, Fernanda dos Santos Nogueira de. Development and evaluation of an interactive virtual learning object about diagnostic reasoning in nursing applied to preterm newborns. Ribeirão Preto, 2010. 188 pages. Thesis (Doctorate) Ribeirão Preto College of Nursing, University of São Paulo, Ribeirão Preto, 2010. Planning nursing care involves some stages. One fundamental stage is developing nursing diagnoses, which is a complex theme and not much explored in Neonatal Nursing. The potential use of computer technology in teaching and continuous education in nursing was the motivation for developing the present study with the objective to develop and evaluate an interactive virtual learning object about diagnostic reasoning in nursing applied to preterm newborns at the neonatal intermediate care unit. This descriptive study used the pedagogical framework of problem-posing and computer-assisted instruction, Bernardo's method of software development and Risner's thinking model to elaborate the nursing diagnosis, according to the NANDA-I taxonomy. The teaching simulations and learning exercises for diagnostic reasoning in nursing included real cases of preterm newborns, which were adapted and designed based on a model for developing clinical cases with educational means, and organized according to basic human needs. The cases were validated by five nursing professors, experts in neonatal nursing and diagnostic reasoning. The software was developed using the tool by Macromedia Authorware®, included in a virtual learning environment on the Internet, the Moodle, and media processed in specific software depending on their type. The virtual interactive learning object was organized in modules, consisting of a presentation, justification, objectives, technical record, image gallery, support tests and references; theoretical content about Nursing Diagnosis; automatic presentations of three clinical cases of preterm newborns at the neonatal intermediate care unit, totaling 32 Nursing Diagnoses, and simulation exercises of four clinical cases of preterm newborns, thus adding up to 40 Nursing Diagnoses. Appearance and content evaluations of the virtual object regarding the aspects related to presentation, organization, use and overall impression were performed by experts in computer technology (12) and nursing (31). Each sub-item from the instruments contained the evaluation on a Likert scale and a space for comments/suggestions. All items received positive evaluations by over 80% of the evaluators, except for the information density criterion on the evaluation by computer technology experts. Hence, the developed product is considered adequate to be used in students and continuous education in nursing about diagnostic reasoning in the elaboration of Nursing Diagnoses for preterm newborns, in the pedagogical framework of problem-posing.

Universidade de são paulo escola de enfermagem de ribeirão preto

This study sought to conduct a review of content validity, which is an important phase of processes of construction and adaptation of measurement instruments. Research of comprehensive literature was conducted by means of a review of national and international databases. Initially, a description of the conceptual basis and the measurement methods used in content validity was made, with emphasis on its application in the healthcare area. It was seen that controversy exists in the literature on the terminology and concept of content validity. The recommended procedures used to check content validity during the construction and adaptation processes of instruments were described, especially the judges' assessment, which can involve qualitative and quantitative procedures. The number, selection and qualification of these judges were also described. The different methods used to quantify the level of agreement among the experts were verified, mainly the Content Validity Index (CVI). This study described aspects of the content validity process, one of the procedures to be considered by healthcare researchers and professionals who are interested in using reliable and appropriate measurements and instruments scales for given population groups.

https://www.scielosp.org/pdf/csc/2011.v16n7/3061-3068/pt

Validade de conteúdo nos processos de construção e adaptação de instrumentos de medidas

/pdf/construction-of-measurement-instruments-in-the-area-of-1j7k0vah4u.pdf

construction Of Measurement Instruments In The Area Of Health

Reliability and validity of an ergonomics-related Job Factors Questionnaire.

Este estudio tuvo como objetivo elaborar un cuestionario para evaluar la factibilidad de la version brasilena del Job Factors Questionnaire. La validez del contenido fue realizada siguiendo la metodologia recomendada: revision por un comite de expertos, y prueba preliminar. El instrumento de factibilidad se aplico a los trabajadores en la produccion y la administracion de dos industrias metalurgica. Las sugerencias de los miembros del comite fueron aceptadas, lo que resulta en un cuestionario que consta de tres cuestiones y una escala Likert de cinco puntos que evalua la factibilidad de los instrumentos de medida. Entre las 148 personas que participaron del estudio, ninguno presento dificultades durante la prueba preliminar. Los datos recogidos han demostrado que el tiempo de respuesta fue de menos de cinco minutos, y el porcentaje fue mayor a la opcion completamente de acuerdo a todas las cuestiones. El Cuestionario de Evaluacion de Factibilidad puede ser util a los investigadores preocupados por la calidad de instrumentos utilizados para recopilacion de datos

Marina Zambon Orpinelli Coluci

Papers

Validade de conteúdo nos processos de construção e adaptação de instrumentos de medidas

Construção de instrumentos de medida na área da saúde

construction Of Measurement Instruments In The Area Of Health

Reliability and validity of an ergonomics-related Job Factors Questionnaire.

Development of a questionnaire to evaluate the usability of assessment instruments