Journal ArticleDOI
On the choice of measures of reliability and validity in the content-analysis of texts
TLDR
The authors discusses several reliability measures: Scott's pi, Krippendorff's alpha, free marginal adjustment, Cohen's kappa, and Perreault and Leigh's $$I$$¯¯ and the assumptions on which they are based and shows that the choice of the reliability measure depends on the format of the text and the type of reading (comprehension versus interpretation).Abstract:
The paper discusses several reliability measures: Scott’s pi, Krippendorff’s alpha, free marginal adjustment (Bennett, Alpert and Goldstein’s $$S$$
), Cohen’s kappa, and Perreault and Leigh’s $$I$$
and the assumptions on which they are based. It is suggested that correlation coefficients between, on one hand, the distribution of qualitative codes and, on the other hand, word co-occurrences and the distribution of the categories identified with the help of the dictionary based on substitution complement the other reliability measures. The paper shows that the choice of the reliability measure depends on the format of the text (stylistic versus rhetorical) and the type of reading (comprehension versus interpretation). Namely, Cohen’s kappa and Bennett, Alpert and Goldstein’s $$S$$
emerge as reliability measures particularly suited for perspectival reading of rhetorical texts. Outcomes of the content analysis of 57 texts performed by four coders with the help of computer program QDA Miner inform the analysis.read more
Citations
More filters
Proceedings ArticleDOI
Garbage in, garbage out?: do machine learning application papers in social computing report where human-labeled training data comes from?
TL;DR: In this paper, the authors investigate to what extent a sample of machine learning application papers in social computing, specifically papers from ArXiv and traditional publications performing an ML classification task on Twitter data, give specific details about whether such best practices were followed.
Journal ArticleDOI
Network hospitality in the share economy: Understanding guest experiences and the impact of sharing on lodging
Allison Wiles,Alleah Crawford +1 more
TL;DR: In this paper, the authors utilize the experience economy to assess the value of the network hospitality experience for the guest and to develop a better understanding of network hospitality as a unique alternative to traditional lodging.
DissertationDOI
An exploratory study of food in destination marketing
TL;DR: This paper explored the use of food in destination marketing in selected destinations in Yorkshire, England, to address this gap in knowledge, and to develop recommendations for destination marketers and other industry stakeholders to assist in planning and utilising food as a cultural resource more effectively at the destination level.
Journal ArticleDOI
Systematic content analysis: A combined method to analyze the literature on the daylighting (de-culverting) of urban streams.
TL;DR: This study reassesses the literature on stream daylighting with a particular focus on its role, as a nature-based solution, for climate change mitigation and adaptation and for socio-environmental justice and develops a method that combines a systematic review of the stream Daylighting literature and inductive content analysis.
References
More filters
Book
Nonparametric statistics for the behavioral sciences
TL;DR: This is the revision of the classic text in the field, adding two new chapters and thoroughly updating all others as discussed by the authors, and the original structure is retained, and the book continues to serve as a combined text/reference.
Book
Content analysis: an introduction to its methodology
TL;DR: History Conceptual Foundations Uses and Kinds of Inference The Logic of Content Analysis Designs Unitizing Sampling Recording Data Languages Constructs for Inference Analytical Techniques The Use of Computers Reliability Validity A Practical Guide
Book
Social Research Methods
TL;DR: In this paper, the authors reviewed the literature on qualitative and quantitative research in social research and discussed the nature and process of social research, the nature of qualitative research, and the role of focus groups in qualitative research.
Book
Introduction to Modern Information Retrieval
Gerard Salton,Michael J. McGill +1 more
TL;DR: Reading is a need and a hobby at once and this condition is the on that will make you feel that you must read.
Book
The Content Analysis Guidebook
TL;DR: The Content Analysis Guidebook provides an accessible core text for upper-level undergraduates and graduate students across the social sciences that unravels the complicated aspects of content analysis.