RAS Social SciencePsikhologicheskii zhurnal

  • ISSN (Print) 0205-9592
  • ISSN (Online)3034-588X

RELIABILITY AND VALIDITY IN TEXTS' CONTENT-ANALYSIS: THE CHOICE OF MEASURES

PII
S0205-95920000596-2-1
DOI
10.31857/S20000596-2-1
Publication type
Article
Status
Published
Authors
Abstract
The paper discusses several reliability measures: Scott's pi, Krippendorff's alpha, free marginal adjustment (Bennett, Alpert and Goldstein's S), Cohen's kappa, and Perreault and Leigh's I and the assumptions on which they are based. It is suggested that correlation coefficients between, on one hand, the distribution of qualitative codes and, on the other hand, word co-occurrences and the distribution of the categories identified with the help of the dictionary based on substitution complement the other reliability measures. The paper shows that the choice of the reliability measure depends on the format of the text (stylistic versus rhetorical) and the type of reading (comprehension versus interpretation). Namely, Cohen's kappa and Bennett, Alpert and Goldstein's S emerge as reliability measures particularly suited for perspectival reading of rhetorical texts. Outcomes of the content analysis of 57 texts performed by four coders with the help of computer program QDA Miner inform the analysis.
Keywords
Content-analysis, correlation analysis, interpretation, stylistic texts, rhetorical texts, psychology of reading, reliability measures
Date of publication
03.11.2014
Number of purchasers
1
Views
696

References

QR
Translate

Индексирование

Scopus

Scopus

Scopus

Crossref

Scopus

Higher Attestation Commission

At the Ministry of Education and Science of the Russian Federation

Scopus

Scientific Electronic Library