|
Sign In to gain access to subscriptions and/or personal tools.
|
The Place of Inter-Rater Reliability in Qualitative Research: An Empirical Study
David Armstrong
Ann Gosling
John Weinman
Theresa Marteau
Assessing inter-rater reliability, whereby data are independently coded and the codings compared for agreements, is a recognised process in quantitative research. However, its applicability to qualitative research is less clear: should researchers be expected to identify the same codes or themes in a transcript or should they be expected to produce different accounts? Some qualitative researchers argue that assessing inter-rater reliability is an important method for ensuring rigour, others that it is unimportant; and yet it has never been formally examined in an empirical qualitative study. Accordingly, to explore the degree of inter-rater reliability that might be expected, six researchers were asked to identify themes in the same focus group transcript. The results showed close agreement on the basic themes but each analyst `packaged' the themes differently.
Key Words: inter-rater reliability • qualitative research • research methods.
Sociology, Vol. 31, No. 3,
597-606 (1997)
DOI: 10.1177/0038038597031003015
 CiteULike  Complore  Connotea  Del.icio.us  Digg  Reddit  Technorati  Twitter What's this?
This article has been cited by other articles:
|
|
|
|
 
S. M. Meffert and C. R. Marmar
Darfur Refugees in Cairo: Mental Health and Interpersonal Conflict in the Aftermath of Genocide
J Interpers Violence,
November 1, 2009;
24(11):
1835 - 1848.
[Abstract]
[PDF]
|
|
|
|
|
|
|
G. P. Quinn, E. M. August, D. Austin, C. Keefe, C. Bernadotte, K. Scarborough, and D. Jeffers
High Risk Community--Men's Perceptions of Black Infant Mortality: A Qualitative Inquiry
American Journal of Men's Health,
September 1, 2009;
3(3):
224 - 237.
[Abstract]
[PDF]
|
|
|
|
|
|
|
L. Selman, I. J Higginson, G. Agupio, N. Dinat, J. Downing, L. Gwyther, T. Mashao, K. Mmoledi, A. P Moll, L. M. Sebuyira, et al.
Meeting information needs of patients with incurable progressive disease and their families in South Africa and Uganda: multicentre qualitative study
BMJ,
April 22, 2009;
338(apr22_1):
b1326 - b1326.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
D. Leake and R. Boone
Multicultural Perspectives on Self-Determination From Youth, Parent, and Teacher Focus Groups
Career Development for Exceptional Individuals,
January 1, 2007;
30(2):
104 - 115.
[Abstract]
[PDF]
|
|
|
|
|
|
|
S. M. Driedger, C. Gallois, C. B. Sanders, N. Santesso,, and on Behalf of the Effective Consumer Investigator G
Finding Common Ground in Team-Based Qualitative Research Using the Convergent Interviewing Method
Qual Health Res,
October 1, 2006;
16(8):
1145 - 1157.
[Abstract]
[PDF]
|
|
|
|
|
|
|
E. H. Bradley, L. A. Curry, T. R. Webster, J. A. Mattera, S. A. Roumanis, M. J. Radford, R. L. McNamara, B. A. Barton, D. N. Berg, and H. M. Krumholz
Achieving Rapid Door-To-Balloon Times: How Top Hospitals Improve Complex Clinical Systems
Circulation,
February 28, 2006;
113(8):
1079 - 1085.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
M. Hammersley
Book Review: Analyzing Race Talk: Multidisciplinary Approaches to the Interview
Qualitative Research,
February 1, 2006;
6(1):
121 - 124.
[PDF]
|
|
|
|
|
|
|
V. L. Lawson, P. A. Lyne, J. N. Harvey, and C. E. Bundy
Understanding Why People with Type 1 Diabetes Do Not Attend for Specialist Advice: A Qualitative Analysis of the Views of People with Insulin-dependent Diabetes Who Do Not Attend Diabetes Clinic
J Health Psychol,
May 1, 2005;
10(3):
409 - 423.
[Abstract]
[PDF]
|
|
|
|
|
|
|
D. J. Hruschka, D. Schwartz, D. C. St.John, E. Picone-Decaro, R. A. Jenkins, and J. W. Carey
Reliability in Coding Open-Ended Data: Lessons Learned from HIV Behavioral Research
Field Methods,
August 1, 2004;
16(3):
307 - 331.
[Abstract]
[PDF]
|
|
|
|
|
|
|
R. S. Barbour
The Newfound Credibility of Qualitative Research? Tales of Technical Essentialism and Co-Option
Qual Health Res,
September 1, 2003;
13(7):
1019 - 1027.
[Abstract]
[PDF]
|
|
|
|
|
|
|
A. P. Gladney, C. Ayars, W. C. Taylor, P. Liehr, and J. C. Meininger
Consistency of Findings Produced by Two Multidisciplinary Research Teams
Sociology,
May 1, 2003;
37(2):
297 - 313.
[Abstract]
[PDF]
|
|
|
|
|
|
|
R. S Barbour
Checklists for improving rigour in qualitative research: a case of the tail wagging the dog?
BMJ,
May 5, 2001;
322(7294):
1115 - 1117.
[Full Text]
|
|
|
|
|
|
|
C. Pope, S. Ziebland, and N. Mays
Qualitative research in health care: Analysing qualitative data
BMJ,
January 8, 2000;
320(7227):
114 - 116.
[Full Text]
|
|
|
|
|
|
|
N. S. Mauthner, O. Parry, and K. Backett-Milburn
The Data are Out there, or are They? Implications for Archiving and Revisiting Qualitative Data
Sociology,
November 1, 1998;
32(4):
733 - 745.
[Abstract]
[PDF]
|
|
|
|
|
