Free
Research Article  |   May 2008
Psychometric Testing of SPIDER: Data Capture Tool for Systematic Literature Reviews
Author Affiliations
  • Sherrilene Classen, PhD, MPH, OTR/L, is Assistant Professor, Department of Occupational Therapy and Rehabilitation Science Doctoral Program, College of Public Health and Health Professions, University of Florida, Gainesville, FL 32611–0164; sclassen@phhp.ufl.edu
  • Sandra Winter, MS, OTR/L, is Doctoral Candidate, Rehabilitation Science Doctoral Program, College of Public Health and Health Professions, University of Florida, Gainesville
  • Kezia D. Awadzi, PhD, is Postdoctoral Fellow, Department of Occupational Therapy and Rehabilitation Science Program, College of Public Health and Health Professions, University of Florida, Gainesville
  • Cynthia W. Garvan, PhD, is Research Assistant Professor, Division of Biostatistics, College of Medicine, University of Florida, Gainesville
  • Ellen D. S. Lopez, PhD, is Assistant Professor, Department of Behavioral Science and Community Health, University of Florida, Gainesville
  • Swathy Sundaram, MPH, is Doctoral Student, Health Services Research, Management and Policy, University of Florida, Gainesville
Article Information
Assessment Development and Testing / Professional and Educational Issues
Research Article   |   May 2008
Psychometric Testing of SPIDER: Data Capture Tool for Systematic Literature Reviews
American Journal of Occupational Therapy, May/June 2008, Vol. 62, 335-348. doi:10.5014/ajot.62.3.335
American Journal of Occupational Therapy, May/June 2008, Vol. 62, 335-348. doi:10.5014/ajot.62.3.335
Abstract

OBJECTIVE. Systematic literature reviews contribute to evidence-based occupational therapy, yet no data capture tool currently exists to validly and reliably appraise the characteristics and quality of primary studies.

METHOD. We determined the psychometrics of Systematic Process for Investigating and Describing Evidence-Based Research (SPIDER) and piloted it with 201 studies included in a systematic literature review.

RESULTS. Content validity showed item relevance with 73% agreement between two experts. For the quality construct, seven of nine quality indicators were positively (p < .05) correlated with the overall quality score. The quality scores were positively correlated (p < .05) with two objective measures, inferring criterion validity. Intrarater reliability was moderate to perfect (κ = 0.4–1.0). Cross-tab analyses showed less variation in experienced reviewers’ interrater reliability.

CONCLUSION. SPIDER provides plausible opportunities for occupational therapy researchers and graduate students to appraise the characteristics and quality of primary studies but requires testing across other settings.