Accuracy In Direct Behavior Rating is Minimally Impacted By Completion Latency
Direct behavior ratings (DBRs) have been proposed as an efficient method to assess student behavior in the classroom due to their relative ease of administration compared to alternative methods like systematic direct observation. DBRs are considered low-inference assessments of behavior because they are designed to be completed immediately following a specified observation period of student behavior; however, in practice it is common for teachers and other respondents to delay completion of a DBR until they are reminded to do so. It is unclear what effect, if any, this latency between observation and DBR completion has on rater accuracy. Thus, the purpose of this study was to examine the effect of completion latency on accuracy in an analogue setting. Two-hundred forty-one undergraduate students (83.8% female) with a mean age of 21 participated across eight groups and were asked to complete an electronic DBR immediately after watching a video of student behavior or after a predetermined delay of 5 minutes, 15 minutes, 30 minutes, 1 hour, 2 hours, 4 hours, or 6 hours. A one-way analysis of variance revealed that there was no statistically significant relationship between completion latency and DBR accuracy, F(7, 233) = .959, p = .46, η2 = .028.
Psychology in the Schools
Dart, E. H.,
Radley, K. C.,
Collins, T. A.,
Terjesen, M. D.,
Wright, S. J.,
McCargo, M. G.,
Hicks, A. J.
(2017). Accuracy In Direct Behavior Rating is Minimally Impacted By Completion Latency. Psychology in the Schools, 54(9), 1123-1133.
Available at: https://aquila.usm.edu/fac_pubs/14940