How Is Treatment Integrity Measured? Direct Measures. Direct measures include systematic observation of behavior in the classroom, videotaping, audiotaping, and using computer software ... Indirect Measures. Available Treatment Integrity Protocols. Selecting Treatment Integrity Assessments.
How do you assess treatment integrity?
In addition to the technical aspects of treatment integrity, relational characteristics between client and practitioner can be examined as well (McLeod, Southam-Gerow, & Weisz, 2009). As McLeod and colleagues state, when assessing treatment integrity, observational methods provide objectivity, but they can be resource-intensive.
What is the least reliable method of treatment integrity measurement?
Self-report is therefore considered the least reliable method of treatment integrity measurement (Noell, 2007). Some authors also have speculated that permanent products may be created without implementing the intervention (Noell, Duhon, Gatti, & Connell, 2002), resulting in artificially high levels of treatment integrity.
What does treatment integrity mean to you?
For the sake of simplicity, we use treatment integrity in this article. Treatment integrity has been defined as the degree to which an intervention or treatment is implemented as planned, intended, or originally designed (Gresham, 1989, 2004; Gresham, MacMillan, Beebe-Frankenberger, & Bocian, 2000; Lane, Bocian, MacMillan, & Gresham, 2004).
Why collect data about treatment integrity?
Witt et al. (2004) recommended that if data about treatment integrity are not being collected, at least one assessment method discussed previously should be initiated. It is only through the collection of data that practitioners can be sure that interventions are delivered as intended.
What is treatment integrity in ABA?
Treatment integrity (also called procedural fidelity) is a measure of how reliably the steps of a treatment protocol are being implemented by others. It is reported as a percentage of correctly performed steps in the treatment out of the total number of opportunities.
In what percentage of treatment sessions should treatment integrity be measured?
A random sample (usually 20% to 40%) of collected tapes is examined to assess integrity. To ensure adequate data representation, sample across therapists, treatment phases, situations, cases and sessions.
What is good treatment integrity?
Treatment integrity has been defined as the degree to which an intervention or treatment is implemented as planned, intended, or originally designed (Gresham, 1989, 2004; Gresham, MacMillan, Beebe-Frankenberger, & Bocian, 2000; Lane, Bocian, MacMillan, & Gresham, 2004).
How is treatment measured fidelity?
In clinical research treatment fidelity is typically attained by intensive training and supervision techniques and demonstrated by measuring therapist adherence and competence to the protocol using external raters.
Abstract
While the measurement of treatment integrity is important to determine how much, and how well, interventions are delivered in schools, the science of treatment integrity is not well developed in education research.
Definitions and Conceptual Model
It is important to place our discussion of treatment integrity within the model of translational research that starts with basic research and progresses to implementation research.
BEST in CLASS
BEST in CLASS is a Tier 2 program delivered by classroom teachers, with support from trained coaches, that targets improvements in teacher–child interactions and relationships in order to reduce the chronic problem behavior of young children and students with or at risk of emotional/behavioral disorders (EBD).
Development of Treatment Integrity Measure
To provide an objective estimate of treatment integrity, we developed an observer-rated treatment integrity instrument for use by trained coders.
BEST in CLASS Adherence and Competence Scale (BiCACS)
The BiCACS (see Sutherland et al. 2014) was developed as part of an Institute of Education Sciences (IES)-funded project that supported the initial development of BEST in CLASS. Our goals in developing this initial integrity measure were threefold.
Treatment Integrity Measure for Early Childhood Settings
While we were pleased about coders’ ability to score adherence, competence and child responsiveness on the BiCACS, this measure did not allow for the measurement of the fourth integrity dimension in our conceptual model, treatment differentiation.
Treatment Integrity Instrument for Elementary School Classrooms
As we completed work on developing the TIMECS, our research team received funding from IES to adapt BEST in CLASS for use in early elementary school classrooms.
