What is Interobserver Agreement (IOA)?
Interobserver agreement (IOA) refers to the degree to which two or more independent observers report the same observed values after measuring the same events. For behaviour analysts and educators, IOA is the gold standard for establishing the reliability of data collection. High IOA ensures that the target behaviour is well-defined, the observers are well-trained, and the data can be trusted for making crucial clinical decisions.
Why is IOA Important?
Without reliable data, behavioural interventions are built on guesswork. IOA provides a quantitative measure of data accuracy. It helps identify observer drift, highlights ambiguities in operational definitions, and is often a requirement for publication in peer-reviewed journals.
Methods Calculated
Total Count (Frequency) IOA
The simplest method for event recording. It is calculated by dividing the smaller count by the larger count and multiplying by 100. While easy to compute, it does not guarantee that observers were recording the exact same instances of behaviour—only that they recorded a similar total number.
Interval-by-Interval IOA
Used for interval recording (e.g., momentary time sampling). It compares the observers' records interval by interval. It is calculated by dividing the number of intervals where observers agreed by the total number of intervals. It provides a more precise measure of agreement than total count.
Partial Interval IOA
Mathematically identical to Interval-by-Interval, but applied specifically when behaviour is recorded if it occurs at any point during an interval. This calculator processes it interval-by-interval to highlight specific disagreements.