Application of the emergency medical services trigger tool to measure adverse events in prehospital emergency care: a time series analysis

Table 3 Inter-rater reliability

	Percent Agreement	Cohen’s Kappa	N Agreements	N Disagreements	N Cases	N Decisions
C1	97.50%	0.297	692	18	710	1420
C1 Adverse Event	97.20%	0.276	690	20	710	1420
C1 Harm	97.20%	0.273	690	20	710	1420
C1 Harm Category 1	96.80%	0.169	687	23	710	1420
C1 Harm Category 2	98.20%	1	551	10	561	1122
C2	88.30%	0.52	627	83	710	1420
C2 Adverse Event	86.50%	0.456	614	96	710	1420
C2 Harm	87.70%	0.501	623	87	710	1420
C2 Harm Category 1	85.60%	0.431	608	102	710	1420
C2 Harm Category 2	97.10%	1	545	16	561	1122
C3	99.40%	1	706	4	710	1420
C3 Adverse Event	99.40%	1	706	4	710	1420
C3 Harm	99.40%	1	706	4	710	1420
C3 Harm Category 1	99.40%	1	706	4	710	1420
C3 Harm Category 2	100%	undefined*	561	0	561	1122
C4	100%	1	710	0	710	1420
C4 Adverse Event	99.70%	0.666	708	2	710	1420
C4 Harm	99.60%	0.499	707	3	710	1420
C4 Harm Category 1	99.60%	0.499	707	3	710	1420
C4 Harm Category 2	99.50%	1	558	3	561	1122
C5	96.90%	0.759	688	22	710	1420
C5 Adverse Event	94.40%	0.571	670	40	710	1420
C5 Harm	96.30%	0.717	684	26	710	1420
C5 Harm Category 1	93.40%	0.488	663	47	710	1420
C5 Harm Category 2	95.50%	1	536	25	561	1122
M1	100%	undefined*	710	0	710	1420
M1 Adverse Event	100%	undefined*	710	0	710	1420
M1 Harm	100%	undefined*	710	0	710	1420
M1 Harm Category 1	100%	undefined*	710	0	710	1420
M1 Harm Category 2	100%	undefined*	561	0	561	1122
P1	99.70%	1	708	2	710	1420
P1 Adverse Event	99.70%	1	708	2	710	1420
P1 Harm	99.70%	1	708	2	710	1420
P1 Harm Category 1	99.70%	1	708	2	710	1420
P1 Harm Category 2	99.30%	1	557	4	561	1122
R1	100%	undefined*	710	0	710	1420
R1 Adverse Event	100%	undefined*	710	0	710	1420
R1 Harm	100%	undefined*	710	0	710	1420
R1 Harm Category 1	100%	undefined*	710	0	710	1420
R1 Harm Category 2	100%	undefined*	561	0	561	1122

ISSN: 1471-227X