Skip to main content

Table 3 Inter-rater agreement: ICC (consistency of agreement and absolute agreement) and Kappa values on categories and items

From: Behavioural observation tool for patient involvement and collaboration in emergency care teams (PIC-ET-tool)

Categories and items

ICC (consistency of agreement)

CI 95%

P-value

ICC (absolute agreement)

CI 95%

P- value

kappa

std err

P-value

Relationship (category)

      

0.55

0.07

< 0.001

 1. Greeting and team introduction

0.97

0.91 0.99

< 0.001

0.97

0.92 0.99

< 0.001

   

 2. Social talk (Yes/No)

      

-0.11

0.16

ns

 3. Maintaining continuous contact

0.54

0.10 0.81

0.01

0.45

0.00 0.76

0.01

   

 4. Using the patient’s name (avoiding ‘the patient’)

0.89

0.72 0.96

< 0.001

0.89

0.73 0.96

< 0.001

   

 5. Physical positioning (Yes/No)

      

-0.06

0.24

ns

 6.Talking TO and less ABOUT the patient

0.66

0.28 0.86

0.001

0.61

0.18 0.84

0.001

   

 7. Respectful communication (Yes/No)

100% same rating

Sharing power (category)

      

0.58

0.11

< 0.001

 8. Clarifying with the patient his/her preference concerning the level of information and involvement/collaboration (Yes/No)

100% same rating

 9. Considering the patient’s preferences regarding their medical care

0.55

0.11 0.81

0.01

0.55

0.12 0.82

0.01

   

 10. Involvement in decision-making (Yes/No)

      

-0.09

0.23

ns

Information exchange (category)

0.45

0.27 0.61

< 0.001

0.45

0.27 0.61

< 0.001

   

 11. Eliciting the patient’s perspective

0.31

0.00 0.68

ns

0.30

0.00 0.67

ns

   

 12. Avoiding misunderstanding of information provided by the patient

0.43

0.00 0.75

0.04

0.42

0.00 0.74

0.04

   

 13. Situation updates

0.51

0.06 0.79

0.02

0.50

0.07 0.78

0.02

   

 14. Information and discussion about diagnostics, treatments, procedures, and plan ahead.

0.41

0.00 0.74

0.04

0.38

0.00 0.71

0.04

   

 15. Preparing and supporting through procedures

0.30

0.00 0.67

ns

0.30

0.00 0.68

ns

   

Safe and caring environment (category)

0.47

0.25 0.65

< 0.001

0.47

0.26 0.65

< 0.001

   

 16. Safeguarding the patient’s integrity

0.59

0.08 0.85

0.01

0.50

0.00 0.81

0.01

   

 17. Interaction with the patient well-coordinated within the team

0.29

0.00 0.67

ns

0.28

0.00 0.66

ns

   

 18. Optimising physical comfort

0.69

0.33 0.87

0.001

0.69

0.34 0.88

0.001

   

 19. Recognising, acknowledging, and responding to emotions

0.26

0.00 0.68

ns

0.26

0.00 0.69

ns

   

Social circumstances (category)

      

0.41

< 0.001

< 0.001

 20. Information to next of kin

0.10

0.00 0.54

ns

0.10

0.00 0.54

ns

   

 21. Support with practical issues (Yes/No)

      

0.42

0.25

0.04

 22. Psychosocial issues

0.00

0.00 0.41

ns

0.00

0.00 0.42

ns

   

All items

      

0.52

0.04

< 0.001