This article has Open Peer Review reports available.
Reliability and validity of the Hospital Anxiety and Depression Scale in an emergency department in Saudi Arabia: a cross-sectional observational study
© Al Aseri et al. 2015
Received: 13 November 2014
Accepted: 21 September 2015
Published: 12 October 2015
Depression and anxiety are prevalent psychiatric comorbidities that are known to have a negative impact on a patient’s general prognosis. But screening for these potential comorbidities in a hospital’s accident and emergency department has seldom been undertaken, particularly in Saudi Arabia and elsewhere in the Middle East. The Hospital Anxiety and Depression Scale (HADS) has been extensively used to evaluate these psychiatric comorbidities in various clinical settings at all levels of health care services except for the accident and emergency department. This study therefore aimed to assess the reliability and validity of the HADS for anxiety and depression among patients at a hospital accident and emergency department in Saudi Arabia.
This cross-sectional observational study was conducted from January to December 2012. The participants were 257 adult patients (aged 16 years and above) who presented at the accident and emergency department of King Khalid University Hospital, Riyadh, Saudi Arabia, who met our inclusion criteria. We used an Arabic translation of the HADS. We employed factor analysis to determine the underlying factor structure of that instrument in assessing reliability and validity.
We found the Arabic version of the HADS to be acceptable for 95 % of the subjects. We used Cronbach’s alpha coefficient to evaluate reliability, and it indicated a significant correlation with both the anxiety (0.73) and depression (0.77) subscales of the HADS, thereby supporting the validity of the instrument. By means of factor analysis, we obtained a two-factor solution according to the two HADS subscales (anxiety and depression), and we observed a statistically significant correlation (r = 0.57; p < 0.0001) between the two subscales.
The HADS can be used effectively in an accident and emergency department as an initial screening instrument for anxiety and depression. It thus has great potential as part of integrated multidisciplinary care.
The prevailing concept of health clearly identifies mind and body as “patho-physiologically inter-dependable entities” that need to be in harmony with the “environment, internal as well as external” to achieve “complete well-being” . The existing literature has identified one aspect of this integral association in terms of the high prevalence of psychiatric comorbidities, especially depressive and anxiety disorders, among medically ill patients [2, 3]. In the Arab world, the prevalence of such psychiatric disorders is quite high, with rates of anxiety and depression being reportedly 26–40 % [4–6]. However, many studies worldwide have consistently found low detection rates of such psychiatric comorbidities by attending physicians, thereby resulting in delays in appropriate diagnoses and treatment [9–11]. These delays probably make a substantial contribution to the burden of illness and to the add-on economic impacts of resulting disabilities—for the patient as well as for the health care system and society in general.
Several questionnaires have been developed as screening tools to detect such psychiatric comorbidities. The Hospital Anxiety and Depression Scale (HADS) was formulated by Zigmond and Sanith  to identify possible or probable anxiety and depression among patients in non-psychiatric clinical settings. The HADS anxiety and depression subscales each consist of seven related items. Each item is rated on a four-point scale from 0 to 3, yielding a maximum score of 21 for each subscale. Scores of 11 or more with either subscale are considered to indicate a significant “case” of psychiatric comorbidity; scores of 8–10 signify the presence of a “disorder.” A score of 7 or less is considered normal [13, 14]. Since its inception, this instrument has been used extensively worldwide, and it has been translated into many languages, including German, Swedish, Chinese, French, Dutch, Portuguese , Farsi (Persian) , and Arabic.
The Arabic version of the HADS has been used in various health care settings, both at primary- and secondary-care levels, in such countries as Saudi Arabia [5, 6], Kuwait , and the United Arab Emirates . There, it has been demonstrated to be a valid, reliable screening instrument in a primary-care setting [7, 8]—just as with its versions in other languages [15, 16]. However, it has been rarely used in accident and emergency (A&E) departments in Arab countries; this is in contrast to other parts of the world, where it has been used successfully for screening purposes in such clinical settings . Patients attending an A&E department are generally in a state of distress owing to the acute nature of their health problems, and so it would appear to be highly appropriate to screen these patients for existing psychiatric comorbidities, such as anxiety and depression.
The present study aimed to identify the existence of prevalent psychiatric comorbidities and to evaluate the sensitivity of the Arabic version of the HADS in a hospital A&E department setting in Saudi Arabia. From the perspective of providing holistic care, a further purpose of this study was to increase awareness among health care professionals about the importance of recognizing such psychiatric comorbidities as anxiety and depression in patients attending the A&E department.
Study design, setting, patient recruitment, and data collection
In this cross-sectional observational study, we recruited participants among patients who attended the A&E department of King Khalid University Hospital, Riyadh, Saudi Arabia, from January to December 2012. The Arabic version of the HADS was used after obtaining prior permission from its sole proprietor, GL Assessment of the United Kingdom [7, 8].
The printed HADS questionnaire in Arabic was provided to all patients aged 16 years and above who were assessed to be clinically stable and were able to read and understand the HADS. We excluded from this study patients who were clinically unstable or whose medical records indicated existing psychiatric disorders. The purpose of the study and the HADS questionnaire was fully described to each included patient beforehand. A signed form indicating informed consent for participation was obtained from each patient. Every subject was given 30 min to complete the questionnaire. Patients who signaled difficulty in reading a particular question on the HADS were assisted by the emergency physician on duty. In such instances, the identified questions were read out to the patients without any explanation or elaboration as to the meaning.
We distributed 298 questionnaires and obtained 257 completed responses for subsequent analysis. The remaining 41 responses were excluded either because the patient refused to participate from the outset (29 subjects) or submitted incomplete questionnaires (12 patients). The patients’ demographic data were recorded each time by the A&E department physicians on duty; the data included age, sex, marital status, educational background, economic status, presenting complaints, medical diagnoses, and previous admissions to the hospital or A&E department visits.
The study was formally approved by the Institutional Review Board of the College of Medicine, King Khalid University Hospital.
We analyzed the data using SPSS software, version 16.0 for Windows (released 2007; Chicago, IL, USA). We assessed internal consistency using Cronbach’s alpha; convergent validity was evaluated using Pearson’s correlation coefficient among the items, subscale scores, and total scores. We further determined the validity of the HADS by means of factor analysis, in which the correlation matrix, Kaiser–Meyer–Olkin measurement of sampling adequacy, and Bartlett’s test of sphericity were used to assess the factorability of the 14 questionnaire items. We examined the factor structure of the HADS by restricting the factor extraction process to two factors and employing the principal component method. Proportion of variance was assessed through initial eigenvalues explained by each of the factors. We used varimax rotation to obtain the rotated factors. Pearson’s chi-square test was utilized to assess the associations between the categorical study variables and the three levels of depression and anxiety. We employed a p value of <0.05 to determine the statistical significance of the study results.
Of the 257 patients, 105 (40.9 %) were aged 16–30 years; 115 (44.7 %) were male. A high literacy status was held by 25 patients (9.7 %); 148 (57.6 %) had attended only primary or secondary school; the remaining 84 (32.7 %) patients had no formal education. With respect to marital status, 139 (54.1 %) patients were married, 84 (32.7 %) had never married, and the remaining 34 (13.2 %) were divorced or widowed.
Factor analysis of the HADS items using varimax rotation
I get a sudden feeling of panic.
I get a sort of frightened feeling like ‘butterflies’ in the stomach.
I get a sort of frightened feeling as if something awful is about to happen.
Worrying thoughts go through my mind.
I feel tense or wound up.
I feel restless as if I have to be on the move.
I can sit and feel relaxed.
I look forward with enjoyment to things.
I still enjoy the things I used to enjoy.
I can laugh and see the funny sides of things.
I have lost interest in my appearance.
I can enjoy a good book or radio or TV program.
I feel cheerful.
I feel disappointed (or feel slowed down).
Correlation of the HADS items with their hypothesized subscales and HADS overall
HADS-A (anxiety subscale)
HADS-D (depression subscale)
Item number/Anxiety (HADS-A)
13/I get sudden feeling of panic.
9/I get a sort of frightened feeling like ‘butterflies’ in the stomach.
3/I get a sort of frightened feeling as if something awful is about to happen.
5/Worrying thoughts go through my mind.
1/I feel tense or wound up.
11/I feel restless as if I have to be on the move.
8/I feel as if I am slowed down.
Item number/Depression (HADS-D)
7/I can sit at ease and feel relaxed.
12/I look forward with enjoyment to things.
2/I still enjoy the things I used to enjoy.
4/I can laugh and see the funny side of things.
10/I have lost interest in my appearance.
14/I can enjoy a good book or TV program.
6/I feel cheerful.
Our study used the cut-off values recommended by the author of the HADS: scores greater than 11 on either subscale were considered significant cases of psychiatric morbidity; scores of 8–10 signified the presence of disorders; scores of 7 or less were considered normal. Using these cut-off values for the total scores for the two subscales of the HADS, we found the rates of depression and anxiety to be 27.2 and 23 %, respectively.
It is feasible to use a cross-sectional approach to interpret data relating to the translation of a screening tool [5–8, 15, 16]. The HADS is an extensively used psychometric tool that has been utilized directly and in translated versions in various languages. The Arabic version of the HADS has been tested in a number of clinical and community settings [5–8]; however, it has hitherto seldom been employed in an A&E department setting. The present study is the first to apply the HADS in an Arabic context: the translation was well accepted by the patients, which is in accordance with the previously reported high levels of general acceptability of the HADS [7, 8, 15]. In contrast with the results for some other translated versions [16, 17], we identified no problems with any of the HADS items in the Arabic version [7, 8].
We found the results of the internal consistency and confirmatory factor analyses to be significant: they appear to underline the reliability and validity of the Arabic version of the HADS in the context of an A&E department. As with the results of other studies [16, 18], the present investigation observed a strong correlation between the anxiety and depression subscales. This correlation may have been the result of similarities between anxiety and depression in terms of symptomatology as well as in their postulated background biopsychosocial etiological models. The validity analyses of the Arabic version of the HADS revealed a two-factor structure, in which six items in each of the two factors were loaded correctly, but one item for each factor was loaded in the opposite manner. This structure may be due to intercorrelation between the anxiety and depression subscales; it is very unlikely to be the result of flaws in the items in the HADS instrument. These findings substantiate the basis for the two-factor structure for the Arabic version of the HADS, and they are in line with the results of other studies [17, 19–24].
In the present study, we found the overall occurrence of anxiety to be 27.2 %, that of depression 23.0 %. The rates of these psychiatric comorbidities in a hospital A&E department are different from those reported in other studies and may be due to the use of different cut-off scores. Another potential contributing factor may be the present study having adopted a wider nonspecific patient pool, i.e., all patients presenting to the A&E department with any complaints. By contrast, most other similar studies investigating A&E departments focused primarily on patients presenting with one particular complaint. For example, a study conducted in Brazil examined patients with chest pain: it reported a higher occurrence rate for anxiety of 33.9 % and for depression of 30.5 % . In an Indian study, the rate of combined anxiety and depression was determined to be 23 % among patients who presented to the A&E department of a university hospital with chest pain. That is very similar to the results found in the present study . However, one Turkish study of an A&E department observed anxiety in 38.1 % of patients with non-cardiac chest pain compared with 40 % of patients with cardiac chest pain; depression was observed in 52.3 % of cardiac chest pain patients versus 52.1 % of non-cardiac chest pain patients . Those findings are higher than the results obtained in the present study. However, a similar Turkish study observed anxiety in 23 % of patients with chest pain, which is lower than the frequency observed in this investigation . A very high occurrence of anxiety (up to 73.3 %) was noted in another study, which focused on patients who presented at an A&E department with nonspecific chest pain;  that is in contrast to the lower reported frequency of combined anxiety and depression among 21 % of patients who presented at an A&E department following substance abuse. A recent study in France assessing the proficiency of physicians in detecting anxiety and depression among the general pool of patients who presented at an A&E department found the occurrence of anxiety to be 47 % and that of depression to be 27 % .
This study has a few limitations that deserve mention. One of these was including only subjects who were found to be clinically stable; thus, the results cannot be regarded as being truly representative of all patients presenting at a hospital A&E department. In addition, owing to the clinical context in the present study, it was not feasible to conduct a follow-up evaluation of positively screened cases by a psychiatrist toward further testing the sensitivity and specificity of the HADS. However, our findings do provide evidence regarding the underlying two-factor structure of the HADS.
To the best of our knowledge, the present study is the first to be based on factor analysis in the subspecialty of an A&E department using the Arabic translation of the HADS. This study found that despite the hectic working environment of an A&E department, the HADS performed well in screening for the two most prevalent psychiatric comorbidities—anxiety and depression. Our findings underscore the merits of the HADS—especially in light of the well-established fact that non-psychiatrist physicians have less ability to screen for psychiatric conditions in general. However, efficient processes and protocol still need to be developed in the Arab context for prompt follow-up psychiatric assessments of cases identified using the HADS so to ensure integrated care planning from a more holistic perspective.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Cassem EH. Depression and anxiety secondary to medical illness. Psychiatr Clin North Am. 1990;13:597–612.PubMedGoogle Scholar
- Uwakwe R. Psychiatric morbidity in elderly patients admitted to non-psychiatric wards in a general/teaching hospital in Nigeria. Int J Geriatr Psychiatry. 2000;15:346–54.View ArticlePubMedGoogle Scholar
- Alexander PJ, Dinesh N, Vidyasagar MS. Psychiatric morbidity among cancer patients and its relationship with awareness of illness and expectations about treatment outcome. Acta Oncol. 1993;32:623–6.View ArticlePubMedGoogle Scholar
- Becker S. Detection of somatiztion and depression in primary care in Saudi Arabia. Soc Psychiatry Psychiatr Epidemiol. 2004;39:962–6.View ArticlePubMedGoogle Scholar
- El Raufaie OE, Absood G. Validity study of the hospital anxiety and depression scale among a group of Saudi patients. Br J Psychiatry. 1987;151:687–8.View ArticleGoogle Scholar
- El Rufaie OE, Albar AA, Al Dabal BK. Identifying anxiety and depressive disorders among primary care patients: a pilot study. Acta Psychiatr Scand. 1988;77:280–2.View ArticlePubMedGoogle Scholar
- Malasi TH, Mirza IA, el Islam MF. Validation of the Hospital Anxiety and Depression Scale in Arab patients. Acta Psychiatr Scand. 1991;84:323–6.View ArticlePubMedGoogle Scholar
- El Rufaie OE, Absood GH, Abou-Saleh MT. Retesting the validity of the Arabic version of the hospital anxiety and depression (HAD) scale in primary health care. Soc Psychiatry Psychiatr Epidemiol. 1995;30:26–31.View ArticlePubMedGoogle Scholar
- Silverstone PH. Prevalence of psychiatric disorders in medical inpatients. J Nerv Ment Dis. 1996;184:43–51.View ArticlePubMedGoogle Scholar
- Silverstone PH, Lemay T, Elliott J, Hsu V, Starko R. The prevalence of major depressive disorder and low self-esteem in medical inpatients. Can J Psychiatry. 1996;41:67–74.PubMedGoogle Scholar
- Zigmond AS, Sanith RP. The hospital anxiety and depression scale. Acta Psychaitr Scand. 1983;67:361–70.View ArticleGoogle Scholar
- Ingvar B, Alv A, Tone T. The validity of the hospital anxiety and depression scale: an updated literature review. J Psychosom Res. 2002;52:69–77.View ArticleGoogle Scholar
- Snaith P. Commentary. The hospital anxiety and depression scale. HQLO. 2003;1:29.PubMedPubMed CentralGoogle Scholar
- Hermann C. International experiences with the Hospital Anxiety and depression Scale. A review of validation data and clinical results. J Psychosom Res. 1997;42:17–41.View ArticleGoogle Scholar
- Montazeri A, Vahadaninia M, Ebrhimi M, Jarvandi S. The hospital anxiety and depression scale (HADS): translation and validation study of Iranian version. HQLO. 2003;1:14.PubMedPubMed CentralGoogle Scholar
- Thomas BC, Devi N, Sarita GP. Reliability & validity of the Malayalam hospital anxiety & depression scale (HADS) in cancer patients. Indian J Med Res. 2005;122:395–9.PubMedGoogle Scholar
- Costantini M, Musso M, Viterbori P. Detecting psychological distress in cancer patients: validity of the Italian version of hospital anxiety and depression Scale. Support Care Cancer. 1999;7:121–7.View ArticlePubMedGoogle Scholar
- Perruche F, Elie C, d'Ussel M, Ray P, Thys F, Bleichner G,et al. Anxiety and depression are unrecognised in emergency patients admitted to the observation care unit. Emerg Med J. 2011;28:662–5.Google Scholar
- Clark LA, Watson D. Tripartite model of anxiety and depression: psychometric evidence and taxonomic implications. J Abnorm Psychol. 1991;100:316–36.View ArticlePubMedGoogle Scholar
- Kessler RC, Nelson CB, McGonagle KA, Liu J, Swartz M, Blazer DG. Comorbidity of DSM III R major depressive disorder in the general population: results from the US National Comorbidity Survey. Br J Psychiatry. 1996;30:17–30.Google Scholar
- Sartorius N, Ustun TB, Lecrubier Y. Depression comorbid with anxiety:results from the WHO study on psychological disorders in primary health care. Br J Psychiatry. 1996;30:38–43.Google Scholar
- Mezzich JE, Ahn CW, Fabrega HJ. Patterns of psychiatric comorbidity in a large population presenting for care. In: Maser JD, Cloninger CR, editors. Comorbidity of Mood and Anxiety Disorders. Washington, DC: American Psychiatric Press; 1990. p. 189–204.Google Scholar
- Mykletun A, Stordal E, Dahl AA. Hospital Anxiety and Depression (HAD) scale: factor structure, item analyses and internal consistency in a larger population. Br J Psychiatry. 2001;179:540–4.View ArticlePubMedGoogle Scholar
- Soares-Filho GL, Freire RC, Biancha K, Pacheco T, Volschan A, Valença AM, et al. Use of the Hospital anxiety and depression scale (HADS) in a cardiac emergency room chest pain unit. Clinics. 2009;64:209–14.Google Scholar
- Srinivasan K, Joseph W. A study of lifetime prevalence of anxiety and depressive disorders in patients presenting with chest pain to emergency medicine. Gen Hosp Psychiatry. 2004;26:470–4.View ArticlePubMedGoogle Scholar
- Eken C, Oktay C, Bacanli A, Gulen B, Koparan C, Ugras S et al. Anxiety and depressive disorders in patients presenting with chest pain to the emergency department: A comparison between cardiac and non-cardiac origin. J Emerg Med. 2010;39:144–50.Google Scholar
- Demiryoguran NS, Karcioglu O, Topacoglu H, Kiyan S, Ozbay D, Onur E, et al. Anxiety disorder in patients with non-specific chest pain in the emergency setting. Emerg Med J. 2006;23:99–102.View ArticlePubMedPubMed CentralGoogle Scholar
- Kuijpers PM, Denollet J, LousbergR WH, Crijns H, Honig A. Validity of the hospital anxiety and depression scale for use with patients with noncardiac chest pain. Psychosomatics. 2003;44:329–35.View ArticlePubMedGoogle Scholar
- Kinner SA, Alati R, Watt K, Najman JM, Fowler G, Green D. Substance misuse, anxiety and depression and urgency of presentation to a public emergency department in Australia. Emerg Med Australas. 2005;17:363–70.View ArticlePubMedGoogle Scholar