Assessing quality indicators related to mental health emergency room utilization
BMC Emergency Medicine volume 19, Article number: 8 (2019)
This descriptive study compared 2014–15 to 2005–06 data on the quality of mental health services (MHS) in relation to emergency room (ER) use to assess the impact of the 2005 Quebec MH reform regarding access, continuity and appropriateness of care for patients with mental illnesses (PMI).
Data emanated from the Quebec Integrated Chronic Disease Surveillance System (Quebec/Canada). Participants (865,255 for 2014–15; 817,395 for 2005–06) were age 12 or over, with at least one MI, including substance use disorders (SUD), diagnosed during an ER visit, outpatient treatment or hospitalization. Variables included: access (ER use/frequency, hospitalization rates, outpatient consultations preceding an ER visit), care continuity (outpatient consultations following an ER visit/hospitalization, consecutive returns to the ERs), and care appropriateness (high ER use, recurrence of yearly ER visits, length of hospitalization). Frequency distributions were calculated on sex, age and geographic area for ER visits/hospitalizations in 2014–15, and between 2014 and 15 and 2005–06.
PMI accounted for 12 % of the Quebec population in 2014–15 (n = 865,255), of whom 39% visited an ER for any reason. Amount and frequency of ER use and number/length of hospitalizations were almost twice as high for PMI versus patients without MI; 17% of PMI were also high/very high ER users and were frequently hospitalized. Among PMI, ER users were also frequent users of outpatient services despite a lack of follow-up appointments after ER visits or hospitalizations. Findings revealed some positive changes over time, such as decreased ER and hospitalization rates; yet overall access, continuity and appropriateness of care, as measured in this study, remained low.
This study demonstrated that the Quebec reform did not produce a substantial impact on ER use or substantially improved care, as hypothesized. Better access and continuity of care should be promoted to reduce the high prevalence of ER use among PMI. Quality improvement in MHS may be realized if ERs are supported by substantial and well-integrated community MH networks.
Quality improvement in mental health (MH) systems is a priority in most countries [1,2,3]. One in four individuals will experience a mental illness (MI) in their lifetimes . The prevalence of MI is increasing particularly as populations age, with healthcare costs expected to reach $80 billion in Canada by 2021 . In 2013, 60% of the Canadian MH budget was allocated to hospital inpatient services . MH systems in developed countries (United Kingdom, Australia, Belgium, etc.) have undergone major transformation in recent decades aimed at improving overall performance [7,8,9,10,11], primary care [12, 13], service integration [14, 15], care continuity , and in adopting multidisciplinary teams, and recovery best-practices (e.g. care pathways, intensive case management, assertive community treatment) [17,18,19]. In Canada, the 2005 Quebec MH reform  followed international trends [7,8,9,10,11], integrating MH and primary care services, and introducing recovery best-practices for improved healthcare quality . International studies supported these reforms in demonstrating that 43–67% of individuals [22,23,24], did not consult with healthcare professionals for MI or SUD. The ERs became the preferred destination for individuals facing deteriorating MH conditions . Canadian and American studies estimate that 4–12% of ER visits are for MH reasons [26,27,28], increasing ER use by 15% or more in the past few years [27, 29]. ER use serves as a barometer for estimating quality in MHS.
Indicators used to assess MHS quality and impact on MH reforms include access, continuity and appropriateness of care [2, 30, 31], with ER attendance as a key indicator of health system access [32, 33]. Canadian and international studies have reported elevated rates of high (more than 4) and very high (more than 12) ER visits/year among PMI, particularly those with co-occurring MI and chronic physical illnesses or SUD [34,35,36], as compared with other patients [36,37,38,39,40,41]. PMI also tended toward recurrent ER use over many years [38, 42], depending upon symptom severity, or medication adjustment issues . Fear of stigma may have discouraged disclosure among primary care patients, leading to under-diagnosis, and suboptimal patient management, another factor in ER overuse for MH reasons [43, 44]. Studies found that 8–32% of patients are hospitalized for MH reasons [45,46,47,48], identifying a relationship between high ER use and psychiatric hospitalization . Among PMI, high ER users also use outpatient services frequently [37, 49]. Their multiple, serious needs persist despite concerted professional efforts to address them . As PMI receive little attention to their problems in daily living [22,23,24], the ERs become the first point of service for conditions that do not require emergency services. One US study suggested that treatment in community-level services was adequate for many MH cases, as 20–40% those treated in ERs were not urgent . This situation reflects lack of access to care elsewhere in the MH network  and the inability of patients to obtain appointments in a timely manner.
The avoidance of repeated ER visits/hospitalizations through better continuity of care following an ER visit or hospitalization is critical for MHS improvement, especially among patients with more severe and co-occurring conditions . Outpatient appointments held within 7 to 30 days of discharge may address potential side effects associated with medication changes, and promote treatment compliance , avoiding return ER visits/hospitalizations, which occur within 30 days after discharge in 10–15% of cases . One study found that only 17% of re-hospitalized patients had received a follow-up appointment prior to discharge . Moreover, PMI remained in hospital longer than others [55,56,57,58], increasing the likelihood of readmission as compared with those discharged after brief admissions . Best practices recommend short hospitalizations , and close post-discharge follow-up  for enhancing social integration and recovery.
Previous studies have assessed the impact of MH reforms [60, 61] in terms of service utilization, access to care, ER (re)admission rates, and hospitalization [62,63,64]. Others evaluated best practices in patient management . Yet, to the best of our knowledge, no study has focused on quality indicators related to ER use for any reason among PMI in the context of system reforms, including access, continuity or appropriateness of care. Moreover, very few studies have assessed ER use or service quality using large samples of PMI, or included robust longitudinal frameworks [46, 66, 67]. Based on data from the Quebec Integrated Chronic Disease Surveillance System (QICDSS), this descriptive study compared data from 2014 to 15 and 2005–06 on MHS quality indicators in relation to ER use, in order to evaluate the impact of the 2005 Quebec MH reform on access, continuity and appropriateness of care provided to PMI. We hypothesized that overall ER use would be reduced over the course of the reform, and the integration of ER and MH medical services in Quebec health networks reinforced.
Background and data sources
All Canadian residents are covered by universal health insurance, mainly administrated by the provinces and territories . Quebec MHS networks include psychiatric hospitals or psychiatric departments in general hospitals, community health and social service centers (CLSCs), general practitioners (GPs) or psychologists in private practice, addiction centers, and community organizations offering crisis services, self-help groups, and the like. Under the Quebec National Institute of Public Health (INSPQ), the QICDSS collects information on prevalence, incidence, and health service use for the entire Quebec population of 8.2 million , through billing files for each medical service performed by physicians in the public health system (e.g. GPs, psychiatrists), who are paid on a fee-for-service basis.
The QICDSS brings together administrative data from the following sources: 1) the health insurance registry (FIPA) containing demographic and geographic records on individuals with valid health insurance numbers (HIN); 2) medical acts compensated by the Quebec Health Insurance Regime (RAMQ) (e.g., ER visits); and 3) the hospitalization databank (MED-ECHO), containing information on hospitalization and discharge. Every Quebec resident registered at RAMQ is assigned a unique identifier, or health insurance number (HIN). The HIN is used to link the various data sources comprising the QICDSS. The linkage probability is 100% between the health insurance registry and the medical acts file, and 99% between the registry and the hospitalization file. We collected data for 2014–15 and for 2005–06. The public health ethics committee of the Douglas MH University Institute and the Quebec Access to Information Commission evaluated and approved the study.
Data were extracted for individuals 12 years old and over, diagnosed with at least one MI, including SUD, during an ER visit, hospitalization, or outpatient consultation for the fiscal year from April 1st 2014 to March 31st 2015, and for the comparison year, 2005–06. Diagnoses were based on the International Classification of Diseases, Ninth Revision (ICD-9) and the Tenth Revision of the Med-Echo (ICD-10), using the following codes: 290 to 319; F00 to F99; 571.0–571.3; K70.0-K70.04; 535.3; K29.2; 425.5; I42.6; 357.5; G62.1; E24.4, E52, G31.2, G72.1, K70.9, K85.2, K86.0; O35.4 (Table 1). MI included anxio-depressive disorder, personality disorder, schizophrenia, attention deficit disorder with or without hyperactivity (AD/HD), and other (e.g. senile dementia simple form, non-organic psychosis) . SUD included alcohol or drug disorders (abuse, dependence). Different combinations of co-occurring disorders, such as MI/SUD, MI/physical illness (e.g. cancer, diabetes) or SUD/physical illness, were included. Final samples consisted of 865,255 patients with MI representing 12.2% of the Quebec population for 2014–15; and 817,395 PMI representing 12.3% of the Quebec population for 2005–06.
Based on the literature [1, 2, 30], the following variables were identified: Access to care: 1) ER use and frequency of ER use, 2) hospitalization and length of stay, 3) number of outpatient consultations for any reason during year of study among PMI using the ERs; and 4) consultations among PMI without ER use; 5) outpatient consultations within the week preceding an ER visit for any reason; and 6) outpatient consultations for the year prior to an ER visit for MH reasons. Continuity of care: 1–2) outpatient consultations for MH reasons within a week, or month, after an ER visit, or 3–4) hospitalization under the same conditions; 5) repeat ER visits for any reason within 30 days after a first visit to ERs, or after a hospitalization; and 6) hospitalization of patients who re-visited the ERs and reasons for re-visits (e.g. MI, SUD, physical illness, co-occurring MI-SUD). Appropriateness of care: 1) high and very high ER users, 2) recurring yearly use of ERs among PMI (3 and 5 recurring years vs 1 year of at least one visit to ERs, from 2005 to 06 to 2015–15), and 3) hospitalization for 30 days or longer for any reason.
Socio-demographic data were collected from the INSPQ databanks for sex (male, female), age (12–17 years, 18–24 years, 25–44 years, 45–64 years, and 65 years or over), geographic area (metropolitan census areas: MCAs: Montreal, urban areas: > 100,000 inhabitants, semi-urban areas: < 100,000, rural areas: < 10,000), on material or social deprivation based on education level (without high school diploma), unemployment, average income, proportions of single-parent families, individuals living alone, and individuals separated, divorced, or widowed. For this study, material or social deprivation was classified in quintiles, with the last quintile representing the most deprived group.
The hospitalization and medical acts files were analyzed as received, with missing information reported in the study limitations. Regarding the health insurance registry, we checked the eligibility of individuals for public health insurance and whether health insurance cards were valid. However, adjustment was made for young adults (women aged 18 to 25 and men aged 18 to 29) to compensate for delays in the renewal of health insurance cards for this group. Admissibility to the study for this group was based on eligibility criteria alone.
Socio-demographic statistics for patients with/without MIs visiting the ERs were calculated first, and group comparisons made. Frequency distributions for each variable were produced for 2014–15, and for 2014–15 vs. 2005–06. An assessment of trends in MHS use for the ten-year observation period was performed, based on the age-standardized method from the 2014–15 age structure of the population, and relevant findings retained. Frequency distributions on ER use, hospitalization, length of hospitalization, and hospitalization 30 days or longer were also computed for patients without MI. Finally, outpatient consultations for PMI who used ERs were compared with those of PMI who did not use ERs during the study period (2014–15) in order to evaluate overall MHS use. No comparison tests were presented, as all associations were significant for the very large sample size. Confidence intervals were also too narrow to provide substantial information.
Socio-demographic portrait of PMI in 2014–15
Of 341,030 PMI who used the ERs in 2014–15, 58% were women, and mean age 51 years; 41% resided in Montreal and 22% in other urban areas, with 41 and 45% in the two lowest quintiles of material and social deprivation respectively (data not shown: DNS). Patients without MI who visited ERs included 52% women, with a mean age of 49 years; 38% resided in Montreal and 25% in rural areas; 39 and 37% were in the two lowest quintiles of material or social deprivation (DNS). Regarding quality indicators, few differences emerged between the sexes, but practices advantaged women slightly over men (e.g. higher use of weekly or yearly consultations prior to ER visits, fewer return ER visits within 30 days; Tables 2 and 4).
PMI aged 12–17 most frequently received outpatient consultations for MH reasons for the one-year period preceding an ER visit (52%) versus other age groups, as well as for weekly and monthly outpatient consultations following an ER visit (14%; 31% respectively) or following hospitalization for MH reasons (16%; 34%: Table 2). The 12–17 year group rated lowest on most other indicators. The 65+ age group sought most outpatient consultations for any reason in the week prior to an ER visit (49%); but least outpatient consultations in the year prior to an ER visit (34%), and outpatient consultations for MH reasons within a week (6%) or month (15%) following an ER visit or hospitalization (Table 2). The 65+ age group had the highest percentage of return ER visits within 30 days (42%; Table 4), recurrent ER visits over 3 years (6%; Table 5), and hospitalizations exceeding 30 days (9%; Table 6). The 45–64 age group, followed closely by the 25–44 age group, also made the greatest number of ER visits over five consecutive years (5%; Table 5).
Differences in ER use by geographic area
Montreal PMI had the most frequent outpatient consultations over a one-year period (mean 21 for PMI using ERs; mean 8 for PMI not using ERs), and for the week preceding an ER visit (41%; Table 2), with the highest rates for: return to ERs within 30 days (34%), re-hospitalization (33%) (Table 4), and hospitalization exceeding 30 days (4%; Table 6). Montreal also had the highest percentage of outpatient consultations for MH reasons in the week following an ER visit (11%; Table 2). Outpatient consultation rates for MH reasons in the year preceding an ER visit were highest in areas with 100,000+ inhabitants (26%; Table 2), as were return ER visits over five consecutive years (4%; Table 5). By contrast, rural areas had the lowest outpatient consultation rates over a one-year period (mean 15 for PMI using ERs; mean 7 for PMI not using ERs), and the lowest rates for the week or month following an ER visit (9%; 24%), or the week following hospitalization (6%; Table 2). Rural areas had the highest rate for three-year recurring ER visits (6%; Table 5), but lowest hospitalization rates exceeding 30 days (2%; Table 6).
Access to care (2014–15 versus 2005–06)
Nearly 40% of PMI visited ERs in 2014–15, 2.3 visits each, on average; 34% of them were hospitalized for an average 16 days. Between 2005-06 and 2014–15, ER use and hospitalizations decreased by over 3% among PMI (Table 3). By contrast, 22% of patients without MI visited ERs twice a year on average; 20% were hospitalized for an average eight-day stay. ER use and hospitalization decreased by 6 and 2%, respectively, following implementation of the reform (DNS).
The 341,030 PMI who used ERs in 2014–15 had an average of 18 outpatient consultations (median: 10), compared with 8 (median: 5) among PMI who did not use ERs. Outpatient consultations among ER patients remained relatively stable after 2005–06 (increased of 0.01%), whereas consultations decreased by 11% among PMI who did not use the ERs. More than 37% of PMI had an outpatient consultation within 1 week preceding an ER visit for any reason, and 45% an outpatient consultation within the year preceding an ER visit for MH reasons. From 2005 to 06 to 2014–15, consultations in the week prior to an ER visit increased less than 1%, but increased nearly 24% for the year prior to an ER visit (Table 2).
Continuity of care (2014–15 vs 2005–06)
Nearly 11% of PMI had an outpatient consultation for MH reasons within the week following an ER visit, and within 1 month for 25% of patients in 2014–15. By 1 week post-hospitalization, 7% of PMI had received an outpatient consultation, whereas 19% received an outpatient consultation for MH reasons within 30 days. From 2005 to 06 to 2014–15, an 18% decrease in outpatient consultations within a week, and 14% within a month following ER visits were observed, but outpatient consultations within a week or a month following hospitalization increased 41 and 33% respectively (Table 2). Among PMI who visited the ERs in 2014–15, 34% returned after discharge within fewer than 30 days, of whom 30% were hospitalized. The principal reason for return to the ERs, whether after an ER visit, or hospitalization, was physical illness (75% ERs, hospitalization), followed by MH reasons exclusively (13%; 15%), then for co-occurring MI/physical illness (7%; 4%). From 2005–06 to 2014–15, an increase of 3% was observed in return ER visits within 30 days (Table 4).
Appropriateness of care (2014–15 vs 2005–06)
Over 16% of PMI who visited ERs in 2014–15 were high ER users (mean 6 visits/year), of whom 58% were hospitalized. Less than 1% were very high ER users (average 17 visits/year), yet 73% of them were hospitalized. From 2005–06 to 2014–15, ER use by high or very high users decreased by 0.3 and 4% respectively (Table 3). Most PMI (72%) presented at an ER for only a single year throughout the 2005–06/2014–15 period; 6% presented over three consecutive years (e.g. from 2012 to 13 to 2014–15); and 4% over five consecutive years (e.g. 2010–11 to 2014–15). From 2005–06 to 2014–15, use of ERs for 3 consecutive years increased by 4%, but for 5 consecutive years decreased by 13% (Table 5). More than 3% of PMI were hospitalized longer than 30 days (Table 6), as compared with 0.3% for patients without MIs (DNS). Comparing 2014–15 to 2005–06, hospitalizations exceeding 30 days decreased 4% among PMI (Table 6), but 25% among patients without MIs (DNS).
This study evaluated changes in MHS quality related to ER use in terms of access, continuity and appropriateness of care for a cohort of PMI, comparing data from 2014–15 vs. 2005–06 when the Quebec MH reform was introduced. We hypothesized that overall ER use would decrease, and that service integration would improve between Quebec ERs and other MH medical services. As hypothesized, ERs and hospitalization for any reasons decreased for PMI from 2005–06 to 2014–15; but their decrease in ER use was two times less than that of patients without MI. Outpatient consultations for MH reasons in the year preceding ER visits also improved considerably: in 2014–15, less than half of PMI had no outpatient consultations for the year prior to their ER visit. Contrary to expectation, indicators of continuity of care or appropriateness revealed either deterioration or only slight improvement from 2005–06 to 2014–15. Positive changes were generally less pronounced for PMI compared with patients without MI. However, some improvement occurred on outpatient consultations for MH reasons following hospitalizations; they increased considerably but were very low overall. Regarding ER visits over 5 consecutive years, rates decreased slightly over time.
The overall findings confirmed a 12% annual prevalence of PMI, similar to rates reported in other North American epidemiological studies, ranging from 12 to 18% [70, 71]. Concerning ER use among PMI, rates in this study, at close to 40%, were much higher than in other North American studies, at 4–12% [26,27,28, 46]. Our results may be explained by the fact that we investigated ER use for any reason among a cohort of patients diagnosed with MI over a 12-month period. Other studies have tended to investigate ER use for MH reasons only. Yet our data were less likely to underestimate ER use by PMI, as opposed to studies that reported data on ER use for MH reasons exclusively. Such methodological distinctions limit the usefulness of comparisons.
Regarding socio-demographic composition of the cohort, we noted that PMI were slightly more materially and socially deprived than other ER patients, suggesting considerable vulnerability among PMI using ERs, as portrayed elsewhere [72, 73]. Older patients received lower quality care overall, including fewer outpatient consultations prior to ER visits, and fewer within 1 week or month after an ER visit or hospitalization for MH reasons; their rates of return to ERs within 30 days, hospitalizations exceeding 30 days, and recurrent ER use over 3 years for any reason were also lowest. Under-diagnosis of MI [74, 75] or lower prioritization of MH issues among older patients may explain these lower outpatient consultation rates. The fact that older PMI often presented with chronic, co-occurring physical illness may explain their other poor outcomes, and need for additional care, which drove their return ER visits , and extended hospitalization rates further exacerbated by placement issues . By contrast, the 12–17 year group received significantly more MHS before and after ER visits or hospitalizations, aimed at countering MI in adulthood [77, 78]. The MH reform may have played a role in prioritizing youth MH; early-onset MI occurs frequently , and carries a poor prognosis . However, younger patients used fewer MHS overall, as highlighted in previous research [81, 82]. In Montreal, higher rates of outpatient consultations, return ER visits within 30 days, re-hospitalizations, and hospitalizations exceeding 30 days may have been due to greater numbers of vulnerable patients with complex problems . More availability of primary care, walk-in clinics without follow-up in Montreal may also have increased outpatient consultations in the week preceding ER visits. Furthermore, rates of outpatient consultations, outpatient consultations following ER visits (within a week, or month) and hospitalizations (within a week), as well as higher recurring ER use over 3 years in rural areas, reflected their relative lack of primary care coverage as compared with cities .
Concerning access to services, we observed that ER use, frequency of use, and number/ length of hospitalizations were almost double for PMI versus other patients. International studies confirm the frequency of ER use [34, 37, 49], with hospitalization rates similar to ours at 15–32% [48, 56], and extended hospitalization among PMI . Limited or delayed access to primary care and other services, and inadequate follow-up for PMI may explain these results [10, 50]. Yet decreased ER use and fewer hospitalizations over time did suggest some improvement in access to care. Measures introduced over the course of the Quebec MH reform aimed at reducing ER use/hospitalization and supporting PMI included: increased access to primary care, prevention strategies by MH teams in CLSCs, and increased mobile crisis services, and GPs working with respondent-psychiatrists (shared care). Incentives were also provided to improve MH supports in medical clinics [10, 21]. Decreased ER use and hospitalization rates in this study were contrary to results obtained in other North American studies, but only those for MH reasons [48, 85].
Overall, PMI who used ERs also used outpatient services twice as often as those who did not use ERs, but patterns of service use remained stable. By contrast, outpatient service use by PMI who did not use ERs decreased by 11%, confirming their high, and inappropriate use of health services [34, 86]. Yet the results also revealed that some patients received intensive, quality outpatient follow-up in terms of monthly access to family physicians. Moreover, close to 40% of patients received outpatient consultations for any reason within a week prior to ER visits, suggesting the occurrence of ER visits on physician recommendation. Yet the fact that most did not consult a physician before ER visits suggested ongoing difficulties with rapid access to medical clinics or psychiatrists, an interpretation further reinforced by evidence that more than half of patients had not consulted a physician for MH reasons in the year previous to an ER visit. In Quebec, 45% of PMI have no family physician , as opposed to 25% of the general population . Previous research also reported that only 45% of PMI in Canada consulted their regular physician for MH problems . Moreover, according to international studies, two thirds of PMI avoided seeking help altogether [22, 90], perhaps viewing their problems as too complex or specialized for GPs. Similarly, studies underline difficulties among GPs around providing MH care [91,92,93].
Regarding continuity of care, we found that most patients did not receive follow-up appointments within 7 to 30 days after an ER visit, or hospitalization for MH reasons. The situation had deteriorated in 2014–15 compared with 2005–05 for outpatient consultations after ER visits, but follow-up to hospitalization had improved considerably. Most studies identified barriers to care continuity among PMI , with average failure rates at 58% (range 18 to 67%) on outpatient follow-up after ER visits or hospitalizations [94,95,96,97], which coincides with our results. Improvement in outpatient consultation rates after hospitalizations may be explained by the MH reform priority on reducing hospitalizations , an international trend [7, 9, 98]. One-third of patients made return ER visits within 30 days, suggesting the persistence of problems in continuity of care. ER readmission rates for MI (with or without hospitalization) within 30 days range from 10 to 40% in the literature, depending on patient population [99, 100]. Severe MI (e.g. schizophrenia), co-occurring MI/SUD or MI/chronic physical illness are difficult to treat during an ER visit, particularly a first visit, requiring several medical consultations [34, 37, 52]. Our results showed that physical illness was the main reason for return to ERs among PMI. Medication use may also involve physical side effects requiring outpatient appointments proximal to discharge [1, 30].
Regarding appropriateness of care, 17% of patients were high/very high ER users, and often hospitalized. A systematic review found that high/very high ER users ranged from 0.03 to 18% among PMI , who were also high users of other services ; they tended to consult hospital-based professionals during crises . High ER use may be explained by significant vulnerability, socioeconomic precariousness, and social isolation among PMI [72, 73], as well as the high prevalence of psychosocial problems associated with co-occurring physical conditions requiring specialized care combined with close follow-up in primary care . Poor coordination of outpatient services and low overall continuity of care  frequently contribute to high hospitalization rates. Again, difficulties in the implementation of continuous services in the Quebec reform context may explain these results .
While most PMI made a single visit to an ER throughout the 2005–06 to 2014–15 period, nearly one in ten did so over three to five consecutive years during the same period. Moreover, ER use increased over three consecutive years, which may be explained by the chronicity often associated with MI. International studies reported that chronic episodic depression may last up to 3 years, especially when accompanied by suicidal ideation [101, 102]. Having two or more MI, SUD or severe MI such as personality disorders may also increase recurrent yearly ER use [43, 103]. Thus, our results highlight some of the challenges inherent in managing patients with complex MH profiles who require close monitoring or frequent medication readjustment by a multidisciplinary team in order to avoid recurring yearly ER use [10, 43]. The fact that recurring yearly ER use decreased over 5 consecutive years after 2005–06 suggests some post-reform improvement in the management of patients with serious and chronic problems. In Quebec, intensive case management and assertive community treatment targeting high ER users with serious MIs have been consolidated since the 2005–06 MH reform .
Even though only 3% of PMI were hospitalized for over 30 days, decreasing over time, their hospitalization rates were ten times that of patients without MI, while hospitalizations for this group were five times lower. An American study found that PMI remained in hospital 38% longer than others , while another reported hospitalization rates exceeding 30 days for PMI with severe disorders , similar to our results. Illness severity remains the main predictor for length of hospitalization, particularly in schizophrenia and psychosis [76, 83].
This study has limitations that should be acknowledged. First, outcomes of the reform may have been affected by the particular indicators selected to measure access, continuity and appropriateness of care. As well, the QICDSS used administrative databanks not originally designed for epidemiological research; they did not include statistics for physicians working in CLSCs who also follow vulnerable PMI . Results from the QICDSS were also slightly underestimated due to a few percentages of missing data on ER diagnoses for the MH population. However, data extracted from the QICDSS may provide a basis for, and complement to, future epidemiological research. Finally, as this study involved ER service use in the Quebec MH population, comparative studies are needed for other Canadian provinces or countries to more adequately evaluate the quality of MHS.
This study is the first to evaluate recent data on MHS quality indicators related to ER use for a cohort of PMI in Quebec, and to compare results with data for the period coinciding with implementation of the Quebec MH reform (2005–06). While we hypothesized that the reform would improve access, continuity, and appropriateness of care, and reduce ER attendance, results did not strongly support these hypotheses. Some improvement occurred over the 10-year period, yet gains among PMI were generally smaller than among patients without MI. In fact, while slightly fewer PMI visited ERs over time, the decrease among patients without MI was twice as great. With service improvement targets unmet, MH seems to remain the “Cinderella” of the Quebec health and social service system. The literature on MHS quality improvement supports various strategies which, if better implemented, could be integrated into the Quebec system to increase ER functioning and enhance coordination between ERs and MH community networks. These include the consolidation of MH and primary care services and follow-up practices such as assertive community treatment (ACT), intensive community management (ICM) or case management, targeting patients with more severe or co-occurring MH profiles, including high or very high ER users. Shared-care, involving closer collaboration between psychiatrists and other MH primary care providers, particularly GPs, may also favor MHS quality improvement. More systematic and routine outpatient follow-up to ER visits or hospitalizations, based on inter-organizational collaboration, may also reduce return ER visits within 30 days. Improving access and continuity of care for the most vulnerable individuals may also reduce the high prevalence of ER use in this population. Alternative services such as crisis resolution teams and home intervention teams could also be implemented with good effect. Overall, there is much room for quality improvement in MHS, including better support for ERs by integrating them within solid community-based MH networks.
Assertive community treatment
Attention deficit disorder with or without hyperactivity
Community health and social service center
Data not shown
Health insurance number
International Classification of Diseases
Intensive case management
Quebec National Institute of Public Health
Hospitalization databank/Maintenance et exploitation des données pour l’étude de la clientèle hospitalière
Mental health services
Patients with mental illnesses
Quebec Integrated Chronic Disease Surveillance System
Quebec Health Insurance Regime
Substance use disorders
Hermann RC, Mattke S, Somekh D, Silfverhielm H, Goldner E, Glover G, Pirkis J, Mainz J, Chan JA. Quality indicators for international benchmarking of mental health care. Int J Qual Health Care. 2006;18(Suppl 1):31–8.
Hermann RC, Leff HS, Palmer RH, Yang D, Teller T, Provost S, Jakubiak C, Chan J. Quality measures for mental health care: results from a national inventory. Med Care Res Rev. 2000;57(Supplement 2):136–54.
Kilbourne AM, Beck K, Spaeth-Rublee B, Ramanuj P, O'Brien RW, Tomoyasu N, Pincus HA. Measuring and improving the quality of mental health care: a global perspective. World Psychiatry. 2018;17(1):30–8.
World Federation of Mental Health: Mental health in the workplace: 2017. http://www.globalmentalhealth.org/sites/default/files/2017%20WMHD%20Mental%20Health%20in%20the%20Workplace.pdf.
Smetanin P, Stiff D, Briante C, Khan M. Life and economic impact of hypothetical intervention scenarios on major mental illnesses in Canada: 2011 to 2041: risk Analytica, on behalf of the Mental Health Commission of Canada; 2012.
Wang J, Jacobs P, Ohinmaa A, Dezetter A, Lesage A. Public Expenditures for Mental Health Services in Canadian Provinces: Depenses publiques pour les services de sante mentale dans les provinces canadiennes. Can J Psychiatry. 2018;63(4):250–6.
Hogan M. Mental health reform under policy mainstreaming: needed, but uncertain. Epidemiol Psychiatr Sci. 2014;23(1):11–6.
Whiteford H, Harris M, Diminic S. Mental health service system improvement: translating evidence into policy. Aust N Z J Psychiatry. 2013;47(8):703–6.
Nicaise P, Dubois V, Lorant V. Mental health care delivery system reform in Belgium: the challenge of achieving deinstitutionalisation whilst addressing fragmentation of care at the same time. Health Policy. 2014;115(2–3):120–7.
Fleury MJ, Acef S. Mental healthcare system transformation: international tendencies and Quebec-France perspectives. Sante Ment Que. 2013;38(1):17–41.
Thiebaut GC, Farand L, Fleury MJ. Policies and mental health action plans in OECD: lessons for Quebec? Sante Ment Que. 2014;39(1):65–84.
Fleury MJ. Primary mental healthcare reform in Quebec and the role and coordination strategies of general practitioners. Sante Ment Que. 2014;39(1):25–45.
Gillies D, Buykx P, Parker AG, Hetrick SE. Consultation liaison in primary care for people with mental disorders. Cochrane Database Syst Rev. 2015;9:CD007193.
Kisely S, Lesage A. Mental health services in Australia. Sante Ment Que. 2014;39(1):195–208.
Kilbourne AM, Irmiter C, Capobianco J, Reynolds K, Milner K, Barry K, Blow FC. Improving integrated general medical and mental health services in community-based practices. Adm Policy Ment Health. 2008;35(5):337–45.
Puntis S, Rugkasa J, Forrest A, Mitchell A, Burns T. Associations between continuity of care and patient outcomes in mental health care: a systematic review. Psychiatr Serv. 2015;66(4):354–63.
Dieterich M, Irving CB, Park B, Marshall M. Intensive case management for severe mental illness. Cochrane Database Syst Rev. 2010;10:CD007906.
Schmidt SJ, Lange M, Schottle D, Karow A, Schimmelmann BG, Lambert M. Negative symptoms, anxiety, and depression as mechanisms of change of a 12-month trial of assertive community treatment as part of integrated care in patients with first- and multi-episode schizophrenia spectrum disorders (ACCESS I trial). Eur Arch Psychiatry Clin Neurosci. 2018;268(6):593-602.
Schrijvers G, van Hoorn A, Huiskes N. The care pathway: concepts and theories: an introduction. Int J Integr Care. 2012;12(Spec Ed Integrated Care Pathways):e192.
Ministère de la Santé et des Services sociaux. Plan d'action en santé mentale 2005–2010 - La force des liens. Québec: Ministère de la Santé et des Services sociaux; 2005.
Fleury MJ, Grenier G, Vallee C, Aube D, Farand L, Bamvita JM, Cyr G. Implementation of the Quebec mental health reform (2005-2015). BMC Health Serv Res. 2016;16(1):586.
Andrews G, Issakidis C, Carter G. Shortfall in mental health service utilisation. Br J Psychiatry. 2001;179(5):417–25.
Alonso J, Angermeyer MC, Bernert S, Bruffaerts R, Brugha TS, Bryson H, de Girolamo G, Graaf R, Demyttenaere K, Gasquet I, et al. Use of mental health services in Europe: results from the European study of the epidemiology of mental disorders (ESEMeD) project. Acta Psychiatr Scand Suppl. 2004;420:47–54.
Verhaak PF, Prins MA, Spreeuwenberg P, Draisma S, van Balkom TJ, Bensing JM, Laurant MG, van Marwijk HW, van der Meer K, Penninx BW. Receiving treatment for common mental disorders. Gen Hosp Psychiatry. 2009;31(1):46–55.
Pines JM, Hilton JA, Weber EJ, Alkemade AJ, Al Shabanah H, Anderson PD, Bernhard M, Bertini A, Gries A, Ferrandiz S, et al. International perspectives on emergency department crowding. Acad Emerg Med Off J Soc Acad Emerg Med. 2011;18(12):1358–70.
Matsumoto CL, O'Driscoll T, Lawrance J, Jakubow A, Madden S, Kelly L. A 5 year retrospective study of emergency department use in Northwest Ontario: a measure of mental health and addictions needs. CJEM. 2017;19(5):381–5.
Weiss AJ, Barrett ML, Heslin KC, Stocks C. Trends in emergency department visits involving mental and substance use disorders, 2006–2013. Statistical brief 216: Agency for Healthcare Research and Quality; 2016.
Raymond L, Pelletier MJP. Bilan de la situation des services d’urgence période 13 de l’année 2013–2014. Montréal: Association québécoise d’établissements de santé et de services sociaux (AQESSS); 2014.
Agency for Healthcare Research and Quality. Chartbook on care coordination. Measures of care coordination: preventable emergency department visits. Rockville: Agency for Healthcare Research and Quality; 2015. http://www.ahrq.gov/research/findings/nhqrdr/2014chartbooks/carecoordination/carecoord-measures2.html
Hermann R, Mattke S, OECD Mental Health Care Panel. Selecting indicators for the quality of mental health care at the health system level in OECD Countries, vol. 17. Paris: OECD; 2004.
Mental Health Commission of Canada. Informing the future: mental health indicators for Canada. Ottawa: Mental Health Commission of Canada; 2015.
Association of Faculties of Medicine of Canada (AFMC): Recommendations for mental health care delivery metric for the new health accord. AFMC submission to minister Philpott: 2016. https://afmc.ca/sites/default/files/documents/Mental_Health_Submission_Federal_Minister_of_Health_Health_Accord_Response.pdf.
Sorup CM, Jacobsen P, Forberg JL. Evaluation of emergency department performance - a systematic review on recommended performance and quality-in-care measures. Scand J Trauma Resusc Emerg Med. 2013;21(1):62.
Doupe MB, Palatnick W, Day S, Chateau D, Soodeen R-A, Burchill C, Derksen S. Frequent users of emergency departments: developing standard definitions and defining prominent risk factors. Ann Emerg Med. 2012;60(1):24–32.
Buhumaid R, Riley J, Sattarian M, Bregman B, Blanchard J. Characteristics of frequent users of the emergency department with psychiatric conditions. J Health Care Poor Underserved. 2015;26(3):941–50.
Ngamini-Ngui A, Fleury MJ, Moisan J, Gregoire JP, Lesage A, Vanasse A. High users of emergency departments in Quebec among patients with both schizophrenia and a substance use disorder. Psychiatr Serv. 2014;65(11):1389–91.
Krieg C, Hudon C, Chouinard MC, Dufour I. Individual predictors of frequent emergency department use: a scoping review. BMC Health Serv Res. 2016;16(1):594.
Doran KM, Raven MC, Rosenheck RA. What drives frequent emergency department use in an integrated health system? National data from the veterans health administration. Ann Emerg Med. 2013;62(2):151–9.
Aagaard J, Aagaard A, Buus N. Predictors of frequent visits to a psychiatric emergency room: a large-scale register study combined with a small-scale interview study. Int J Nurs Stud. 2014;51(7):1003–13.
Liu SW, Nagurney JT, Chang Y, Parry BA, Smulowitz P, Atlas SJ. Frequent ED users: are most visits for mental health, alcohol, and drug-related complaints? Am J Emerg Med. 2013;31(10):1512–5.
Minassian A, Vilke GM, Wilson MP. Frequent emergency department visits are more prevalent in psychiatric, alcohol abuse, and dual diagnosis conditions than in chronic viral illnesses such as hepatitis and human immunodeficiency virus. J Emerg Med. 2013;45(4):520–5.
Beck A, Sanchez-Walker E, Evans LJ, Harris V, Pegler R, Cross S. Characteristics of people who rapidly and frequently reattend the emergency department for mental health needs. Eur J Emerg Med. 2016;23(5):351–5.
Poremski D, Kunjithapatham G, Koh D, Lim XY, Alexander M, Lee C. Lost keys: understanding service providers’ impressions of frequent visitors to psychiatric emergency Services in Singapore. Psychiatr Serv. 2017;68(4):390–5.
Mehl-Madrona LE. Prevalence of psychiatric diagnoses among frequent users of rural emergency medical services. Can J Rural Med. 2008;13(1):22–30.
Barratt H, Rojas-Garcia A, Clarke K, Moore A, Whittington C, Stockton S, Thomas J, Pilling S, Raine R. Epidemiology of mental health attendances at emergency departments: systematic review and meta-analysis. PLoS One. 2016;11(4):e0154449.
Commissaire à la santé et au bien-être (CSBE). Utilisation des urgences en santé mentale et en santé physique au Québec. Québec: Commissaire à la santé et au bien-être; 2017.
Smith MW, Stocks C, Santora PB. Hospital readmission rates and emergency department visits for mental health and substance abuse conditions. Community Ment Health J. 2015;51(2):190–7.
Heslin KC, Elixhauser A, Steiner C. Hospitalizations involving mental and substance use disorders among adults. Statistical brief 191. Healthcare cost and utilization project. Rockville: Agency for Healthcare Research and Quality; 2012.
Schmidt M. Frequent visitors at the psychiatric emergency room - a literature review. Psychiatr Q. 2018;89(1):11–32.
Zeman L, Arfken CL. Decreasing unnecessary care in a psychiatric emergency service. Psychiatr Serv. 2006;57(1):137–8.
Nesper AC, Morris BA, Scher LM, Holmes JF. Effect of Decreasing County mental health services on the emergency department. Ann Emerg Med. 2016;67(4):525–30.
Douzenis A, Seretis D, Nika S, Nikolaidou P, Papadopoulou A, Rizos EN, Christodoulou C, Tsopelas C, Mitchell D, Lykouras L. Factors affecting hospital stay in psychiatric patients: the role of active comorbidity. BMC Health Serv Res. 2012;12:166.
Pfeiffer PN, Ganoczy D, Zivin K, McCarthy JF, Valenstein M, Blow FC. Outpatient follow-up after psychiatric hospitalization for depression and later readmission and treatment adequacy. Psychiatr Serv. 2012;63(12):1239–42.
Boudreaux ED, Allen MH, Claassen C, Currier GW, Bertman L, Glick R, Park J, Feifel D, Camargo CA Jr., PERC. The psychiatric emergency research Collaboration-01: methods and results. Gen Hosp Psychiatry. 2009;31(6):515–22.
Babalola O, Gormez V, Alwan NA, Johnstone P, Sampson S. Length of hospitalisation for people with severe mental illness. Cochrane Database Syst Rev. 2014;30(1):CD000384.
Hamilton JE, Desai PV, Hoot NR, Gearing RE, Jeong S, Meyer TD, Soares JC, Begley CE. Factors associated with the likelihood of hospitalization following emergency department visits for behavioral health conditions. Acad Emerg Med. 2016;23(11):1257–66.
Eaton WW, Mortensen PB, Herrman H, Freeman H, Bilker W, Burgess P, Wooff K. Long-term course of hospitalization for schizophrenia: part I. Risk for rehospitalization. Schizophr Bull. 1992;18(2):217–28.
Pauselli L, Verdolini N, Bernardini F, Compton MT, Quartesan R. Predictors of length of stay in an inpatient psychiatric unit of a general Hospital in Perugia, Italy. Psychiatr Q. 2017;88(1):129–40.
Compton MT, Craw J, Rudisch BE. Determinants of inpatient psychiatric length of stay in an urban county hospital. Psychiatr Q. 2006;77(2):173–88.
Garfield RL, Lave JR, Donohue JM. Health reform and the scope of benefits for mental health and substance use disorder services. Psychiatr Serv. 2010;61(11):1081–6.
Priebe S, Badesconyi A, Fioritti A, Hansson L, Kilian R, Torres-Gonzales F, Turner T, Wiersma D. Reinstitutionalisation in mental health care: comparison of data on service provision from six European countries. BMJ. 2005;330(7483):123–6.
Jones W, Godldner EM, Butler AC, McEwan K. Informing the future: mental health indicators for Canada technical report. Vancouver: Centre for Applied Research in Mental Health & Addiction (CARMHA), Simon Fraser University, Harbour Centre; 2015.
Alberta Health Services Addiction and Mental Health. Performance of the addiction and mental system in Alberta Health Services 2013/14. Edmonton: Alberta Health Services, Addiction and Mental Health; 2015.
Mental Health Commission of Canada. Making the case for investing in mental health in Canada. Ottawa: Mental Health Commission of Canada; 2017.
Druss BG, Wang PS, Sampson NA, Olfson M, Pincus HA, Wells KB, Kessler RC. Understanding mental health treatment in persons without mental diagnoses: results from the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2007;64(10):1196–203.
Lesage A, Émond V. Surveillance des troubles mentaux au Québec: prévalence, mortalité et profil d'utilisation des services. In: Surveillance des maladies chroniques, vol. 6. Québec: Institut national de santé publique; 2012.
Statistiques Canada: Enquête sur la santé dans les collectivités canadiennes - Composante annuelle (ESCC). 2017.
Mossialos E, Wenzl M, Osborn R, Sanak D. 2015 international profiles of health care systems. Washington, DC: The Commonwealth Fund; 2016.
Blais C, Jean S, Sirois C, Rochette L, Plante C, Larocque I, Doucet M, Ruel G, Simard M, Gamache P, et al. Quebec integrated chronic disease surveillance system (QICDSS), an innovative approach. Chronic Dis Inj Can. 2014;34(4):226–35.
National Institute of Mental Health: Any mental illness (AMI) among U.S. adults. 2016. https://www.nimh.nih.gov/health/statistics/prevalence/any-mental-illness-ami-among-us-adultsshtml.
Kisely S, Lin E, Lesage A, Gilbert C, Smith M, Campbell L, Vasiliadis H. Use of administrative data for the surveillance of mental disorders in 5 provinces. Can J Psychiatr. 2009;54:571–5.
Boyer L, Dassa D, Belzeaux R, Henry JM, Samuelian JC, Baumstarck-Barrau K, Lancon C. Frequent visits to a French psychiatric emergency service: diagnostic variability in psychotic disorders. Psychiatr Serv. 2011;62(8):966–70.
Brunero S, Fairbrother G, Lee S, Davis M. Clinical characteristics of people with mental health problems who frequently attend an Australian emergency department. Aust Health Rev. 2007;31(3):462–70.
Searby A, Maude P, McGrath I. Dual diagnosis in older adults: a review. Issues Ment Health Nurs. 2015;36(2):104–11.
Allan CE, Valkanova V, Ebmeier KP. Depression in older people is underdiagnosed. Practitioner. 2014;258(1771):19–22 2-3.
Chung W, Oh SM, Suh T, Lee YM, Oh BH, Yoon CW. Determinants of length of stay for psychiatric inpatients: analysis of a national database covering the entire Korean elderly population. Health Policy. 2010;94(2):120–8.
Newton AS, Rosychuk RJ, Niu X, Radomski AD, McGrath PJ. Emergency department use and Postvisit Care for Anxiety and Stress Disorders among Children: a population-based cohort study in Alberta, Canada. Aust Health Rev. 2016;32(10):658–63.
Mapelli E, Black T, Doan Q. Trends in pediatric emergency department utilization for mental health-related visits. J Pediatr. 2015;167(4):905–10.
von Klitzing K, Dohnert M, Kroll M, Grube M. Mental disorders in early childhood. Dtsch Arztebl Int. 2015;112(21–22):375–86 quiz 386.
Castagnini AC, Foldager L, Caffo E, Thomsen PH. Early-adult outcome of child and adolescent mental disorders as evidenced by a national-based case register survey. Eur Psychiatry. 2016;38:45–50.
Plaistow J, Masson K, Koch D, Wilson J, Stark RM, Jones PB, Lennox BR. Young people's views of UK mental health services. Early Interv Psychiatry. 2014;8(1):12–23.
Heflinger CA, Hinshaw SP. Stigma in child and adolescent mental health services research: understanding professional and institutional stigmatization of youth with mental health problems and their families. Adm Policy Ment Health. 2010;37(1–2):61–70.
Tulloch AD, Fearon P, David AS. Length of stay of general psychiatric inpatients in the United States: systematic review. Adm Policy Ment Health. 2011;38(3):155–68.
Masters GA, Baldessarini RJ, Ongur D, Centorrino F. Factors associated with length of psychiatric hospitalization. Compr Psychiatry. 2014;55(3):681–7.
McDermott KW, Elixhauser A, Sun R. Trends in hospital stays in the United States, 2005–2014. Statistical brief #225. Rockville: Agency for Healthcare Research and Quality; 2017.
Hansagi H, Olsson M, Hussain A, Ohlen G. Is information sharing between the emergency department and primary care useful to the care of frequent emergency department users? Eur J Emerg Med. 2008;15(1):34–9.
Institut de la statistique du Québec (ISQ). Portrait des statistiques de la santé mentale des québécois. Résultats de l'Enquête sur la santé dans les collectivités canadiennes Santé mentale 2012; Portrait chiffré. Québec: Gouvernement du Québec, Institut de la statistique du Québec; 2015.
Statistics Canada: Access to a regular medical doctor, 2014. 2015. https://www.statcan.gc.ca/pub/82-625-x/2015001/article/14177-enghtm.
Gagné M-A. Avancement des objectifs des soins de santé mentale axés sur la collaboration. Mississauga: Initiative canadienne de collaboration en santé mentale; 2005.
Prins MA, Verhaak PFM, van der Meer K, Penninx BW, Bensing JM. Primary care patients with anxiety and depression: need for care from the patient's perspective. J Affect Disord. 2009;119(1–3):163–71.
Walters P, Tylee A, Goldberg D. Psychiatry in primary care. In: Murray RM, Kendler KS, McGuffin P, Wessely S, Castle DJ, editors. Essential psychiatry. 4th ed. UK: Cambridge University Press; 2008. p. 479–97.
Fleury MJ, Imboua A, Aube D, Farand L, Lambert Y. General practitioners’ management of mental disorders: a rewarding practice with considerable obstacles. BMC Fam Practice. 2012;13:19.
Barkil-Oteo A. Collaborative care for depression in primary care: how psychiatry could “troubleshoot” current treatments and practices. Yale J Biol Med. 2013;86(2):139–46.
Kreyenbuhl J, Nossel IR, Dixon LB. Disengagement from mental health treatment among individuals with schizophrenia and strategies for facilitating connections to care: a review of the literature. Schizophr Bull. 2009;35(4):696–703.
Cuffel BJ, Held M, Goldman W. Predictive models and the effectiveness of strategies for improving outpatient follow-up under managed care. Psychiatr Serv. 2002;53(11):1438–43.
Kruse GR, Rohland BM. Factors associated with attendance at a first appointment after discharge from a psychiatric hospital. Psychiatr Serv. 2002;53(4):473–6.
Stein BD, Kogan JN, Sorbero MJ, Thompson W, Hutchinson SL. Predictors of timely follow-up care among medicaid-enrolled adults after psychiatric hospitalization. Psychiatr Serv. 2007;58(12):1563–9.
Zhou W, Yu Y, Yang M, Chen L, Xiao S. Policy development and challenges of global mental health: a systematic review of published studies of national-level mental health policies. BMC Psychiatry. 2018;18(1):138.
Durbin J, Lin E, Layne C, Teed M. Is readmission a valid indicator of the quality of inpatient psychiatric care? J Behav Health Serv Res. 2007;34(2):137–50.
Vandyk AD, Harrison MB, VanDenKerkhof EG, Graham ID, Ross-White A. Frequent emergency department use by individuals seeking mental healthcare: a systematic search and review. Arch Psychiatr Nurs. 2013;27(4):171–8.
Klein DN, Kotov R. Course of depression in a 10-year prospective study: evidence for qualitatively distinct subgroups. J Abnorm Psychol. 2016;125(3):337–48.
Murphy JA, Byrne GJ. Prevalence and correlates of the proposed DSM-5 diagnosis of chronic depressive disorder. J Affect Disord. 2012;139(2):172–80.
Richard-Lepouriel H, Weber K, Baertschi M, DiGiorgio S, Sarasin F, Canuto A. Predictors of recurrent use of psychiatric emergency services. Psychiatr Serv. 2015;66(5):521–6.
Imboua A, Fleury MJ. General practitioners: practices and integration of mental health care in Quebec. Sante Ment Que. 2009;34(1):55–76.
We gratefully acknowledge the support of the Fonds de la recherche en santé du Québec (FRSQ). Also, we would like to thank other co-investigators especially Dr. Alain Lesage, and professionals from the Quebec National Institute of Public Health for their participation in this study.
This study was funded by the Fonds de la recherche en santé du Québec (FRSQ), grant number 3082.
Availability of data and materials
The datasets analyzed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The public health ethics committee of the Douglas Mental Health University Institute and the Quebec Access to Information Commission evaluated and approved the study. Since the information used came from a database covering almost the entire Quebec population, the consent to participate was not applicable.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Fleury, MJ., Fortin, M., Rochette, L. et al. Assessing quality indicators related to mental health emergency room utilization. BMC Emerg Med 19, 8 (2019). https://doi.org/10.1186/s12873-019-0223-8