The article you requested is

Suicidality Is Associated With Medication Access Problems in Publicly Insured Psychiatric Patients

J Clin Psychiatry 2010;71(12):1657-1663
10.4088/JCP.10m06177gre

Background: Beginning January 1, 2006, the Medicare Part D prescription drug benefit shifted drug coverage from Medicaid to the new Medicare Part D program for patients who were eligible for both Medicare and Medicaid benefits (“dual-eligibles”). These patients were randomly assigned to a private Part D plan and came under specific formulary and utilization management procedures of the plan in which they were enrolled.

Objective: To examine the relationship between physician-reported medication switches, discontinuations, and other access problems and suicidal ideation or behavior among “dual-eligible” psychiatric patients.

Method: Data were collected in 3 cross-sectional cycles in 2006 (January–April, May–August, and September–December) as part of the National Study of Medicaid and Medicare Psychopharmacologic Treatment Access and Continuity using through-the-mail, practice-based survey research methods. Data from the third cycle, representing all events since January 1, 2006, were used for these analyses. A national sample of psychiatrists randomly selected from the AMA Masterfile provided clinically detailed data on 1 systematically selected, dual-eligible psychiatric patient (N = 908). Propensity score analyses adjusted for patient sociodemographics, treatment setting, diagnoses, and psychiatric symptom severity.

Results: Patients who experienced medication switches, discontinuations, and other access problems had 3 times the rate of suicidal ideation or behavior compared with patients with no access problems (22.0% vs 7.4%, P < .0001). Mean odds ratios and excess probabilities were highest for patients who were clinically stable but were required to switch medications (31.8%; mean OR = 4.87, mean P = 8.92–5, excess probability = 0.21). Patients who experienced discontinuations (26.4%; mean OR = 2.13, mean P = 2.12–2, excess probability = 0.12), other access problems (18.7%; mean OR = 3.01, mean P = 1.03–5, excess probability = 0.15), and multiple access problems (22.3%; mean OR = 2.88, mean P = 4.10–5, excess probability = 0.14) also had significantly increased suicidal ideation or behavior.

Conclusion: Increased occurrences of suicidal ideation or behavior appear to be associated with disruptions in patient medication access and continuity. Clinicians need to be aware of the possibility of increased suicidality when, for administrative reasons, a clinically stable patient’s medication regimen is altered. Dual-eligible psychiatric patients represent a highly vulnerable group with a substantial burden of illness; these findings underscore the need to provide special protections for this population.

J Clin Psychiatry 2010;71(12):1657–1663

Submitted: April 14, 2010; accepted September 13, 2010(doi:10.4088/JCP.10m06177gre).

Corresponding author: Eve K. Mościcki, ScD, MPH, 1000 Wilson Blvd, Ste 1825, Arlington, VA 22209 (emoscicki@psych.org).

Suicidality Is Associated With Medication Access Problems in Publicly Insured Psychiatric Patients

Background: Beginning January 1, 2006, the Medicare Part D prescription drug benefit shifted drug coverage from Medicaid to the new Medicare Part D program for patients who were eligible for both Medicare and Medicaid benefits (“dual-eligibles”). These patients were randomly assigned to a private Part D plan and came under specific formulary and utilization management procedures of the plan in which they were enrolled.

Objective: To examine the relationship between physician-reported medication switches, discontinuations, and other access problems and suicidal ideation or behavior among “dual-eligible” psychiatric patients.

Method: Data were collected in 3 cross-sectional cycles in 2006 (January–April, May–August, and September–December) as part of the National Study of Medicaid and Medicare Psychopharmacologic Treatment Access and Continuity using through-the-mail, practice-based survey research methods. Data from the third cycle, representing all events since January 1, 2006, were used for these analyses. A national sample of psychiatrists randomly selected from the AMA Masterfile provided clinically detailed data on 1 systematically selected, dual-eligible psychiatric patient (N = 908). Propensity score analyses adjusted for patient sociodemographics, treatment setting, diagnoses, and psychiatric symptom severity.

Results: Patients who experienced medication switches, discontinuations, and other access problems had 3 times the rate of suicidal ideation or behavior compared with patients with no access problems (22.0% vs 7.4%, P < .0001). Mean odds ratios and excess probabilities were highest for patients who were clinically stable but were required to switch medications (31.8%; mean OR = 4.87, mean P = 8.92–5, excess probability = 0.21). Patients who experienced discontinuations (26.4%; mean OR = 2.13, mean P = 2.12–2, excess probability = 0.12), other access problems (18.7%; mean OR = 3.01, mean P = 1.03–5, excess probability = 0.15), and multiple access problems (22.3%; mean OR = 2.88, mean P = 4.10–5, excess probability = 0.14) also had significantly increased suicidal ideation or behavior.

Conclusion: Increased occurrences of suicidal ideation or behavior appear to be associated with disruptions in patient medication access and continuity. Clinicians need to be aware of the possibility of increased suicidality when, for administrative reasons, a clinically stable patient’s medication regimen is altered. Dual-eligible psychiatric patients represent a highly vulnerable group with a substantial burden of illness; these findings underscore the need to provide special protections for this population.

J Clin Psychiatry 2010;71(12):1657–1663

Submitted: April 14, 2010; accepted September 13, 2010(doi:10.4088/JCP.10m06177gre).

Corresponding author: Eve K. Mościcki, ScD, MPH, 1000 Wilson Blvd, Ste 1825, Arlington, VA 22209 (emoscicki@psych.org).

Suicide is a fatal, self-inflicted destructive act with explicit or inferred intent to die.1 Psychiatric illnesses are the primary distal risk processes that underlie the vast majority of suicide mortality and morbidity2–12 and are considered to be necessary conditions under which suicidal behaviors may occur.9,12,13

Although suicide death is a rare event in the general population,2,14 suicide morbidity and mortality among psychiatric patients are far from rare and are ongoing concerns in providing adequate care.6 Appropriate treatment of psychiatric disorders is a central component of suicide prevention.1,5,7,13 Individuals suffering from comorbid conditions are an especially vulnerable group3,6,10,15–20 and in need of stable care to facilitate symptom remission, improvement in functioning, and recovery. A key element of treatment for such patients is pharmacotherapy. Compelling evidence demonstrates that appropriate pharmacologic treatment can reduce suicide risk among patients with bipolar illness21,22 and schizophrenia.23 At the ecological level, higher rates of prescriptions for selective serotonin reuptake inhibitors have consistently been linked with lower population rates of suicide fatalities in defined geographic regions (eg, Gibbons et al24).

Disruptions in treatment access and continuity of care can negatively affect the course of disease in seriously ill psychiatric patients and potentially precipitate adverse clinical and life events.25–35 Disruption of pharmacologic treatment is of particular concern, as these treatments generally represent first-line, evidence-based interventions for most psychiatric patients. For example, disruptions in medication regimen have been associated with lower patient adherence,36 increases in adverse events,25–30 and increased emergency department visits and hospitalization.37–39 Gaps in medication coverage for patients with schizophrenia have been associated with increased symptom exacerbation,35 likelihood of relapse,40 increased hospitalization,34,35 and homelessness.35 There is also evidence that switching antipsychotic medications for clinically stable patients with chronic schizophrenia is associated with greater side effects and higher discontinuations than maintaining patients on stable medication regimens.41 While there are compelling clinical reasons for modifying a patient’s medications to personalize treatment (eg, Quitkin et al,42 Stroup et al,43 Fava et al44), the practice of switching medications for nonclinical reasons has received limited attention.

With few exceptions, most studies of discontinuity in pharmacotherapy have not addressed suicidality, and systematic data examining the relationship between medication disruptions, switches, or other access problems and suicidality have been limited. There is increasing interest in understanding how medication access problems and other treatment discontinuities may affect suicidal ideation or behavior among psychiatric patients. The American Psychiatric Association has called attention to the potential harmful effects of treatment disruption in its Practice Guideline for the Assessment and Treatment of Patients with Suicidal Behaviors.45 Changes in treatment access have been linked with both suicide mortality31–33 and morbidity.29 West et al29 examined the experiences of a large sample of psychiatric patients in the first 4 months following the implementation of the Medicare Part D prescription drug benefit on January 1, 2006. The investigators found a 22% increase in suicidal ideation or behavior among patients who experienced disruptions in continuity of care as reported by physicians. It is not clear whether this group was disproportionately affected, however, as data were not available on adverse events among patients who did not experience problems with medication access. The goal of the current study is to examine more fully the relationship between medication switches, discontinuations, and other access problems and suicidal ideation or behavior among psychiatric patients using more extensive data, in order to identify potential avenues for prevention.

METHOD

Procedures

The implementation of the Medicare Part D prescription drug benefit under the Medicare Prescription Drug Improvement and Modernization Act of 2003 provided a unique opportunity to conduct a naturalistic study of the potential association of suicidality with changes in medication access. The Medicare Part D prescription drug benefit shifted drug coverage from Medicaid to the new Medicare Part D program for patients eligible to receive benefits from both Medicare and Medicaid (“dual eligibles”), beginning January 1, 2006. This policy affected approximately 2 million patients with mental and addictive illnesses.29 All dually eligible patients were randomly assigned to a private Part D plan and came under specific formulary and utilization management procedures of the plan in which they were enrolled. Antipsychotics, antidepressants, and anticonvulsants are given special protections, in that plans are required to cover at least 1, but not all, formulations of each molecule in the class. In an effort to control potentially high costs, however, plans employ various formulary and utilization management tools to influence use.46–49 Strategies may include, for example, prior authorization, switching to a generic drug, or an approach such as step therapy/“fail first,” which requires enrollees to document a poor response to 1 or more less-expensive medications before they are granted coverage of a more expensive one.

Data for the current study were collected as part of the National Study of Medicaid and Medicare Psychopharmacologic Treatment Access and Continuity. The data collection procedures have been described in detail elsewhere.29,30 Briefly, a national sample of psychiatrists provided information on dual-eligible psychiatric patients. Through-the-mail, practice-based survey research methods were used and included a $75 check in the study mailing as incentive to increase response. Data were collected in 3 cross-sectional cycles in 2006: January–April, May–August, and September–December. Each cycle covered the preceding time period that began January 1, 2006, with the third cycle covering January–December; response rates ranged from 66% to 75%. Across all 3 cycles, a total of 1,490 individual psychiatrists reported clinically detailed data on 1 systematically selected patient with dual eligibility. Data from the third and final data collection cycle, reported by 967 psychiatrists, were used for the analyses presented here.

Data included patient sociodemographic characteristics, patient diagnoses, current symptoms and symptom severity, patient’s prescription drug plan features during the period covered by the data collection cycle, any disruptions in the patient’s medication access or continuity since January 1, 2006, the extent and type of any disruption, and any adverse events since January 1, 2006. Adverse events included increased medication side effects, emergency room visits, psychiatric hospitalization, homelessness, incarceration, violent ideation or behavior, and suicidal ideation or behavior. The study was approved by the institutional review board of the American Psychiatric Institute for Research and Education.

Analyses

A patient was considered to have switched medications for administrative reasons if the physician reported that the patient was stable on treatment with a clinically desired or indicated medication, but was required to switch to a different medication because clinically preferred medication refills were not covered or approved. A patient was considered to have discontinued a medication if the physician reported that the medication was discontinued or temporarily stopped because of drug coverage, management or administration issues, or copayments. A patient was considered to have experienced suicidal ideation or behavior if the physician answered “yes” to the question, “Since January 1, 2006, has this patient had an increase in suicidal ideation or behavior?” Patients under 18, those missing information on sex or age, patients with diagnoses of alcohol/drug abuse only or personality disorders only, and patients in nursing homes were excluded from the analyses. The final sample size was 908.

Sociodemographic and clinical characteristics and medication access problems for patients with and without physician-reported suicidal ideation or behavior were compared using χ2 tests. Estimates were weighted to the target population, dual-eligible psychiatric patients in the United States. Weights were based on the probability of selection of the psychiatrist and the number of dual-eligible patients in the psychiatrists’ caseloads. Propensity score analyses50 adjusted for selected characteristics by creating matched pairs of patients who differed on whether they had (cases) or had not (noncases) experienced a medication access problem, to determine whether one group was more likely to also have experienced increased suicidal ideation or behavior. The propensity score models matched patients on sex; age group (< 25, 26–40, 41–55, 56–64, or 65 years and over); race (white vs nonwhite); diagnosis of schizophrenia and/or bipolar disorder versus no such diagnosis; severity of current depressive, anxiety, psychotic/manic, alcohol/substance use, and sleep symptoms (none, mild, moderate, severe); and region (Midwest, South, West, and Northeast). This approach was used to estimate the difference in the probability of increased suicidal ideation or behavior between patients who had experienced a medication access problem and those who had not; it was also used to calculate odds ratios (ORs). Four models were estimated, 2 for specifically operationalized medication access problems (medication switch and medication discontinuation), 1 for all other medication access problems not including switches or discontinuations, and a fourth that included any medication access problem. To tighten the confidence intervals of the effect parameters, the analyses were replicated 150 times for each model. We report the average of these estimated parameters.

Table 1

Click figure to enlarge

RESULTS

Weighted distributions of sociodemographic characteristics for US dual-eligible psychiatric patients with and without suicidal ideation or behavior during the study period are shown in Table 1. Overall, 56% (weighted) of the patients were female; the majority were white (71%) and 55 years of age or younger (70%). More patients (weighted frequency 31%) were seen by psychiatrists practicing in the South, and fewer (19%) were seen by psychiatrists practicing in the West; 51% were treated in a public clinic or outpatient facility.

There were no significant differences between patients with and without suicidal ideation or behavior on age, race, or treatment setting. There were significant differences by sex, with more females than males experiencing suicidal ideation or behavior, and by region, with a higher proportion of patients treated in the Midwest and a lower proportion treated in the Northeast having an increase in suicidality.

Forty-five percent (weighted) of all patients had a diagnosis of schizophrenia, 32% had a diagnosis of major depression, and nearly half (45%) had more than 1 diagnosis. Three out of 4 (76%) suffered from general medical conditions. Sixty-two percent of all patients experienced 1 or more medication access or continuity problem in the period since Medicare Part D was implemented.

Table 2

Click figure to enlarge

Weighted distributions of clinical characteristics for dual-eligible patients with and without suicidal ideation or behavior reported during the study period are shown in Table 2. Overall, nearly 16% (weighted) of patients had an increase in suicidal ideation or behavior reported during the past year. Patients with and without suicidal ideation or behavior did not differ significantly on the most frequent psychiatric diagnoses or on presence of general medical conditions. There were significant differences between groups on other psychiatric disorders, number of psychiatric diagnoses, symptom severity, other adverse events, and medication access problems. Patients who experienced increased suicidal ideation or behavior were significantly more likely to have a psychiatric diagnosis other than the most frequent ones reported, to have more than 1 psychiatric diagnosis, and to be rated by their physicians as having severe symptoms of depression and anxiety and severe sleep problems. These patients were also significantly more likely to have experienced other adverse events in addition to suicidal ideation or behavior. Weighted frequencies ranged from 21% for increased violent ideation or behavior to 36% for significantly worsened medication side effects. The rates of suicidal ideation or behavior in patients with medication access problems were 3 times higher than for patients with no access problems (22.0% vs 7.4%, P < .0001).

Patients who experienced medication access problems had increased probabilities of suicidal ideation or behavior regardless of the type of access problem (Table 3). The excess probabilities ranged from 12% to 21%; all associations were highly significant (P values for ORs shown in column 5). Excess probabilities and mean odds ratios were highest for patients who were clinically stable but were required to switch medications (mean OR = 4.87). Thirty-two percent of these patients experienced suicidal ideation or behavior, compared with 12% of patients not required to switch. Patients whose medication was discontinued or temporarily stopped had more than twice the odds of suicidality than did patients with no medication access problem (mean OR = 2.13). Patients who experienced 1 or more medication access problems had nearly 3 times the odds of suicidality than did patients with no medication access problem (mean OR = 2.88).

Table 3

Click figure to enlarge

DISCUSSION

This study examined the relationship between medication switches, discontinuations, and other medication access problems and physician-reported suicidal ideation or behavior. Our findings indicated strong and consistent relationships between access problems and suicidal ideation or behavior. Physicians reported that more than 1 in 5 patients who had any medication access problems also experienced suicidal ideation or behavior. Among patients who were specifically required to switch medications because their clinically preferred medication was not covered by their prescription drug benefit, nearly 1 in 3 experienced suicidal ideation or behavior.

The consequences of breaks in medication regimens for seriously ill psychiatric patients are well known.[1] The current naturalistic study confirms and extends previous work in this area in several ways. First, most studies of the consequences of medication disruption have examined outcomes such as emergency department visits35,37–39 or hospitalization34,35,37–39; a handful have also examined clinical outcomes such as symptom exacerbation.26,27,35,40 The current study is one of the few to show that suicidality can also be a potential consequence of medication disruption or a change in medication that is not clinically indicated.

Second, previous findings from studies of medication disruptions were derived primarily from studies of patients with schizophrenia or bipolar disorder,[2] small samples,26,40,51 or clinical trial data.26,27,41–44,52 Our naturalistic study provides evidence from a large and clinically diverse population of patients, seen in a wide range of clinical settings, that switching or discontinuing medications for nonclinical reasons may place vulnerable patients at greatly increased risk for destabilization and serious adverse events such as suicidality. Our findings on patients who did not experience suicidal ideation or behavior also provide evidence to support continuity of current medication regimens in patients who are clinically stable.

Third, most studies of treatment discontinuation have been conducted from the perspective of the individual patient and have focused on patient nonadherence as a major reason for medication disruption (eg, Lacro et al53). Some investigators have recently argued that nonadherence to treatment is multidimensional and can occur for a variety of reasons other than being a willful choice of the patient.34,51,54,55 The current study, through physician-reported data, provides further evidence that potential factors at the systems level may contribute to medication nonadherence, disruptions in medication regimen, and clinical consequences for patients and need to be considered.

The current findings are consistent with the stress-diathesis model, which suggests that higher risk for suicidal outcomes is associated with a greater number of stressors and a greater burden of illness.12,56–59 In our study, patients with increased suicidality were significantly more likely to have an increased burden of illness as indicated by more than 1 diagnosis, high rates of symptom severity, and more than 1 medication access problem. Although such multiple stressors present considerable challenges to patient care, they also present multiple opportunities to intervene to reduce risk and ease the burden of illness. One promising direction for preventing a suicidal outcome may be to reduce stressors for vulnerable patients when treatments are changed for administrative rather than clinical reasons. Clinicians need to be aware of the possibility of increased suicidality when a clinically stable patient’s medication regimen is altered and carefully monitor any switches in medications or other disruptions in medication continuity.26,27,41

Taken together, our findings support the recent call60 for improvement of mental health services through approaches from a variety of perspectives and point to the need to revise administrative policies related to medication access for seriously ill psychiatric patients. Prescription drug policies are largely driven by economic considerations,47,48 and it is likely that the majority of patients in the general population may not be adversely affected by changes in their medications. Dual-eligible psychiatric patients, however, represent a highly vulnerable group with a substantial burden of illness, and our findings underscore the need to provide special protections for this population.

Limitations

The findings of the current study should be interpreted with several important limitations in mind. First, information on patient experiences was derived from physician reports; it was not possible to validate the data against other sources of information such as chart reviews or administrative claims data. Second, clinicians were asked to report on increases in “suicidal ideation or behavior” as 1 item rather than providing separate reports for suicidal thinking, nonsuicidal self-injury, and suicidal self-injurious behaviors. It was not possible to determine, therefore, what proportion of patients experienced any level of suicidal ideation only, what proportion injured themselves without intent to die, and what proportion injured themselves with intent to die, ie, made a suicide attempt. Future work needs to separately ascertain suicidal thinking, nonsuicidal self-injury, and suicidal behaviors in order to examine whether disruptions in medication access may be more likely to be associated with some self-injurious behaviors or suicidal outcomes but not others. Third, access problems could have triggered increased patient contact, making the physician more likely to detect suicidal ideation. Fourth, this study could not address temporal sequence or causality, since the data were retrospective and collected in cross-sectional assessments. It was not possible, therefore, to ascertain whether medication access problems occurred before the observed increases in patient suicidal ideation or behavior, nor was it possible to determine whether patients with a prior history of suicidality were more likely to experience suicidality during the reporting period. A causal relationship between medication access problems and suicidality cannot be established on the basis of our data. We can only note that there was a strong association between medication access problems and clinician-reported increases in patient suicidal ideation or behavior within the reporting period, a finding that merits further investigation with longitudinal data.

CONCLUSION

The observational findings reported here have important implications for suicide prevention in clinical settings and merit further investigation. While the sequence of events is unknown and causality cannot be established with these data, the fact remains that increased occurrence of a serious clinical outcome—suicidal ideation or behavior—was significantly associated with disruptions in patient medication access and continuity that were previously attributed specifically to prescription drug coverage and management. Awareness that this potential set of circumstances at the systems level may affect highly vulnerable individuals provides important opportunities for preventive intervention. Whether patients with elevated rates of suicidal thinking or behavior are at greater risk for medication access problems, or whether access problems put severely ill patients at greater risk for suicidal outcomes, the observed link with administrative procedures suggests that prescription drug coverage and management policies that are sensitive to the needs of the most vulnerable patients may potentially ease suffering and ultimately save lives.

Author affiliations: American Psychiatric Institute for Research and Education (APIRE), Arlington, Virginia (Drs Mościcki, West, Rubio-Stipec, and Regier and Mr Rae); and Walter Reed Army Institute of Research, Silver Spring, Maryland (Dr Wilk).

Potential conflicts of interest: Dr Regier, executive director of APIRE, oversees all federal and industry-sponsored research and research training grants in APIRE but receives no external salary funding or honoraria from any government or industry sources. Drs Mościcki, West, Rubio-Stipec, and Wilk and Mr Rae report no potential conflict of interest.

Funding/support: This work was supported by an unrestricted grant from the American Psychiatric Foundation through a consortium of industry supporters, including AstraZeneca, Bristol-Myers Squibb, Eli Lilly, Forest, Janssen, Pfizer, and Wyeth. The authors had complete discretion and control over the design and conduct of the study, data analyses, and interpretation and reporting of the findings.

Previous presentations: Portions of this work were presented at the 162nd Annual Meeting of the American Psychiatric Association, May 16–21, 2009, San Francisco, California; Annual Research Meeting of AcademyHealth, June 28–30, 2009, Chicago, Illinois; 49th Annual NCDEU Meeting, June 29–July 2, 2009, Hollywood, Florida; 61st Institute of Psychiatric Services, October 8–11, 2009, New York, New York; and 138th Annual Meeting of the American Public Health Association, November 6–10, 2010, Denver, Colorado.

REFERENCES

1. Goldsmith SK, Pellmar TC, Kleinman AM, et al. Reducing Suicide: A National Imperative. Washington, DC: National Academies Press; 2002.

2. Mościcki EK. Suicidal behaviors among adults. In: Nock MK, ed. Oxford Handbook of Suicide and Self-Injury. Oxford, UK: Oxford University Press. In press.

3. Kessler RC, Berglund P, Borges G, et al. Trends in suicide ideation, plans, gestures, and attempts in the United States, 1990–1992 to 2001–2003. JAMA. 2005;293(20):2487–2495. PubMed doi:10.1001/jama.293.20.2487

4. Joe S, Baser RE, Breeden G, et al. Prevalence of and risk factors for lifetime suicide attempts among blacks in the United States. JAMA. 2006;296(17):2112–2123. PubMed doi:10.1001/jama.296.17.2112

5. Lesage AD, Boyer R, Grunberg F, et al. Suicide and mental disorders: a case-control study of young men. Am J Psychiatry. 1994;151(7):1063–1068. PubMed

6. Mann JJ. Neurobiology of suicidal behaviour. Nat Rev Neurosci. 2003;4(10):819–828. PubMed doi:10.1038/nrn1220

7. Mann JJ, Apter A, Bertolote J, et al. Suicide prevention strategies: a systematic review. JAMA. 2005;294(16):2064–2074. PubMed doi:10.1001/jama.294.16.2064

8. Conwell Y, Duberstein PR, Cox C, et al. Relationships of age and Axis I diagnoses in victims of completed suicide: a psychological autopsy study. Am J Psychiatry. 1996;153(8):1001–1008. PubMed

9. Rich CL, Young D, Fowler RC. San Diego Suicide Study I: young vs old subjects. Arch Gen Psychiatry. 1986;43(6):577–582. PubMed

10. Beautrais AL, Joyce PR, Mulder RT, et al. Prevalence and comorbidity of mental disorders in persons making serious suicide attempts: a case-control study. Am J Psychiatry. 1996;153(8):1009–1014. PubMed

11. Mościcki EK, O’Carroll P, Rae DS, et al. Suicide attempts in the Epidemiologic Catchment Area Study. Yale J Biol Med. 1988;61(3):259–268. PubMed

12. Mann JJ, Waternaux C, Haas GL, et al. Toward a clinical model of suicidal behavior in psychiatric patients. Am J Psychiatry. 1999;156(2):181–189. PubMed

13. Mościcki EK. Epidemiology of completed and attempted suicide: toward a framework for prevention. Clin Neurosci Res. 2001;1(5):310–323. doi:10.1016/S1566-2772(01)00032-9

14. Xu JQ, Kochanek KD, Murphy SL, et al. Deaths: Final data for 2007. Hyattsville, Maryland: National Center for Health Statistics. 2009;58(1). http://www.cdc.gov/nchs/data/nvsr/nvsr58/nvsr58_01.pdf. Updated August 19, 2009. Accessed October 21, 2010.

15. Hawton K, Houston K, Haw C, et al. Comorbidity of Axis I and Axis II disorders in patients who attempted suicide. Am J Psychiatry. 2003;160(8):1494–1500. PubMed doi:10.1176/appi.ajp.160.8.1494

16. Hawton K, Sutton L, Haw C, et al. Schizophrenia and suicide: systematic review of risk factors. Br J Psychiatry. 2005;187(1):9–20. PubMed doi:10.1192/bjp.187.1.9

17. Mościcki EK. Gender differences in completed and attempted suicides. Ann Epidemiol. 1994;4(2):152–158. PubMed doi:10.1016/1047-2797(94)90062-0

18. Fortuna LR, Perez DJ, Canino G, et al. Prevalence and correlates of lifetime suicidal ideation and suicide attempts among Latino subgroups in the United States. J Clin Psychiatry. 2007;68(4):572–581. PubMed doi:10.4088/JCP.v68n0413

19. Sareen J, Cox BJ, Afifi TO, et al. Anxiety disorders and risk for suicidal ideation and suicide attempts: a population-based longitudinal study of adults. Arch Gen Psychiatry. 2005;62(11):1249–1257. PubMed doi:10.1001/archpsyc.62.11.1249

20. Kuo W-H, Gallo JJ, Tien AY. Incidence of suicide ideation and attempts in adults: the 13-year follow-up of a community sample in Baltimore, Maryland. Psychol Med. 2001;31(7):1181–1191. PubMed doi:10.1017/S0033291701004482

21. Collins JC, McFarland BH. Divalproex, lithium and suicide among Medicaid patients with bipolar disorder. J Affect Disord. 2008;107(1–3):23–28. PubMed doi:10.1016/j.jad.2007.07.014

22. Goodwin FK, Fireman B, Simon GE, et al. Suicide risk in bipolar disorder during treatment with lithium and divalproex. JAMA. 2003;290(11):1467–1473. PubMed doi:10.1001/jama.290.11.1467

23. Meltzer HY, Alphs L, Green AI, et al; International Suicide Prevention Trial Study Group. Clozapine treatment for suicidality in schizophrenia: International Suicide Prevention Trial (InterSePT). Arch Gen Psychiatry. 2003;60(1):82–91. PubMed doi:10.1001/archpsyc.60.1.82

24. Gibbons RD, Hur K, Bhaumik DK, et al. The relationship between antidepressant medication use and rate of suicide. Arch Gen Psychiatry. 2005;62(2):165–172. PubMed doi:10.1001/archpsyc.62.2.165

25. Rosenbaum JF, Falk WE, Gastfriend DR, et al. Acute distress after switch from Norpramin to generic desipramine. Am J Psychiatry. 1989;146(1):122. PubMed

26. Fava M, Mulroy R, Alpert J, et al. Emergence of adverse events following discontinuation of treatment with extended-release venlafaxine. Am J Psychiatry. 1997;154(12):1760–1762. PubMed

27. Perlis RH, Sachs GS, Lafer B, et al. Effect of abrupt change from standard to low serum levels of lithium: a reanalysis of double-blind lithium maintenance data. Am J Psychiatry. 2002;159(7):1155–1159. PubMed doi:10.1176/appi.ajp.159.7.1155

28. Fava M. Prospective studies of adverse events related to antidepressant discontinuation. J Clin Psychiatry. 2006;67(suppl 4):14–21. PubMed

29. West JC, Wilk JE, Muszynski IL, et al. Medication access and continuity: the experiences of dual-eligible psychiatric patients during the first 4 months of the Medicare prescription drug benefit. Am J Psychiatry. 2007;164(5):789–796. PubMed doi:10.1176/appi.ajp.164.5.789

30. West JC, Wilk JE, Rae DS, et al. First-year Medicare Part D prescription drug benefits: medication access and continuity among dual eligible psychiatric patients. J Clin Psychiatry. 2010;71(4):400–410. PubMed doi:10.4088/JCP.08m04608whi

31. Meehan J, Kapur N, Hunt IM, et al. Suicide in mental health in-patients and within 3 months of discharge: national clinical survey. Br J Psychiatry. 2006;188(2):129–134. PubMed doi:10.1192/bjp.188.2.129

32. Hansen V, Jacobsen BK, Arnesen E. Cause-specific mortality in psychiatric patients after deinstitutionalisation. Br J Psychiatry. 2001;179(5):438–443. PubMed doi:10.1192/bjp.179.5.438

33. Appleby L, Dennehy JA, Thomas CS, et al. Aftercare and clinical characteristics of people with mental illness who commit suicide: a case-control study. Lancet. 1999;353(9162):1397–1400. PubMed doi:10.1016/S0140-6736(98)10014-4

34. Weiden PJ, Kozma C, Grogg A, et al. Partial compliance and risk of rehospitalization among California Medicaid patients with schizophrenia. Psychiatr Serv. 2004;55(8):886–891. PubMed doi:10.1176/appi.ps.55.8.886

35. Olfson M, Mechanic D, Hansell S, et al. Predicting medication noncompliance after hospital discharge among patients with schizophrenia. Psychiatr Serv. 2000;51(2):216–222. PubMed doi:10.1176/appi.ps.51.2.216

36. Epstein AJ, Rathore SS, Alexander GC, et al. Primary care physicians’ views of Medicare Part D. Am J Manag Care. 2008;14(suppl):SP5–SP13. PubMed

37. Sun SX, Liu GG, Christensen DB, et al. Review and analysis of hospitalization costs associated with antipsychotic nonadherence in the treatment of schizophrenia in the United States. Curr Med Res Opin. 2007;23(10):2305–2312. PubMed doi:10.1185/030079907X226050

38. Huskamp HA, West JC, Rae DS, et al. Part D and dually eligible patients with mental illness: medication access problems and use of intensive services. Psychiatr Serv. 2009;60(9):1169–1174. PubMed doi:10.1176/appi.ps.60.9.1169

39. West JC, Rae DS, Huskamp H, et al. Medicaid medication access problems and increased psychiatric hospital and emergency care. Gen Hosp Psychiatry. 2010. doi:10.1016/j.genhosppsych.2010.07.005

40. Gitlin M, Nuechterlein K, Subotnik KL, et al. Clinical outcome following neuroleptic discontinuation in patients with remitted recent-onset schizophrenia. Am J Psychiatry. 2001;158(11):1835–1842. PubMed doi:10.1176/appi.ajp.158.11.1835

41. Essock SM, Covell NH, Davis SM, et al. Effectiveness of switching antipsychotic medications. Am J Psychiatry. 2006;163(12):2090–2095. PubMed doi:10.1176/appi.ajp.163.12.2090

42. Quitkin FM, Petkova E, McGrath PJ, et al. When should a trial of fluoxetine for major depression be declared failed? Am J Psychiatry. 2003;160(4):734–740. PubMed doi:10.1176/appi.ajp.160.4.734

43. Stroup TS, Lieberman JA, McEvoy JP, et alCATIE Investigators. Effectiveness of olanzapine, quetiapine, risperidone, and ziprasidone in patients with chronic schizophrenia following discontinuation of a previous atypical antipsychotic. Am J Psychiatry. 2006;163(4):611–622. PubMed doi:10.1176/appi.ajp.163.4.611

44. Fava M, Rush AJ, Wisniewski SR, et al. A comparison of mirtazapine and nortriptyline following two consecutive failed medication treatments for depressed outpatients: a STAR*D report. Am J Psychiatry. 2006;163(7):1161–1172. PubMed doi:10.1176/appi.ajp.163.7.1161

45. American Psychiatric Association (APA). Practice Guideline for the Assessment and Treatment of Patients with Suicidal Behaviors. Am J Psychiatry. 2003;160(11 suppl):1–60. PubMed

46. Donohue JM, Huskamp HA, Zuvekas SH. Dual eligibles with mental disorders and Medicare Part D: how are they faring? Health Aff (Millwood). 2009;28(3):746–759. PubMed doi:10.1377/hlthaff.28.3.746

47. Soumerai SB, Zhang F, Ross-Degnan D, et al. Use of atypical antipsychotic drugs for schizophrenia in Maine Medicaid following a policy change. Health Aff (Millwood). 2008;27(3):w185–w195. PubMed doi:10.1377/hlthaff.27.3.w185

48. Zhang Y, Adams AS, Ross-Degnan D, et al. Effects of prior authorization on medication discontinuation among Medicaid beneficiaries with bipolar disorder. Psychiatr Serv. 2009;60(4):520–527. PubMed doi:10.1176/appi.ps.60.4.520

49. Domino ME, Farley JF. Economic grand rounds: did Medicare Part D improve access to medications? Psychiatr Serv. 2010;61(2):118–120. PubMed doi:10.1176/appi.ps.61.2.118

50. D’Agostino RB Jr. Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Stat Med. 1998;17(19):2265–2281. PubMed doi:10.1002/(SICI)1097-0258(19981015)17:19<2265::AID-SIM918>3.0.CO;2-B

51. Sajatovic M, Bauer MS, Kilbourne AM, et al. Self-reported medication treatment adherence among veterans with bipolar disorder. Psychiatr Serv. 2006;57(1):56–62. PubMed doi:10.1176/appi.ps.57.1.56

52. Sajatovic M, Biswas K, Kilbourne AK, et al. Factors associated with prospective long-term treatment adherence among individuals with bipolar disorder. Psychiatr Serv. 2008;59(7):753–759. PubMed doi:10.1176/appi.ps.59.7.753

53. Lacro JP, Dunn LB, Dolder CR, et al. Prevalence of and risk factors for medication nonadherence in patients with schizophrenia: a comprehensive review of recent literature. J Clin Psychiatry. 2002;63(10):892–909. PubMed

54. Kessler RC, Berglund PA, Bruce ML, et al. The prevalence and correlates of untreated serious mental illness. Health Serv Res. 2001;36(6 Pt 1):987–1007. PubMed

55. Zeber JE, Grazier KL, Valenstein M, et al. Effect of a medication copayment increase in veterans with schizophrenia. Am J Manag Care. 2007;13(6 Pt 2):335–346. PubMed

56. Juurlink DN, Herrmann N, Szalai JP, et al. Medical illness and the risk of suicide in the elderly. Arch Intern Med. 2004;164(11):1179–1184. PubMed doi:10.1001/archinte.164.11.1179

57. Petronis KR, Samuels JF, Mościcki EK, et al. An epidemiologic investigation of potential risk factors for suicide attempts. Soc Psychiatry Psychiatr Epidemiol. 1990;25(4):193–199. PubMed

58. Gunnell D, Harbord R, Singleton N, et al. Factors influencing the development and amelioration of suicidal thoughts in the general population. Cohort study. Br J Psychiatry. 2004;185(5):385–393. PubMed doi:10.1192/bjp.185.5.385

59. Borges G, Angst J, Nock MK, et al. Risk factors for the incidence and persistence of suicide-related outcomes: a 10-year follow-up study using the National Comorbidity Surveys. J Affect Disord. 2008;105(1–3):25–33. PubMed doi:10.1016/j.jad.2007.01.036

60. Covell NH, Finnerty MT, Essock SM. Implications of CATIE for mental health services researchers. Psychiatr Serv. 2008;59(5):526–529. PubMed doi:10.1176/appi.ps.59.5.526

[1]References 29, 30, 34, 35, 37, 39, 40.

[2]References 26, 27, 34, 35, 37, 40, 47, 51, 52.