<div id="freepromo">Enjoying this free article from JCP? You can get access to many more articles and the chance to earn CME credit by <a href="/pages/register.aspx">registering for a free account</a>.</div><script language="javascript">
<!--
color = 'white';
-->
</script>
<div id="_idContainer000">
<p style="text-align: right; margin: 10px 0 5px; font-size: 10em;">See reply by <a href="/JCP/article/Pages/2015/v76n09/v76n0910.aspx" target="_top">Andrade</a> and article by <a href="/JCP/article/Pages/2015/v76n03/v76n0313.aspx" target="_top">Andrade</a></p>
<p class="frontmatter-fieldnotes disclaimer" style="margin-bottom:15px;">This work may not be copied, distributed, displayed, published, reproduced, transmitted, modified, posted, sold, licensed, or used for commercial purposes. By downloading this file, you are agreeing to the publisher’s <a href="/pages/termsofuse.aspx" target="_blank">Terms & Conditions</a>.</p></div>
<p class="ltrs-br-ltr-br-title"><span class="bold">Number Needed to Treat Can Be Helpful: A Response to Andrade</span></p>
<p class="ltrs-br-ltr-br-body-text"><span class="semibold">To the Editor:</span> We read with interest the March 2015 Clinical and Practical Psychopharmacology column by Dr Andrade regarding numbers needed to treat and harm (NNT, NNH).<span class="htm-cite"><a href="#ref1">1</a></span> We applaud Dr Andrade for writing an exceptionally clear explanation of what NNT and NNH are and how they may be calculated. In our own experience, NNT and NNH are the simplest ways of explaining effect sizes in a clinically relevant manner to medical practitioners who would otherwise mistakenly believe that all they need to be aware of are <span class="italic">P</span> values. Although <span class="italic">P</span> values can help convince us that we are most likely dealing with a truth, effect sizes are essential in helping determine if such a truth is clinically important. Therefore, in our view, the statement “The NNT is an academically useful statistic, but it has limited value for the practicing clinician”<span class="htm-cite"><a href="#ref1">1(p e332)</a></span> is unduly pessimistic, as NNT is easy to calculate and <span class="italic">can</span> help practicing clinicians appraise benefits and harms in a meaningful way. This is demonstrated in a number of published works examining different interventions, as, for example, in bipolar depression.<span class="htm-cite"><a href="#ref2">2</a></span> Thus, we contend that clinicians can rapidly calculate NNT from published randomized controlled studies, easily comprehend this effect size (which reflects magnitude of therapeutic benefit in “patient units”), and intuitively integrate it into practice.</p>
<p class="ltrs-br-ltr-br-body-text">We agree with Dr Andrade’s statement that “a lot of information is lost when outcomes are dichotomized into response and nonresponse categories,”<span class="htm-cite"><a href="#ref1">1(p e332)</a></span> but emphasize that NNT and NNH are tools of particular value to clinicians and not intended to replace the usual statistical analytic techniques when designing and reporting on clinical trials. We advocate that NNT and NNH based on well-accepted and clinically relevant dichotomous benefits (such as response and remission) and harms (such as ≥<span class="thinspace"> </span>7% weight gain) can provide a “birds-eye” view of real-world clinical outcomes that can be expected with a potential intervention. Although Dr Andrade suggests that “it is far better to directly examine by what margin drug outperforms placebo on a rating scale than to see by what margin drug outperforms placebo on an arbitrary cutoff value that defines response on that rating scale,”<span class="htm-cite"><a href="#ref1">1(p e332)</a></span> this more granular and esoteric approach implies a greater knowledge about statistics and rating scales than many clinicians possess and minimizes the importance of the “outliers” who respond by a clinically relevant amount. We contend that most clinicians will find it more difficult to understand the clinical relevance of a mean<span class="thinspace"> </span>±<span class="thinspace"> </span>SD difference of 3.5<span class="thinspace"> </span>±<span class="thinspace"> </span>1.6 points between groups on a rating scale, compared to understanding a 25% advantage in response (≥<span class="thinspace"> </span>50% improvement) rate (ie, an NNT for response of 4).</p>
<p class="ltrs-br-ltr-br-body-text">By adhering to best practices when reporting NNT or NNH values, we can avoid the important potential problems that Dr Andrade wisely describes. These practices include (1) reporting 95% confidence intervals (CIs) for NNT and NNH and noting if the CI includes infinity (a CI that includes infinity means that the NNT and NNH estimates are not statistically significant at the <span class="italic">P</span> value threshold selected); (2) reporting the time frame from which data were obtained—the effect of time on benefits such as treatment response can be profound, and the longer the clinical trial, the greater the opportunity for harms such as adverse events to occur or resolve<span class="htm-cite"><a href="#ref3">3</a></span>; and (3) reporting the absolute rates from which NNT or NNH estimates were calculated—an NNT of 10 calculated from responder rates of 95% versus 85% is a very different clinical scenario compared to the same NNT calculated from responder rates of 15% versus 5%. Moreover, the individual baseline characteristics of the person being treated, and their values and preferences, will be important to know in order to optimize the use of NNT and NNH in clinical decision making.</p>
<p class="ltrs-br-ltr-br-body-text">Lastly, it needs to be emphasized that NNT values of 1 or −1 are mere theoretical constructs, as they imply absolutely perfect or absolutely imperfect therapeutic outcomes, respectively, which clearly do not have real-world clinical correlates. Because whole numbers are preferred when describing NNT or NNH, the lowest numeric absolute value (most robust effect size) encountered in clinical trials is 2, and such a value is indeed rare.</p>
<p class="references_references-heading"><span class="bold">References</span></p>
<p class="references-references-text-1-9"><a name="ref1"></a><span class="htm-ref"> 1.	</span>Andrade C. The numbers needed to treat and harm (NNT, NNH) statistics: what they tell us and what they do not. <span class="italic">J Clin Psychiatry</span>. 2015;76(3):e330–e333. <a href="
http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&list_uids=25830454&dopt=Abstract"><span class="pubmed-crossref">PubMed</span></a> <a href="
http://dx.doi.org/10.4088/JCP.15f09870"><span class="pubmed-crossref">doi:10.4088/JCP.15f09870</span></a></p>
<p class="references-references-text-1-9"><a name="ref2"></a><span class="htm-ref"> 2.	</span>Ketter TA, Miller S, Dell’Osso B, et al. Balancing benefits and harms of treatments for acute bipolar depression. <span class="italic">J Affect Disord</span>. 2014;169(suppl 1):S24–S33. <a href="
http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&list_uids=25533911&dopt=Abstract"><span class="pubmed-crossref">PubMed</span></a> <a href="
http://dx.doi.org/10.1016/S0165-0327(14)70006-0"><span class="pubmed-crossref">doi:10.1016/S0165-0327(14)70006-0</span></a></p>
<p class="references-references-text-1-9"><a name="ref3"></a><span class="htm-ref"> 3.	</span>Citrome L, Ketter TA. When does a difference make a difference? interpretation of number needed to treat, number needed to harm, and likelihood to be helped or harmed. <span class="italic">Int J Clin Pract</span>. 2013;67(5):407–411. <a href="
http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&list_uids=23574101&dopt=Abstract"><span class="pubmed-crossref">PubMed</span></a> <a href="
http://dx.doi.org/10.1111/ijcp.12142"><span class="pubmed-crossref">doi:10.1111/ijcp.12142</span></a></p>
<p class="ltrs-br-ltr-br-author" style="margin-top:15px;"><span class="bold">Leslie Citrome, MD, MPH</span></p>
<p class="ltrs-br-ltr-br-author"><a href="
mailto:citrome@cnsconsultant.com" target="_blank">
citrome@cnsconsultant.com</a></p>
<p class="ltrs-br-ltr-br-author"><span class="bold">Terence A. Ketter, MD</span></p>
<p class="end-matter"><span class="bold-italic">Author affiliations:</span> New York Medical College, Psychiatry and Behavioral Sciences, Valhalla (Dr Citrome); and Stanford University, Psychiatry and Behavioral Sciences, Stanford, California (Dr Ketter).</p>
<p class="end-matter"><span class="bold-italic">Potential conflicts of interest:</span> In the past 36 months, <span class="semibold">Dr Citrome</span> has engaged in collaborative research with or received consulting or speaking fees from Actavis (Forest), Alexza, Alkermes, AstraZeneca, Avanir, Bristol-Myers Squibb, Eli Lilly, Forum, Genentech, Janssen, Jazz, Lundbeck, Merck, Medivation, Mylan, Novartis, Noven, Otsuka, Pfizer, Reckitt Benckiser, Reviva, Shire, Sunovion, Takeda, Teva, and Valeant. In the past 36 months, <span class="semibold">Dr Ketter</span> has engaged in collaborative research with or received consulting or speaking fees from Abbott, Allergan, AstraZeneca, Avanir, Cephalon, Depotmed, Eli Lilly, GlaxoSmithKline, Janssen, Merck, Otsuka, Pfizer, and Sunovion. In addition, Dr Ketter’s spouse is an employee and stockholder of Janssen. No writing assistance was utilized in the production of this letter.</p>
<p class="end-matter"><span class="bold-italic">Funding/support: </span>None reported.</p>
<p class="end-matter"><span class="italic">J Clin Psychiatry 2015;76(9):e1136 </span></p>
<p class="doi-line"><span class="italic">dx.doi.org/</span><span class="doi">10.4088/JCP.15lr10001</span></p>
<p class="end-matter"><span class="italic">© Copyright 2015 Physicians Postgraduate Press, Inc.</p>
</div>