CME Institute

Home | About Us | Mission Statement | All CME Activities | MyCME | CME Facebook | CME Twitter

JCP

Home | About JCP | Subscribe | Archive | Information for Authors | Information for Reviewers | Information for Advertisers | Customer Service | JCP Facebook | JCP Twitter

PCC

Home | About PCC | Register | Archive | Information for Authors | Information for Reviewers | PCC Facebook | PCC Twitter

Help

FAQ | About Psychiatrist.com | Terms of use | Privacy policy

magnifying glass for search

  • magnifying glass for search
  • Advanced Search

Login

Login  
Login | Login Help | Register | Subscribe
  Subscribe to JCP | Elerts

Quick Links

Font: A | A | A

Top

Free PDF

Printer-Friendly Copy

Vol 76, No 9
Table of Contents

Facebook ShareShare

twitter shareTweet This

envelope iconEmail a link

Related ►

Related Articles

[X]

<script language="javascript">
<!--
color = 'white';

-->
</script>
<div id="_idContainer000">
         <p style="text-align: right; margin: 10px 0 5px; font-size: 10em;">See reply by <a href="/JCP/article/Pages/2015/v76n09/v76n0910.aspx" target="_top">Andrade</a> and article by <a href="/JCP/article/Pages/2015/v76n03/v76n0313.aspx" target="_top">Andrade</a></p>
<p class="frontmatter-fieldnotes disclaimer" style="margin-bottom:15px;">This work may not be copied, distributed, displayed, published, reproduced, transmitted, modified, posted, sold, licensed, or used for commercial purposes. By downloading this file, you are agreeing to the publisher’s <a href="/pages/termsofuse.aspx" target="_blank">Terms &amp; Conditions</a>.</p></div>
<p class="ltrs-br-ltr-br-title"><span class="bold">Number Needed to Treat Can Be Helpful: A Response to Andrade</span></p>
<p class="ltrs-br-ltr-br-body-text"><span class="semibold">To the Editor:</span> We read with interest the March 2015 Clinical and Practical Psychopharmacology column by Dr Andrade regarding numbers needed to treat and harm (NNT, NNH).<span class="htm-cite"><a href="#ref1">1</a></span> We applaud Dr Andrade for writing an exceptionally clear explanation of what NNT and NNH are and how they may be calculated. In our own experience, NNT and NNH are the simplest ways of explaining effect sizes in a clinically relevant manner to medical practitioners who would otherwise mistakenly believe that all they need to be aware of are <span class="italic">P</span> values. Although <span class="italic">P</span> values can help convince us that we are most likely dealing with a truth, effect sizes are essential in helping determine if such a truth is clinically important. Therefore, in our view, the statement “The NNT is an academically useful statistic, but it has limited value for the practicing clinician”<span class="htm-cite"><a href="#ref1">1(p e332)</a></span> is unduly pessimistic, as NNT is easy to calculate and <span class="italic">can</span> help practicing clinicians appraise benefits and harms in a meaningful way. This is demonstrated in a number of published works examining different interventions, as, for example, in bipolar depression.<span class="htm-cite"><a href="#ref2">2</a></span> Thus, we contend that clinicians can rapidly calculate NNT from published randomized controlled studies, easily comprehend this effect size (which reflects magnitude of therapeutic benefit in “patient units”), and intuitively integrate it into practice.</p>
<p class="ltrs-br-ltr-br-body-text">We agree with Dr Andrade’s statement that “a lot of information is lost when outcomes are dichotomized into response and nonresponse categories,”<span class="htm-cite"><a href="#ref1">1(p e332)</a></span> but emphasize that NNT and NNH are tools of particular value to clinicians and not intended to replace the usual statistical analytic techniques when designing and reporting on clinical trials. We advocate that NNT and NNH based on well-accepted and clinically relevant dichotomous benefits (such as response and remission) and harms (such as ≥<span class="thinspace"> </span>7% weight gain) can provide a “birds-eye” view of real-world clinical outcomes that can be expected with a potential intervention. Although Dr Andrade suggests that “it is far better to directly examine by what margin drug outperforms placebo on a rating scale than to see by what margin drug outperforms placebo on an arbitrary cutoff value that defines response on that rating scale,”<span class="htm-cite"><a href="#ref1">1(p e332)</a></span> this more granular and esoteric approach implies a greater knowledge about statistics and rating scales than many clinicians possess and minimizes the importance of the “outliers” who respond by a clinically relevant amount. We contend that most clinicians will find it more difficult to understand the clinical relevance of a mean<span class="thinspace"> </span>±<span class="thinspace"> </span>SD difference of 3.5<span class="thinspace"> </span>±<span class="thinspace"> </span>1.6 points between groups on a rating scale, compared to understanding a 25% advantage in response (≥<span class="thinspace"> </span>50% improvement) rate (ie, an NNT for response of 4).</p>
<p class="ltrs-br-ltr-br-body-text">By adhering to best practices when reporting NNT or NNH values, we can avoid the important potential problems that Dr Andrade wisely describes. These practices include (1) reporting 95% confidence intervals (CIs) for NNT and NNH and noting if the CI includes infinity (a CI that includes infinity means that the NNT and NNH estimates are not statistically significant at the <span class="italic">P</span> value threshold selected); (2) reporting the time frame from which data were obtained—the effect of time on benefits such as treatment response can be profound, and the longer the clinical trial, the greater the opportunity for harms such as adverse events to occur or resolve<span class="htm-cite"><a href="#ref3">3</a></span>; and (3) reporting the absolute rates from which NNT or NNH estimates were calculated—an NNT of 10 calculated from responder rates of 95% versus 85% is a very different clinical scenario compared to the same NNT calculated from responder rates of 15% versus 5%. Moreover, the individual baseline characteristics of the person being treated, and their values and preferences, will be important to know in order to optimize the use of NNT and NNH in clinical decision making.</p>
<p class="ltrs-br-ltr-br-body-text">Lastly, it needs to be emphasized that NNT values of 1 or −1 are mere theoretical constructs, as they imply absolutely perfect or absolutely imperfect therapeutic outcomes, respectively, which clearly do not have real-world clinical correlates. Because whole numbers are preferred when describing NNT or NNH, the lowest numeric absolute value (most robust effect size) encountered in clinical trials is 2, and such a value is indeed rare.</p>
<p class="references_references-heading"><span class="bold">References</span></p>
<p class="references-references-text-1-9"><a name="ref1"></a><span class="htm-ref"> 1.&#9;</span>Andrade C. The numbers needed to treat and harm (NNT, NNH) statistics: what they tell us and what they do not. <span class="italic">J&#160;Clin Psychiatry</span>. 2015;76(3):e330–e333. <a href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&amp;db=PubMed&amp;list_uids=25830454&amp;dopt=Abstract"><span class="pubmed-crossref">PubMed</span></a> <a href="http://dx.doi.org/10.4088/JCP.15f09870"><span class="pubmed-crossref">doi:10.4088/JCP.15f09870</span></a></p>
<p class="references-references-text-1-9"><a name="ref2"></a><span class="htm-ref"> 2.&#9;</span>Ketter TA, Miller S, Dell’Osso B, et al. Balancing benefits and harms of treatments for acute bipolar depression. <span class="italic">J&#160;Affect Disord</span>. 2014;169(suppl 1):S24–S33. <a href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&amp;db=PubMed&amp;list_uids=25533911&amp;dopt=Abstract"><span class="pubmed-crossref">PubMed</span></a> <a href="http://dx.doi.org/10.1016/S0165-0327(14)70006-0"><span class="pubmed-crossref">doi:10.1016/S0165-0327(14)70006-0</span></a></p>
<p class="references-references-text-1-9"><a name="ref3"></a><span class="htm-ref"> 3.&#9;</span>Citrome L, Ketter TA. When does a difference make a difference? interpretation of number needed to treat, number needed to harm, and likelihood to be helped or harmed. <span class="italic">Int J Clin Pract</span>. 2013;67(5):407–411. <a href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&amp;db=PubMed&amp;list_uids=23574101&amp;dopt=Abstract"><span class="pubmed-crossref">PubMed</span></a> <a href="http://dx.doi.org/10.1111/ijcp.12142"><span class="pubmed-crossref">doi:10.1111/ijcp.12142</span></a></p>
<p class="ltrs-br-ltr-br-author" style="margin-top:15px;"><span class="bold">Leslie Citrome, MD, MPH</span></p>
<p class="ltrs-br-ltr-br-author"><a href="mailto:citrome@cnsconsultant.com" target="_blank">citrome@cnsconsultant.com</a></p>
<p class="ltrs-br-ltr-br-author"><span class="bold">Terence A. Ketter, MD</span></p>
<p class="end-matter"><span class="bold-italic">Author affiliations:</span> New York Medical College, Psychiatry and Behavioral Sciences, Valhalla (Dr Citrome); and Stanford University, Psychiatry and Behavioral Sciences, Stanford, California (Dr Ketter).</p>
<p class="end-matter"><span class="bold-italic">Potential conflicts of interest:</span> In the past 36 months, <span class="semibold">Dr Citrome</span> has engaged in collaborative research with or received consulting or speaking fees from Actavis (Forest), Alexza, Alkermes, AstraZeneca, Avanir, Bristol-Myers Squibb, Eli Lilly, Forum, Genentech, Janssen, Jazz, Lundbeck, Merck, Medivation, Mylan, Novartis, Noven, Otsuka, Pfizer, Reckitt Benckiser, Reviva, Shire, Sunovion, Takeda, Teva, and Valeant. In the past 36 months, <span class="semibold">Dr Ketter</span> has engaged in collaborative research with or received consulting or speaking fees from Abbott, Allergan, AstraZeneca, Avanir, Cephalon, Depotmed, Eli Lilly, GlaxoSmithKline, Janssen, Merck, Otsuka, Pfizer, and Sunovion. In addition, Dr Ketter’s spouse is an employee and stockholder of Janssen. No writing assistance was utilized in the production of this letter.</p>
<p class="end-matter"><span class="bold-italic">Funding/support: </span>None reported.</p>
<p class="end-matter"><span class="italic">J Clin Psychiatry 2015;76(9):e1136 </span></p>
<p class="doi-line"><span class="italic">dx.doi.org/</span><span class="doi">10.4088/JCP.15lr10001</span></p>
<p class="end-matter"><span class="italic">© Copyright 2015 Physicians Postgraduate Press, Inc.</p>
</div>
Manage Subscriptions
/_layouts/images/ReportServer/Manage_Subscription.gif
/JCP/article/_layouts/ReportServer/ManageSubscriptions.aspx?list={ListId}&ID={ItemId}
0x80
0x0
FileType
rdl
350
Manage Data Sources
/JCP/article/_layouts/ReportServer/DataSourceList.aspx?list={ListId}&ID={ItemId}
0x0
0x20
FileType
rdl
351
Manage Shared Datasets
/JCP/article/_layouts/ReportServer/DatasetList.aspx?list={ListId}&ID={ItemId}
0x0
0x20
FileType
rdl
352
Manage Parameters
/JCP/article/_layouts/ReportServer/ParameterList.aspx?list={ListId}&ID={ItemId}
0x0
0x4
FileType
rdl
353
Manage Processing Options
/JCP/article/_layouts/ReportServer/ReportExecution.aspx?list={ListId}&ID={ItemId}
0x0
0x4
FileType
rdl
354
Manage Cache Refresh Plans
/JCP/article/_layouts/ReportServer/CacheRefreshPlanList.aspx?list={ListId}&ID={ItemId}
0x0
0x4
FileType
rdl
355
View Report History
/JCP/article/_layouts/ReportServer/ReportHistory.aspx?list={ListId}&ID={ItemId}
0x0
0x40
FileType
rdl
356
View Dependent Items
/JCP/article/_layouts/ReportServer/DependentItems.aspx?list={ListId}&ID={ItemId}
0x0
0x4
FileType
rsds
350
Edit Data Source Definition
/JCP/article/_layouts/ReportServer/SharedDataSource.aspx?list={ListId}&ID={ItemId}
0x0
0x4
FileType
rsds
351
View Dependent Items
/JCP/article/_layouts/ReportServer/DependentItems.aspx?list={ListId}&ID={ItemId}
0x0
0x4
FileType
smdl
350
Manage Clickthrough Reports
/JCP/article/_layouts/ReportServer/ModelClickThrough.aspx?list={ListId}&ID={ItemId}
0x0
0x4
FileType
smdl
352
Manage Model Item Security
/JCP/article/_layouts/ReportServer/ModelItemSecurity.aspx?list={ListId}&ID={ItemId}
0x0
0x2000000
FileType
smdl
353
Regenerate Model
/JCP/article/_layouts/ReportServer/GenerateModel.aspx?list={ListId}&ID={ItemId}
0x0
0x4
FileType
smdl
354
Manage Data Sources
/JCP/article/_layouts/ReportServer/DataSourceList.aspx?list={ListId}&ID={ItemId}
0x0
0x20
FileType
smdl
351
Load in Report Builder
/JCP/article/_layouts/ReportServer/RSAction.aspx?RSAction=ReportBuilderModelContext&list={ListId}&ID={ItemId}
0x0
0x2
FileType
smdl
250
Edit in Report Builder
/_layouts/images/ReportServer/EditReport.gif
/JCP/article/_layouts/ReportServer/RSAction.aspx?RSAction=ReportBuilderReportContext&list={ListId}&ID={ItemId}
0x0
0x4
FileType
rdl
250
Edit in Report Builder
/JCP/article/_layouts/ReportServer/RSAction.aspx?RSAction=ReportBuilderDatasetContext&list={ListId}&ID={ItemId}
0x0
0x4
FileType
rsd
250
Manage Caching Options
/JCP/article/_layouts/ReportServer/DatasetCachingOptions.aspx?list={ListId}&ID={ItemId}
0x0
0x4
FileType
rsd
350
Manage Cache Refresh Plans
/JCP/article/_layouts/ReportServer/CacheRefreshPlanList.aspx?list={ListId}&ID={ItemId}&IsDataset=true
0x0
0x4
FileType
rsd
351
Manage Data Sources
/JCP/article/_layouts/ReportServer/DataSourceList.aspx?list={ListId}&ID={ItemId}
0x0
0x20
FileType
rsd
352
View Dependent Items
/JCP/article/_layouts/ReportServer/DependentItems.aspx?list={ListId}&ID={ItemId}
0x0
0x4
FileType
rsd
353
Compliance Details
javascript:commonShowModalDialog('{SiteUrl}/_layouts/itemexpiration.aspx?ID={ItemId}&List={ListId}', 'center:1;dialogHeight:500px;dialogWidth:500px;resizable:yes;status:no;location:no;menubar:no;help:no', function GotoPageAfterClose(pageid){if(pageid == 'hold') {STSNavigate(unescape(decodeURI('{SiteUrl}'))+'/_layouts/hold.aspx?ID={ItemId}&List={ListId}'); return false;} if(pageid == 'audit') {STSNavigate(unescape(decodeURI('{SiteUrl}'))+'/_layouts/Reporting.aspx?Category=Auditing&backtype=item&ID={ItemId}&List={ListId}'); return false;} if(pageid == 'config') {STSNavigate(unescape(decodeURI('{SiteUrl}'))+'/_layouts/expirationconfig.aspx?ID={ItemId}&List={ListId}'); return false;}}, null); return false;
0x0
0x1
ContentType
0x01
898
Document Set Version History
javascript:SP.UI.ModalDialog.ShowPopupDialog('{SiteUrl}/_layouts/DocSetVersions.aspx?List={ListId}&ID={ItemId}')
0x0
0x0
ContentType
0x0120D520
330
Send To other location
javascript:GoToPage('{SiteUrl}/_layouts/docsetsend.aspx?List={ListId}&ID={ItemId}')
0x0
0x0
ContentType
0x0120D520
350

Comment on Number Needed to Treat Can Be Helpful: A Response to Andrade

Please note that this forum is mediated to ensure that all comments are relevant to the topic and appropriate for this venue. See PPP Terms of Use and Privacy Policy.

[ Previous  |  Next ]

Information Links

Terms of Use | Privacy Policy | Information for Authors (JCP) | Information for Authors (PCC) | Reprints and Permissions | CNS Job Market | Information for Advertisers | Media Relations | Machine-Readable JCP Archive

Help

Contact us | Unsubscribe from Elerts | Customer Service | FAQ | About JCP | About PCC | About Psychiatrist.com

Our Family of Sites

Psychiatrist.com | The Journal of Clinical Psychiatry | The Primary Care Companion | The CME Institute | Strong Veterans
Anonymous