Reviews
9 July 2019

Effects of Nutritional Supplements and Dietary Interventions on Cardiovascular Outcomes: An Umbrella Review and Evidence Map

This article has been corrected.
VIEW CORRECTION
Publication: Annals of Internal Medicine
Volume 171, Number 3

Abstract

This article has been corrected. The original version (PDF) is appended to this article as a Supplement.

Background:

The role of nutritional supplements and dietary interventions in preventing mortality and cardiovascular disease (CVD) outcomes is unclear.

Purpose:

To examine evidence about the effects of nutritional supplements and dietary interventions on mortality and cardiovascular outcomes in adults.

Data Sources:

PubMed, CINAHL, and the Cochrane Library from inception until March 2019; ClinicalTrials.gov (10 March 2019); journal Web sites; and reference lists.

Study Selection:

English-language, randomized controlled trials (RCTs) and meta-analyses of RCTs that assessed the effects of nutritional supplements or dietary interventions on all-cause mortality or cardiovascular outcomes, such as death, myocardial infarction, stroke, and coronary heart disease.

Data Extraction:

Two independent investigators abstracted data, assessed the quality of evidence, and rated the certainty of evidence.

Data Synthesis:

Nine systematic reviews and 4 new RCTs were selected that encompassed a total of 277 trials, 24 interventions, and 992 129 participants. A total of 105 meta-analyses were generated. Low-certainty evidence showed that omega-3 long-chain polyunsaturated fatty acid (LC-PUFA) was associated with reduced risk for myocardial infarction (RR, 0.92 [CI, 0.85 to 0.99]) and coronary heart disease (RR, 0.93 [CI, 0.89 to 0.98]). Folic acid was associated with lower risk for stroke (RR, 0.80 [CI, 0.67 to 0.96]; low certainty), whereas calcium plus vitamin D increased the risk for stroke (RR, 1.17 [CI, 1.05 to 1.30]; moderate certainty). Other nutritional supplements, such as vitamin B6, vitamin A, multivitamins, antioxidants, and iron and dietary interventions, such as reduced fat intake, had no significant effect on mortality or cardiovascular disease outcomes (very low– to moderate-certainty evidence).

Limitations:

Suboptimal quality and certainty of evidence.

Conclusion:

Use of omega-3 LC-PUFA and folate supplementation could reduce risk for some cardiovascular outcomes in adults. Combined calcium plus vitamin D might increase risk for stroke.

Primary Funding Source:

None.

Get full access to this article

View all available purchase options and get full access to this article.

Supplemental Material

Supplement. Original Version (PDF)

Supplement. Supplemental Material.

References

1.
DeSalvo KBOlson RCasavale KO. Dietary guidelines for Americans. JAMA. 2016;315:457-8. [PMID: 26746707]  doi: 10.1001/jama.2015.18396
2.
Chen FDu MBlumberg JBet al. Association among dietary supplement use, nutrient intake, and mortality among U.S. adults. A cohort study. Ann Intern Med. 2019. [PMID: 30959527]  doi: 10.7326/M18-2478
3.
Kim JChoi JKwon SYet al. Association of multivitamin and mineral supplementation and risk of cardiovascular disease: a systematic review and meta-analysis. Circ Cardiovasc Qual Outcomes. 2018;11:e004224. [PMID: 29991644]  doi: 10.1161/CIRCOUTCOMES.117.004224
4.
Kantor EDRehm CDDu Met al. Trends in dietary supplement use among US adults from 1999-2012. JAMA. 2016;316:1464-74. [PMID: 27727382]  doi: 10.1001/jama.2016.14403
5.
Gahche JJBailey RLPotischman Net al. Dietary supplement use was very high among older adults in the United States in 2011-2014. J Nutr. 2017;147:1968-76. [PMID: 28855421]  doi: 10.3945/jn.117.255984
6.
Fortmann SPBurda BUSenger CAet al. Vitamin and mineral supplements in the primary prevention of cardiovascular disease and cancer. An updated systematic evidence review for the U.S. Preventive Services Task Force. Ann Intern Med. 2013;159:824-34. [PMID: 24217421]
7.
Jenkins DJASpence JDGiovannucci ELet al. Supplemental vitamins and minerals for CVD prevention and treatment. J Am Coll Cardiol. 2018;71:2570-84. [PMID: 29852980]  doi: 10.1016/j.jacc.2018.04.020
8.
Manson JECook NRLee IMet alVITAL Research Group. Marine n-3 fatty acids and prevention of cardiovascular disease and cancer. N Engl J Med. 2019;380:23-32. [PMID: 30415637]  doi: 10.1056/NEJMoa1811403
9.
Bhatt DLSteg PGMiller Met alREDUCE-IT Investigators. Cardiovascular risk reduction with icosapent ethyl for hypertriglyceridemia. N Engl J Med. 2019;380:11-22. [PMID: 30415628]  doi: 10.1056/NEJMoa1812792
10.
Bowman LMafham MWallendszus Ket alASCEND Study Collaborative Group. Effects of n-3 fatty acid supplements in diabetes mellitus. N Engl J Med. 2018;379:1540-50. [PMID: 30146932]  doi: 10.1056/NEJMoa1804989
11.
Manson JECook NRLee IMet alVITAL Research Group. Vitamin D supplements and prevention of cancer and cardiovascular disease. N Engl J Med. 2019;380:33-44. [PMID: 30415629]  doi: 10.1056/NEJMoa1809944
12.
Scragg RStewart AWWaayer Det al. Effect of monthly high-dose vitamin D supplementation on cardiovascular disease in the Vitamin D Assessment Study: a randomized clinical trial. JAMA Cardiol. 2017;2:608-16. [PMID: 28384800]  doi: 10.1001/jamacardio.2017.0175
13.
Dodge TLitt DKaufman A. Influence of the Dietary Supplement Health and Education Act on consumer beliefs about the safety and effectiveness of dietary supplements. J Health Commun. 2011;16:230-44. [PMID: 21120738]  doi: 10.1080/10810730.2010.529493
14.
Farah WHAlsawas MMainou Met al. Non-pharmacological treatment of depression: a systematic review and evidence map. Evid Based Med. 2016;21:214-21. [PMID: 27836921]  doi: 10.1136/ebmed-2016-110522
15.
Veroniki AAJackson DViechtbauer Wet al. Methods to estimate the between-study variance and its uncertainty in meta-analysis. Res Synth Methods. 2016;7:55-79. [PMID: 26332144]  doi: 10.1002/jrsm.1164
16.
Egger MSmith GDSchneider Met al. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315:629-34. [PMID: 9310563]
17.
Martin NGermanò RHartley Let al. Nut consumption for the primary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2015:CD011583. [PMID: 26411417]  doi: 10.1002/14651858.CD011583.pub2
18.
Hartley LIgbinedion EHolmes Jet al. Increased consumption of fruit and vegetables for the primary prevention of cardiovascular diseases. Cochrane Database Syst Rev. 2013:CD009874. [PMID: 23736950]  doi: 10.1002/14651858.CD009874.pub2
19.
Hartley LMay MDLoveman Eet al. Dietary fibre for the primary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2016:CD011472. [PMID: 26758499]  doi: 10.1002/14651858.CD011472.pub2
20.
Hartley LFlowers NHolmes Jet al. Green and black tea for the primary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2013:CD009934. [PMID: 23780706]  doi: 10.1002/14651858.CD009934.pub2
21.
Mansoor NVinknes KJVeierød MBet al. Effects of low-carbohydrate diets v. low-fat diets on body weight and cardiovascular risk factors: a meta-analysis of randomised controlled trials. Br J Nutr. 2016;115:466-79. [PMID: 26768850]  doi: 10.1017/S0007114515004699
22.
Adler AJTaylor FMartin Net al. Reduced dietary salt for the prevention of cardiovascular disease. Cochrane Database Syst Rev. 2014:CD009217. [PMID: 25519688]  doi: 10.1002/14651858.CD009217.pub3
23.
Liyanage TNinomiya TWang Aet al. Effects of the Mediterranean diet on cardiovascular outcomes: a systematic review and meta-analysis. PLoS One. 2016;11:e0159252. [PMID: 27509006]  doi: 10.1371/journal.pone.0159252
24.
Abdelhamid ASBrown TJBrainard JSet al. Omega-3 fatty acids for the primary and secondary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2018;11:CD003177. [PMID: 30521670]  doi: 10.1002/14651858.CD003177.pub4
25.
Hooper LAl-Khudairy LAbdelhamid ASet al. Omega-6 fats for the primary and secondary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2018;7:CD011094. [PMID: 30019765]  doi: 10.1002/14651858.CD011094.pub3
26.
Hooper LSummerbell CDThompson Ret al. Reduced or modified dietary fat for preventing cardiovascular disease. Cochrane Database Syst Rev. 2011:CD002137. [PMID: 21735388]  doi: 10.1002/14651858.CD002137.pub2
27.
Hooper LMartin NAbdelhamid Aet al. Reduction in saturated fat intake for cardiovascular disease. Cochrane Database Syst Rev. 2015:CD011737. [PMID: 26068959]  doi: 10.1002/14651858.CD011737
28.
Riaz HKhan SURahman Het al. Effects of high-density lipoprotein targeting treatments on cardiovascular outcomes: a systematic review and meta-analysis. Eur J Prev Cardiol. 2019;26:533-43. [PMID: 30861690]  doi: 10.1177/2047487318816495
29.
Mente AO'Donnell MRangarajan Set alPURE EPIDREAM and ONTARGET/TRANSCEND Investigators. Associations of urinary sodium excretion with cardiovascular events in individuals with and without hypertension: a pooled analysis of data from four studies. Lancet. 2016;388:465-75. [PMID: 27216139]  doi: 10.1016/S0140-6736(16)30467-6
30.
Higgins JPAltman DGGøtzsche PCet alCochrane Bias Methods Group. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928. [PMID: 22008217]  doi: 10.1136/bmj.d5928
31.
Cook NRAppel LJWhelton PK. Lower levels of sodium intake and reduced cardiovascular risk. Circulation. 2014;129:981-9. [PMID: 24415713]  doi: 10.1161/CIRCULATIONAHA.113.006032
32.
Cook NRAppel LJWhelton PK. Sodium intake and all-cause mortality over 20 years in the Trials of Hypertension Prevention. J Am Coll Cardiol. 2016;68:1609-17. [PMID: 27712772]  doi: 10.1016/j.jacc.2016.07.745
33.
O'Donnell MMente ARangarajan Set alPURE Investigators. Urinary sodium and potassium excretion, mortality, and cardiovascular events. N Engl J Med. 2014;371:612-23. [PMID: 25119607]  doi: 10.1056/NEJMoa1311889
34.
Kalogeropoulos APGeorgiopoulou VVMurphy RAet al. Dietary sodium content, mortality, and risk for cardiovascular events in older adults: the Health, Aging, and Body Composition (Health ABC) Study. JAMA Intern Med. 2015;175:410-9. [PMID: 25599120]  doi: 10.1001/jamainternmed.2014.6278
35.
Graudal NJürgens GBaslund Bet al. Compared with usual sodium intake, low- and excessive-sodium diets are associated with increased mortality: a meta-analysis. Am J Hypertens. 2014;27:1129-37. [PMID: 24651634]  doi: 10.1093/ajh/hpu028
36.
Huo YLi JQin Xet alCSPPT Investigators. Efficacy of folic acid therapy in primary prevention of stroke among adults with hypertension in China: the CSPPT randomized clinical trial. JAMA. 2015;313:1325-35. [PMID: 25771069]  doi: 10.1001/jama.2015.2274
37.
Bolland MJGrey AAvenell Aet al. Calcium supplements with or without vitamin D and risk of cardiovascular events: reanalysis of the Women's Health Initiative limited access dataset and meta-analysis. BMJ. 2011;342:d2040. [PMID: 21505219]  doi: 10.1136/bmj.d2040
38.
Chin KAppel LJMichos ED. Vitamin D, calcium, and cardiovascular disease: A”D”vantageous or “D”etrimental? An era of uncertainty. Curr Atheroscler Rep. 2017;19:5. [PMID: 28127710]  doi: 10.1007/s11883-017-0637-2
39.
Anderson JJKruszka BDelaney JAet al. Calcium intake from diet and supplements and the risk of coronary artery calcification and its progression among older adults: 10-year follow-up of the multi-ethnic study of atherosclerosis (MESA). J Am Heart Assoc. 2016;5. [PMID: 27729333]
40.
Bolland MJAvenell ABaron JAet al. Effect of calcium supplements on risk of myocardial infarction and cardiovascular events: meta-analysis. BMJ. 2010;341:c3691. [PMID: 20671013]  doi: 10.1136/bmj.c3691
41.
Moyer VAU.S. Preventive Services Task Force. Vitamin, mineral, and multivitamin supplements for the primary prevention of cardiovascular disease and cancer. U.S. Preventive Services Task Force recommendation statement. Ann Intern Med. 2014;160:558-64. [PMID: 24566474].  doi: 10.7326/M14-0198
42.
Lichtenstein AHAppel LJBrands Met alAmerican Heart Association Nutrition Committee. Diet and Lifestyle Recommendations revision 2006: a scientific statement from the American Heart Association Nutrition Committee. Circulation. 2006;114:82-96. [PMID: 16785338]
43.
Singh RBDubnov GNiaz MAet al. Effect of an Indo-Mediterranean diet on progression of coronary artery disease in high risk patients (Indo-Mediterranean Diet Heart Study): a randomised single-blind trial. Lancet. 2002;360:1455-61. [PMID: 12433513]
44.
Estruch RRos ESalas-Salvadó Jet alPREDIMED Study Investigators. Primary prevention of cardiovascular disease with a Mediterranean diet supplemented with extra-virgin olive oil or nuts. N Engl J Med. 2018;378:e34. [PMID: 29897866]  doi: 10.1056/NEJMoa1800389
45.
Aung THalsey JKromhout Det alOmega-3 Treatment Trialists' Collaboration. Associations of omega-3 fatty acid supplement use with cardiovascular disease risks: meta-analysis of 10 trials involving 77 917 individuals. JAMA Cardiol. 2018;3:225-34. [PMID: 29387889]  doi: 10.1001/jamacardio.2017.5205
46.
Nissen SE. U.S. dietary guidelines. An evidence-free zone. Ann Intern Med. 2016;164:558-9. [PMID: 26783992].  doi: 10.7326/M16-0035
47.
Schwarzer GCarpenter JRRücker G. Small-study effects in meta-analysis. In: Schwarzer G, Carpenter JR, Rücker G, eds. Meta-Analysis with R. Cham, Switzerland: Springer Publishing; 2015:107-41.

Comments

0 Comments
Sign In to Submit A Comment
A. David Smith ,Professor Emeritus of Pharmacology 23 July 2019
Trials of nutritional supplements – do not ignore the subgroups
It is hardly surprising that the conclusions of the review by Khan et al were so negative because the majority, if not all, the trials analysed were conducted on large groups of people and no account seems to have been taken of subgroups within each population. Many subgroups have been identified that respond differently to nutrients and in a trial these should be identified and a pre-specified subgroup analysis should always be done. The single most important aspect for subgroup analysis is the status of the participants in that particular nutrient. Clearly, the subgroup with a high nutrient status is not likely to respond to further exposure to that nutrient, whereas the subgroup with deficiency, or with low-normal status or intake, may well respond (1). In trials on healthy people in high-income countries it is likely that the majority will have a good status in most common nutrients. Such trials should as a matter of design measure the nutrient status in each participant and carry out subgroup analysis of the outcomes according to the status.
Other subgroups have been identified in trials with nutrients. Nutrients often interact with genes and common genetic polymorphisms, such as ApoE 4, can influence the response to nutrients such as vitamin B12 (2) and omega-3 fatty acids (3). The biological effect of a nutrient may be influenced by common medications, for example, anti-platelet drugs interact with the effect of B vitamins on stroke (4). Different nutrients interact with each other: for example the beneficial effect of B vitamins on the brain requires a good omega-3 fatty acid status (5).
It is important that trials of nutritional supplements should recognise the heterogeneity of the population and stratify for different subgroups in case one or other subgroup responds differently. Until this is done, we should not dismiss the use of supplements for improving health outcomes since we might well be denying benefit to sections of the population.
1. Morris MC, Tangney CC. A potential design flaw of randomized trials of vitamin supplements. JAMA. 2011;305(13):1348-9. doi: 10.1001/jama.2011.383
2. Vogiatzoglou A, Smith AD, Nurk E, Drevon CA, Ueland PM, Vollset SE, et al. Cognitive function in an elderly population: Interaction between vitamin B12 status, depression, and apolipoprotein E E4: The Hordaland Homocysteine Study. Psychosom Med. 2013;75(1):20-9. doi: 10.1097/PSY.0b013e3182761b6c
3. Hennebelle M, Plourde M, Chouinard-Watkins R, Castellano CA, Barberger-Gateau P, Cunnane SC. Ageing and apoE change DHA homeostasis: relevance to age-related cognitive decline. Proc Nutr Soc. 2014;73(1):80-6. doi: 10.1017/s0029665113003625
4. Arshi B, Ovbiagele B, Markovic D, Saposnik G, Towfighi A. Differential effect of B-vitamin therapy by antiplatelet use on risk of recurrent vascular events after stroke. Stroke. 2015;46(3):870-3. doi: 10.1161/strokeaha.114.006927
5. Jernerén F, Elshorbagy AK, Oulhaj A, Smith SM, Refsum H, Smith AD. Brain atrophy in cognitively impaired elderly: the importance of long-chain omega-3 fatty acids and B vitamin status in a randomized controlled trial. Am J Clin Nutr. 2015;102(7):215-21. doi: 10.3945/ajcn.114.103283
Jesper M Kivelä 6 August 2019
Does statistics in meta-analyses matter?
Khan and coworkers reported that reduced salt intake in normotensive persons reduced the risk of all-cause mortality with risk ratio (RR) (95% CI) of 0.90 (0.85 to 0.95) based on three studies with a small number of events (n=79) (1). This result was based on reanalysis of a Cochrane review in which RR (95% CI) was 0.90 (0.58 to 1.40) for all-cause mortality at longest follow-up (Analysis 1.2) (2).

The width of CI is s shorter with random-effects (RE) model used by Khan and coworkers compared to fixed-effect (FE) model used in the Cochrane review (2). Indeed, in some situations the RE model by Hartung-Knapp/Sidik-Jonkman (HKSJ) can result narrower CI compared to the FE model, and an ad hoc modification has been introduced (3, 4). Contrary, with this modification 95% CI would be 0.34 to 2.36 based on reanalysis of three studies [Analysis 1.2 in (2)]. However, confidence intervals can be too wide, especially when there are few studies (4).

A between-study heterogeneity was estimated to be zero, which is implausible even for outcomes like all-cause mortality based on what we know from a large sample of meta-analyses conducted within Cochrane reviews (5). Therefore, I conducted a Bayesian RE meta-analysis with R bayesmeta package using a prior distribution for between-study variance of 0.030 [i.e. all-cause mortality as outcome and non-pharma vs. non-pharma as comparison according to (5)]. Further, a uniform prior for mean effect was used. In sensitivity analysis, a normal prior of RR 1 with standard deviation of 0.35 (i.e. 5% probability for RR to be outside 95% interval of 0.5 to 2.0) was used.

The Bayesian RE model yielded a posterior mean for RR (95% credible interval) of 0.90 (0.53 to 1.54) based on reanalysis of three studies [Analysis 1.2 in (2)]. There was 65% probability that salt reduction has some benefit but also 35% probability for some harm in the context of premature deaths. In sensitivity analysis, posterior mean for RR was 0.94 (95% credible interval 0.62 to 1.42).

In conclusion, robustness of results in meta-analyses should be examined with a more than one statistical method. The certainty of evidence considering salt reduction in normotensive persons and all-cause mortality should be downgraded.


References

1. Khan SU, Khan MU, Riaz H, et al. Effects of Nutritional Supplements and Dietary Interventions on Cardiovascular Outcomes: An Umbrella Review and Evidence Map. Ann Intern Med. 2019 Jul 9. doi: 10.7326/M19-0341.

2. Adler AJ, Taylor F, Martin N, Gottlieb S, Taylor RS, Ebrahim S. Reduced dietary salt for the prevention of cardiovascular disease. Cochrane Database Syst Rev. 2014;12:CD009217.

3. Wiksten A, Rücker G, Schwarzer G. Hartung-Knapp method is not always conservative compared with fixed-effect meta-analysis. Stat Med. 2016;35:2503-15.

4. Röver C, Knapp G, Friede T. Hartung-Knapp-Sidik-Jonkman approach and its modification for random-effects meta-analysis with few studies. BMC Med Res Methodol. 2015;15:99.

5. Turner RM, Jackson D, Wei Y, Thompson SG, Higgins JP. Predictive distributions for between-study heterogeneity and simple methods for their application in Bayesian meta-analysis. Stat Med. 2015;34:984-98.
Safi U. Khan1; Erin D. Michos2 7 August 2019
Subgroup Analyses: Take It with a Pinch of Salt

Randomized controlled trials are generally powered to examine the efficacy or safety of an intervention in heterogenous group of patients and subgroup analyses are usually performed as post hoc analyses1. Multiple subgroup analyses can potentially generate false positive results; which may further complicate the interpretation of the results when analyses are conducted based on dichotomization of variables, such as low nutrient status versus high nutrient status in this case1. As such a process can lead to divergent results, one way to ensure that probability of a false-positive finding is not >5%, correction should be made for multiple testing (e.g. Bonferroni adjustment of P-values)2. While, prespecifying the subgroups in a trial protocol might provide some credibility to the subgroups results, even the prespecified analyses are at a higher risk of false positive results secondary to multiple testing, and should be interpreted cautiously1. For instance, subgroup analyses based on baseline 25-OH vitamin D levels were specified a priori in VITAL trial, but multiple hypothesis testing and formal adjustment of P-values or confidence intervals were not done. Regardless, vitamin D supplementation showed null effect compared with control among participants with baseline serum 25-OH vitamin D (<20 ng/mL and ≥ 20 ng/mL, or <median of 31 ng/mL or ≥ 31 ng/mL; p=interaction 0.75 and 0.42, respectively)3.

In view of these issues, generating subgroup analyses based on trial level information in meta-analyses can be extremely misleading. Therefore, we refrained from generating subgroup analyses and focused on providing a broad-based evidence for nutritional supplements and dietary interventions4. We stated in our discussion that “because the focus of our study was to provide broad-based evidence for various nutritional supplements and dietary interventions using existing meta-analyses and trial-level information, we could not analyze interventions according to important subgroups, such as sex, body mass index, lipid values, blood pressures thresholds, diabetes, and history of CVD.”  We also acknowledged the limitations related to health and socioeconomic status, interventions and lack of dose-response analyses and discussed results in the context of these limitations. For instance, in case of folate supplementation, we discussed that it remains unclear that whether the benefit of folate supplementation can be generalized to US population, which has folate fortification. This umbrella review examined the effects of “routine use of supplements and dietary interventions on cardiovascular outcomes” and highlights the issue that the current evidence reporting the effects of these interventions was suboptimal.

1. Wang R, Lagakos SW, Ware JH, Hunter DJ, Drazen JM. Statistics in medicine--reporting of subgroup analyses in clinical trials. The New England journal of medicine. 2007;357(21):2189-2194.

2. Jafari M, Ansari-Pour N. Why, When and How to Adjust Your P Values? Cell J. 2019;20(4):604-607.

3. Manson JE, Cook NR, Lee IM, et al. Vitamin D Supplements and Prevention of Cancer and Cardiovascular Disease. The New England journal of medicine. 2019;380(1):33-44.

4. Khan SU, Khan MU, Riaz H, et al. Effects of Nutritional Supplements and Dietary Interventions on Cardiovascular Outcomes: An Umbrella Review and Evidence MapEffects of Supplements and Dietary Interventions on Cardiovascular Outcomes. Annals of internal medicine. 2019.


Martin Mayer 21 August 2019
Deciphering discrepancy in meta-analytic results: The model matters
I applaud Khan and colleagues taking on the substantial task of performing an umbrella review on nutritional supplements and dietary interventions on cardiovascular outcomes.(1) However, their results for salt reduction in patients without hypertension for the outcome of all-cause mortality deserve additional scrutiny. They cite a Cochrane review(2) as the sole source for this outcome, and the number of events and participants are consistent with the Cochrane review's analysis for all-cause mortality at longest follow-up (Analysis 1.2.1). However, although the risk ratio (RR) point estimates are the same in the Cochrane review and Khan and colleagues' review (RR of 0.90), the 95% confidence intervals (CIs) differ substantially (0.58 to 1.40 versus 0.85 to 0.95, respectively).

The considerably wider CI in the Cochrane review raises immediate suspicion. The Cochrane review used a fixed-effects model and Khan and colleagues used a random-effects model, and it does not make sense for the fixed-effects model to yield a wider CI than the random-effects model.

This oddity is due to Khan and colleagues' use of the Hartung-Knapp adjustment. In many cases, use of the Hartung-Knapp adjustment achieves its intended effect: more conservative estimates (i.e., estimates with wider CIs). However, this is not always the case, which has understandably resulted in some recommending sensitivity analyses if one uses the Hartung-Knapp adjustment, or perhaps even an "adaptive meta-analysis", where the underlying data drive decisions about which analytic model to present as the primary model.(3,4)

Repeating the analysis with Khan and colleagues' methods but excluding the Hartung-Knapp adjustment yields results identical to the Cochrane review (analyses carried out with R version 3.6.1 and meta version 4.9-6; data and analytic code available on request). The consistency of the results is expected given no statistical heterogeneity is identified in the analysis. The fact that τ^2 = 0 is also a probable cause for why the Hartung-Knapp adjustment resulted in a narrower CI than the fixed-effects model in the Cochrane review.(3,4) Results without the Hartung-Knapp adjustment should be considered more reliable here.

I encourage Khan and colleagues to consider conducting additional analyses for their results where relevant based on the above finding. This might be considered an example of "vibration in effects" due to model specification, and although not severe enough to result in a Janus phenomenon, the inferential difference that might result if considering Khan and colleagues' results versus the Cochrane review’s results feels much more substantial than a "vibration".(5)


References

1. Khan SU, Khan MU, Riaz H, Valavoor S, Zhao D, Vaughan L, et al. Effects of Nutritional Supplements and Dietary Interventions on Cardiovascular Outcomes: An Umbrella Review and Evidence Map. Ann Intern Med. 2019 Aug 6;171(3):190.

2. Adler AJ, Taylor F, Martin N, Gottlieb S, Taylor RS, Ebrahim S. Reduced dietary salt for the prevention of cardiovascular disease. Cochrane Database Syst Rev. 2014 Dec 18;(12):CD009217.

3. Wiksten A, Rücker G, Schwarzer G. Hartung-Knapp method is not always conservative compared with fixed-effect meta-analysis: Hartung-Knapp method is not always conservative compared with fixed-effect meta-analysis. Statist Med. 2016 Jul 10;35(15):2503–15.

4. Jackson D, Law M, Rücker G, Schwarzer G. The Hartung-Knapp modification for random-effects meta-analysis: A useful refinement but are there any residual concerns? Statist Med. 2017 Nov 10;36(25):3923–34.

5. Patel CJ, Burford B, Ioannidis JPA. Assessment of vibration of effects due to model specification can demonstrate the instability of observational associations. Journal of Clinical Epidemiology. 2015 Sep 1;68(9):1046–58.
Safi U. Khan 1, Di Zhao 2, Erin D. Michos 2, M. Hassan Murad 3 10 September 2019
The Choice of Meta-Analytic Model- Setting the Goals of the Analyses
We thank Drs. Kivelä and Mayer for their comments regarding the choice of meta-analytic model in estimating effects of salt reduction on all-cause mortality. Dr. Kivelä suggests using a Bayesian random effects (RE) model, yielding a 65% probability of mortality benefit with low salt diet. Dr. Mayer believes that a conservative RE model without Hartung-Knapp (HK) adjustment should have been considered.

Bayesian approaches in meta-analysis offer some advantages, such as the ability to include external evidence (from other data or from expert’s opinion), ability to adjust for bias (from outside sources) and overall model flexibility. Bayesian approaches are helpful in dealing with missing data and a limited number of studies (1). However, the Bayesian framework requires some strong assumptions; the most controversial of which is identifying reliable prior distributions. Different priors can yield inconsistent results. In this scenario, what constitutes a reasonable prior for salt reduction on all-cause mortality is unsettled.

In terms of the HK adjustment, this method assumes that variances are derived from small samples and constructs confidence limits based on the t distribution. Thus, KH adjustments should usually generate conservative (wider) confidence intervals (CIs). The CIs reduce towards fixed effects model results when results are more homogenous (2). It is thought to be more appropriate for meta-analyses with a small number of studies, binary outcomes and high degree of heterogeneity (3, 4).

Knowing that we were dealing with substantial clinical and methodological heterogeneity, small number of studies and binary outcomes, we set a priori the RE Paule-Mandel (PM) model with HK adjustments when number of trials were <10. We can certainly argue back and forth for a long time about which model is best. However, our decision was made a priori and repeating the analysis with a different model will be a data driven approach that opens the door for biased personal believes and data dredging. There is no gold standard and no single preferred approach (5). In the original paper, we noted the moderate certainty for the estimated effects, and we acknowledge that different results provided by different models can limit the certainty in the evidence.



REFERENCES
1. van de Schoot R, Kaplan D, Denissen J, Asendorpf JB, Neyer FJ, van Aken MAG. A gentle introduction to bayesian analysis: applications to developmental research. Child Dev. 2014;85(3):842-60.
2. Wiksten A, Rucker G, Schwarzer G. Hartung-Knapp method is not always conservative compared with fixed-effect meta-analysis. Stat Med. 2016;35(15):2503-15.
3. Veroniki AA, Jackson D, Viechtbauer W, Bender R, Bowden J, Knapp G, et al. Methods to estimate the between-study variance and its uncertainty in meta-analysis. Res Synth Methods. 2016;7(1):55-79.
4. Hartung J, Knapp G. On tests of the overall treatment effect in meta-analysis with normally distributed responses. Stat Med. 2001;20(12):1771-82.
5. Cornell JE, Mulrow CD, Localio R, Stack CB, Meibohm AR, Guallar E, et al. Random-effects meta-analysis of inconsistent effects: a time for change. Ann Intern Med. 2014;160(4):267-70.
Martin Mayer 17 September 2019
Sticking with a hammer when you find out you are working with a screw is not the best choice – The analytic tool should be appropriate for the data.
I thank Dr. Khan and colleagues for responding. However, with respect, their response does not address my concern; rather, their response seems to construct a "straw man" that acts as a "red herring".

They note I believe a "RE [random effects] model without Hartung-Knapp (HK) adjustment should have been considered" for the analysis in question (salt reduction in patients without hypertension for the outcome of all-cause mortality). They are correct about this. However, it seems they missed or misunderstood the concepts in my original letter. The HK adjustment has several advantages and should be considered accordingly in meta-analyses.[1,2] However, it is – like anything else – a tool, and people must use tools appropriately, even if their original belief about the "best" tool turns out to be incorrect.[1,2] As noted in my original letter, the HK adjustment typically yields more conservative estimates (i.e., wider confidence intervals). However, for the analysis in question, it does exactly the opposite. This effect is so pronounced that Dr. Khan and colleagues’ analysis (with a Paule-Mandle RE estimator and the HK adjustment) yields a narrower confidence interval than the fixed-effects (FE) analysis in the Cochrane review.[3,4] Although I noted this originally, it bears repeating, because this simple observation makes my point: The fact that the same data analyzed with a FE model would yield a wider confidence interval than a RE model lacks even face validity, and I explain why this is likely occurring in my original letter.

Rather than engaging with the concerns in my letter, Dr. Khan and colleagues seem to disregard the importance of ensuring model specifications are appropriate for the data at hand; instead, they suggest this "opens the door for biased personal believes[sic] and data dredging". Although presumably inadvertent, this constructs a "straw man" that acts as a "red herring". It is clear in my original letter I am not calling for an "anything goes" framework; what I am calling for, however, is avoidance of inappropriately stringent adherence to a priori specifications when it becomes clear that those specifications are inappropriate for the data at hand. If you tell everyone you are going to use a hammer because you anticipate needing to drive in nails and later find out you actually have one or more screws that need to be put in place, using the hammer for the screws because that was what you told people you would use is imprudent.







References

1. Jackson D, Law M, Rücker G, Schwarzer G. The Hartung-Knapp modification for random-effects meta-analysis: A useful refinement but are there any residual concerns? Statist Med. 2017 Nov 10;36(25):3923–34.

2. Wiksten A, Rücker G, Schwarzer G. Hartung-Knapp method is not always conservative compared with fixed-effect meta-analysis: Hartung-Knapp method is not always conservative compared with fixed-effect meta-analysis. Statist Med. 2016 Jul 10;35(15):2503–15.

3. Khan SU, Khan MU, Riaz H, Valavoor S, Zhao D, Vaughan L, et al. Effects of Nutritional Supplements and Dietary Interventions on Cardiovascular Outcomes: An Umbrella Review and Evidence Map. Ann Intern Med. 2019 Aug 6;171(3):190.

4. Adler AJ, Taylor F, Martin N, Gottlieb S, Taylor RS, Ebrahim S. Reduced dietary salt for the prevention of cardiovascular disease. Cochrane Database Syst Rev. 2014 Dec 18;(12):CD009217.
Karen Aspry MD MS, Andrew Freeman MD, Penny Kris Etherton RD PhD, Michael Miller MD, Emilio Ros MD PhD 30 September 2019
DATA FLAWS
We believe there are substantive flaws in this meta-analysis of randomized controlled trials (RCTs) of the effects of dietary interventions on cardiovascular (CV) outcomes. We also respectfully but strongly rebut editorialists Pandey and Topol, who conclude, based on this analysis, that “it is reasonable to hold off on any…dietary interventions in all guidelines."

Khan et al report no effect of reducing dietary saturated fat (SFA) on myocardial infarction, CV mortality or total mortality in RCTs. However, these findings are based on a previously published meta-analysis of 15 RCTs with a median duration of 4.7 years that was viewed as weak by the authors of the 2017 AHA Presidential Advisory on Dietary Fats because it omitted a high quality RCT yet included others limited by short durations, low adherence, or dietary contamination with trans-fats (1,2). Despite these limitations, this cited review did demonstrate a significant 27% reduction in the relative risk (RR) of major CV events (HR 0.83, 95% CI 0.72-0.96) that was even greater when dietary SFA was replaced by polyunsaturated fat (PUFA), a finding that led the original authors to conclude that this “appears to be a useful strategy” for reducing CV risk, but that Khan et al do not mention. Similarly, Khan et al fail to acknowledge that the meta-analysis of RCTs of the Mediterranean diet that they cite as having no impact on CV outcomes showed significant reductions in the RR of major vascular events (HR 0.69, 95% CI 0.55-0.86) and stroke (HR 0.66, 95% CI, 0.48–0.92) (3).

The authors also identify the use of “data only from RCTs and their meta-analyses” as one of the strengths of their study. This view fails to recognize the totality of the diet-heart disease science base, which also includes carefully conducted basic science, metabolic, translational, and prospective cohort studies that have yielded largely concordant data, including evidence that replacing dietary SFA with PUFA, or adhering to a Mediterranean dietary pattern, reduces CV and/or total mortality. The view that RCTs are the best way to examine the effects of dietary exposures on CV outcomes also conflicts with those of noted nutritional epidemiologists (4), and of the ACC/AHA, who recognize that “many important clinical questions addressed in guidelines do not lend themselves to clinical trials.”

Thus, we believe this meta-analysis contains flaws and omissions. Moreover, both the analysis and editorial ignore sound epidemiologic, cohort and translational nutrition evidence, and downgrade its importance in the prevention of CV disease, in stark contrast to expert panels of the AHA/ACC, the Dietary Guidelines Advisory Committee, and the National Lipid Association, all of whom report strong and consistent evidence that a healthy dietary pattern decreases CV risk, particularly when SFA are replaced by PUFA.


REFERENCES
1. Sacks, FM, Lichtenstein, AH, Wu, JHY et al. Dietary fats and cardiovascular disease. Circulation 2017 DOI: 10.1161/CIR.0000000000000510
2. Hooper, N, Martin, N, Abdelhamid, A et al. Reduction in saturated fat intake for cardiovascular disease. Cochrane Database Syst Rev. 2015:doi:10.1002/14651858.CD011737.
3. Liyanage T, Ninomiya T, Wang A, et al. Effects of the Mediterranean diet on cardiovascular outcomes: a systematic review and meta-analysis. PLoS One. 2016;11:e0159252. [PMID: 27509006] doi: 10.1371/journal.pone.0159252
4. Satija, A, Stampfer, MJ, Rimm, EB, Willett, W, and Hu, F. Are large simple trials the solution for nutrition research? Adv Nutr 2018;9:378-387 doi.org/10.1093/advances/nmy030.
John E. Cornell, PhD, Cynthia Mulrow, MD, MSc 7 October 2019
Choosing a Random-effects Estimator in the Post-DerSimonian-Laird Era
Khan and colleagues’ umbrella review of the Effects of Nutritional Supplements and Dietary Interventions on Cardiovascular Outcomes (1) elicited critiques based on the statistical methods used to re-estimate treatment effects. The authors’ used the Paule-Mandel (PM) method to estimate between-study variance (𝜏2), with the Hartung-Knapp/Sidik-Jonkman (HKSJ) adjustment in cases where the number of trails was 𝑘≤10. Their choice is consistent with Hartung and Knapp’s general recommendation to use the HKSJ adjustment with the PM estimate 𝜏2 (2), and it is consistent with the general, though tentative recommendations, by Veroniki and colleagues in two recent systematic reviews of methods to estimate 𝜏2 and construct confidence intervals in a random-effects meta-analysis. (3)
Kivelä’s (4) and Mayer’s (5) critique centers on the effects of reduced salt intake on all-cause mortality among normotensive patients reported in a Cochrane Review by Alder, et al. (6) The estimated treatment effect is based on 3 relatively small trials. The estimated between-study variance is 𝜏2=0 (95% 𝐶𝐼:0.00 𝑡𝑜 0.55). Kivelä (4) and Mayer (5) correctly point out that the standard HKSJ adjustment can seriously underestimate the uncertainty relative to the fixed effect or DerSimonian-Laird (DL) random effect method in this particular case. This occurs because the factor (q) used to adjust the pooled variance can be less than 1 under these circumstances; shrinking rather than increasing the variance estimate. Knapp and Hartung (2) recommend using a modified HKSJ that sets 𝑞∗ =max⁡{1,𝑞} to avoid this problem. The modified HKSJ with the PM yields a 𝑅𝑅=0.90 (95% 𝐶𝐼:0.35 𝑡𝑜 2.36), which is identical to the fixed confidence interval based on the t distribution with df = k – 1.
It is difficult to obtain robust estimates of 𝜏2 with k < 5 trials, and small sample adjustments like the modified HKSJ are often viewed as very conservative. So, what are our alternatives? The answer depends upon conditions in the data. Bayesian methods incorporate uncertainty in estimating both the average treatment effect and between-study variance, and these methods allow us to use informative priors for the model parameters. Informative priors based on established evidence are recommended for meta-analyses summarizing rare events and/or small number of trials. Sensitivity analyses over a range of reasonable priors are essential to establish the robustness of Bayesian estimated treatment effects. Other potential estimators include higher-order profile likelihood methods that adjust for small samples (3).
The HKSJ combined with a robust between-study variance estimator tends to have the best performance when k < 10 studies, except in the case where k < 5 and 𝜏2 = 0 (3). We believe the conditions in the data should guide decisions about the best estimator to use in any meta-analysis, and that sensitivity analyses are necessary to assess the robustness (certainty) of any finding. The modified HKSJ, Bayesian, and profile likelihood methods appear to perform well in a number of circumstances, particularly when conditions in the data pose problems for the HKSJ. We recommend that authors consider conducting additional analyses using one or more of these methods and that they reevaluate the robustness of findings when there were very few studies with no apparent heterogeneity.
References
1. Khan SU, Khan MU, Riaz H, et al. Effects of Nutritional Supplements and dietary Interventions on Cardiovascular Outcomes: An Umbrella Review and Evidence Map. Ann Intern Med. 2019; 171: 190-198.
2. Knapp G, Hartung J. Improved tests for a random effects meta-regression with a single covariate. Stat Med. 2003; 22: 2693-2710.
3. Veroniki AA, Jackson D, Bender R, et al. Methods to calculate uncertainty in the estimated overall effect size from a random-effects meta-analysis. Res Syn Meth. 2019; 10: 23-43.
4. Kivelä JM. JM. Does statistics in meta-analysis matter? (citation needed)
5. Mayer M. Deciphering discrepancy in meta-analytic results: The model matters.(citation needed)
6. Adler AJ, Taylor F, Martin N. et al. Reduced dietary salt for the prevention of cardiovascular disease. Cochrane Database Syst Rev. 2014; 12: CD009217.

John E. Cornell PhD
Annals Associate Editor, Statistics
Cynthia Mulrow MD, MSc
Annals Senior Deputy Editor
Safi U. Khan, MD 1; Muhammad Shahzeb Khan, MD 2; M. Hassan Murad, MD 2; Erin D. Michos, MD 3 10 October 2019
Tackling the Claims of Data Flaws
We respectfully but strongly rebut claims by Aspry and colleagues regarding data flaws and omissions in our umbrella review (1). Aspry et al. suggested that Hooper et al. and our review excluded a “high quality RCT” which potentially biased the findings against dietary saturated fat (2). While they did not cite that particular RCT, we assume they referred to the Finnish Mental Hospital study (3). Among various methodological issues, this study lacked genuine randomization (a cluster randomization with < 6 clusters), unacceptably high drop-out rates (55% per 6 years), had a mix of parallel (2/3 of participants) and cross over design (1/3 of participants), home food was not controlled and change in trans-fat intake was not taken into consideration. Since this study was clearly an outlier due to serious methodological limitations and perhaps did not truly satisfy the requirements of an RCT, it was eventually excluded by Hooper et al. and in our review.
They further pointed out that we failed to acknowledge relative risk (RR) reduction of major cardiovascular events (MACE: RR, 0.83 [0.72-0.96]; Analysis 1.3 in Hopper et al.)(2), that was even greater when dietary SFA was replaced by polyunsaturated fatty acid (PUFA), as well as lack of significant reductions in RR of MACE and stroke by Mediterranean diet by Liyanage et al (4). Here, Aspry and colleagues clearly missed the purpose of an umbrella review, which is to re estimate data abstracted from meta-analyses and individual studies using more robust statistical methodology to generate evidence map based on certainty and quality of evidence. While we clearly stated that abstracted data was re-estimated using Paule-Mandel (PM) method with Hartung-Knapp small sample adjustments (<10 trials), reviewers also failed to recognize that our pre-specified secondary endpoint was coronary heart disease (CHD) instead of MACE. Additionally, we did not specify analysis based on replacement of dietary fats with other fats modifications. Accordingly, Hooper et al. did not show a significant risk reduction in CHD events with SFA (RR, 0.87 [0.74-1.03; Analysis 2.5), which was consistent with our results.
However, for the sake of argument, we reanalyzed MACE via random effects (PM method) model using data of Analysis 2.5 in Hooper et al, to revalidate our conclusion regarding lack of cardiovascular benefit with SFA (RR, 0.80 [0.62-1.02]; Figure 1.A).  Furthermore, interestingly, the argument of RR reduction by replacing SFA with PUFA (RR, 0.73 [0.58-0.92]) versus replacement with monounsaturated fatty acid, carbohydrate and protein hangs on a P-interaction value of 0.14 (Table 9; Hopper et al.). In the same framework, consistent to our report, Liyange et al. showed no significant benefit of Mediterranean diet on CHD (RR, 0.73 [0.51-1.05]. Again, we reanalyzed stroke and MACE and results remained non-significant for Mediterranean diet (stroke: RR, 0.65; [0.39-1.11] and MACE: RR. 0.48 [0.10-2.28]; Figure 1.B & C, respectively).  That said, we did compare our results with prior meta-analyses and acknowledged that changes in results are due to different statistical methodology, where necessary. We also acknowledged limitations of included RCTs, including variable duration of follow-up across the studies.
Finally, Aspry and colleagues suggested that we ignored the wealth of observational data regarding nutritional science. We purposefully excluded epidemiological studies due to their lack of a priori hypothesis, residual confounding and lack of adjustment for confounders and recall bias with dietary measurement leading to seriously inaccurate conclusions (5). Authors believe that in the presence of quality RCTs, shaping guidelines based on observational studies can be extremely misleading, and our umbrella review was an attempt to fill this evidence free zone (6).

REFERENCES
1. Khan SU, Khan MU, Riaz H, Valavoor S, Zhao D, Vaughan L, et al. Effects of Nutritional Supplements and Dietary Interventions on Cardiovascular Outcomes: An Umbrella Review and Evidence Map. Ann Intern Med. 2019;171(3):190-8.
2. Hooper L, Martin N, Abdelhamid A, Davey Smith G. Reduction in saturated fat intake for cardiovascular disease. Cochrane Database Syst Rev. 2015(6):Cd011737.
3. Turpeinen O, Karvonen MJ, Pekkarinen M, Miettinen M, Elosuo R, Paavilainen E. Dietary prevention of coronary heart disease: the Finnish Mental Hospital Study. Int J Epidemiol. 1979;8(2):99-118.
4. Liyanage T, Ninomiya T, Wang A, Neal B, Jun M, Wong MG, et al. Effects of the Mediterranean Diet on Cardiovascular Outcomes-A Systematic Review and Meta-Analysis. PLoS One. 2016;11(8):e0159252.
5. Ioannidis JPA. The Challenge of Reforming Nutritional Epidemiologic Research. Jama. 2018;320(10):969-70.
6. Nissen SE. U.S. Dietary Guidelines: An Evidence-Free Zone. Ann Intern Med. 2016;164(8):558-9.


Figure legends

Figure 1. Effects of Reduced Saturated Fat (SFA) on Major Adverse Cardiovascular Outcomes (MACE); and Mediterranean Diet on MACE and Stroke
Safi U. Khan, MD1; Di Zhao, PhD2; M. Hassan Murad, MD3; Eliseo Guallar, MD, DrPH 2,4, Erin D. Michos, MD, MHS2,4. 30 October 2019
Sensitivity Analyses on Cardiovascular Effects of Nutritional Supplements and Dietary Interventions: Taking A Fresh Look
In our original analyses, we adopted a priori model consistent with Hartung and Knapp’s general recommendation for the use of Hartung-Knapp/Sidik-Jonkman (HKSJ) adjustment with the Paule-Mandel (PM) estimator of between-study variance (𝜏2), when the number of trials (𝑘) were ≤10. (1, 2) However, Drs. Kivelä, Mayer and Cornell highlighted that using standard HKSJ adjustment with the PM method can underestimate the uncertainty when k < 5 and 𝜏2 = 0 (3-5), and in this case, led to narrower confidence intervals (CI) in evaluating effect of reduced salt intake on all-cause mortality in normotensive patients (2-6). Considering the difficulty to generate robust estimates in such a scenario, Cornell et al. encouraged us to conduct additional analyses, using modified HKSJ, Bayesian, or profile likelihood methods, where relevant (3).
Accordingly, we performed sensitivity analyses for all interventions and outcomes, where k ≥ 2 but < 5 and 𝜏2= 0 using modified HKSJ with PM method. Statistical analyses were conducted using “meta” commands from Stata version 16. Consistent with already published statistical plan (6), statistical significance was set at 0.05 and effect sizes were reported as risk ratios (RRs) with 95% CIs. We used I2 statistics to estimate the extent of unexplained heterogeneity; I2 greater than 50% was considered a high degree of between-study heterogeneity.
Twenty-nine estimates were re-analyzed. As expected, CIs widened with adjustment. Two estimates changed from protective to nonsignificant: 1) low salt diet on all-cause mortality (RR, 0.90 [0.34, 2.36]; low certainty of evidence) in hypertensives; and 2) cardiovascular mortality (RR, 0.67 [0.28, 1.64]; low certainty of evidence) in normotensive patients. There was no important change in conclusions or certainty in evidence for the other 27 estimates (Table ) Sensitivity Analyses and Implications on Outcomes


These sensitivity analyses further validate the lack of cardiovascular effects of various nutritional supplements and dietary interventions. Editorialists Drs. Pandey and Topol highlighted the controversial finding of better mortality outcomes with low salt diet in view of limited evidence (7). We also discussed about inconsistent data supporting cardiovascular benefits of low salt diet (6). Therefore, in view of these sensitivity analyses, the certainty of evidence regarding cardiovascular effects of reduced salt intake should be downgraded. Essentially, our updated findings support the 2019 National Academics Consensus Study regarding insufficient evidence to establish estimates average requirements (EAR) or recommended dietary allowances (RAD) for sodium (8). Meta-analyses with a small number of included studies remain a challenge. It is a difficult decision to choose between the a priori selected model vs a new post hoc data-driven model. In this case, the new model likely yields the more conservative and appropriate results. 

References

1. Veroniki AA, Jackson D, Bender R, Kuss O, Langan D, Higgins JPT, et al. Methods to calculate uncertainty in the estimated overall effect size from a random-effects meta-analysis. Res Synth Methods. 2019;10(1):23-43.
2. Knapp G, Hartung J. Improved tests for a random effects meta-regression with a single covariate. Stat Med. 2003;22(17):2693-710.
3. John E. Cornell CM. Choosing a Random-effects Estimator in the Post-DerSimonian-Laird Era. Annals of Internal Medicine. 2019.
4. Kivelä JM. Does statistics in meta-analyses matter? Annals of Internal Medicine. 2019.
5. Mayer M. Deciphering discrepancy in meta-analytic results: The model matters. Annals of Internal Medicine. 2019.
6. Khan SU, Khan MU, Riaz H, Valavoor S, Zhao D, Vaughan L, et al. Effects of Nutritional Supplements and Dietary Interventions on Cardiovascular Outcomes: An Umbrella Review and Evidence Map. Ann Intern Med. 2019;171(3):190-8.
7. Pandey AC, Topol EJ. Dispense With Supplements for Improving Heart Outcomes. Ann Intern Med. 2019;171(3):216-7.
8. National Academies of Sciences E, and Medicine. Dietary Reference Intakes for Sodium and Potassium. Washington, DC: National Academies Program, 2019.

Information & Authors

Information

Published In

cover image Annals of Internal Medicine
Annals of Internal Medicine
Volume 171Number 36 August 2019
Pages: 190 - 198

History

Published online: 9 July 2019
Published in issue: 6 August 2019

Keywords

Authors

Affiliations

Safi U. Khan, MD
West Virginia University, Morgantown, West Virginia (S.U.K., M.U.K., S.V.)
Muhammad U. Khan, MD
West Virginia University, Morgantown, West Virginia (S.U.K., M.U.K., S.V.)
Haris Riaz, MD
Cleveland Clinic, Cleveland, Ohio (H.R.)
Shahul Valavoor, MD
West Virginia University, Morgantown, West Virginia (S.U.K., M.U.K., S.V.)
Di Zhao, PhD
Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland (D.Z.)
Lauren Vaughan, MD
East Carolina University, Greenville, North Carolina (L.V., V.O.)
Victor Okunrintemi, MD, MPH
East Carolina University, Greenville, North Carolina (L.V., V.O.)
Irbaz Bin Riaz, MD, MS
Mayo Clinic, Rochester, Minnesota (I.B.R., M.H.M.)
Muhammad Shahzeb Khan, MD
John H. Stroger, Jr. Hospital of Cook County, Chicago, Illinois (M.S.K.)
Edo Kaluski, MD
Guthrie Robert Packer Hospital, Sayre, Pennsylvania (E.K.)
M. Hassan Murad, MD
Mayo Clinic, Rochester, Minnesota (I.B.R., M.H.M.)
Michael J. Blaha, MD, MPH
Johns Hopkins School of Medicine, Baltimore, Maryland (M.J.B.)
Eliseo Guallar, MD, DrPH
Johns Hopkins Bloomberg School of Public Health and Johns Hopkins School of Medicine, Baltimore, Maryland (E.G.)
Erin D. Michos, MD, MHS
Johns Hopkins School of Medicine and Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland (E.D.M.)
Financial Support: Drs. Zhao, Guallar, and Michos are funded by the Blumenthal Scholars Fund in Preventive Cardiology at Johns Hopkins University.
Disclosures: Dr. Blaha reports grants from the National Heart, Lung, and Blood Institute, the Food and Drug Administration, the American Heart Association, Amgen, and the Aetna Foundation and personal fees from the Food and Drug Administration, Amgen, Sanofi, Novartis, Novo Nordisk, and Bayer outside the submitted work. Authors not named here have disclosed no conflicts of interest. Disclosures can also be viewed at www.acponline.org/authors/icmje/ConflictOfInterestForms.do?msNum=M19-0341.
Editors' Disclosures: Christine Laine, MD, MPH, Editor in Chief, reports that her spouse has stock options/holdings with Targeted Diagnostics and Therapeutics. Darren B. Taichman, MD, PhD, Executive Editor, reports that he has no financial relationships or interests to disclose. Cynthia D. Mulrow, MD, MSc, Senior Deputy Editor, reports that she has no relationships or interests to disclose. Jaya K. Rao, MD, MHS, Deputy Editor, reports that she has stock holdings/options in Eli Lilly and Pfizer. Catharine B. Stack, PhD, MS, Deputy Editor, Statistics, reports that she has stock holdings in Pfizer, Johnson & Johnson, and Colgate-Palmolive. Christina C. Wee, MD, MPH, Deputy Editor, reports employment with Beth Israel Deaconess Medical Center. Sankey V. Williams, MD, Deputy Editor, reports that he has no financial relationships or interests to disclose. Yu-Xiao Yang, MD, MSCE, Deputy Editor, reports that he has no financial relationships or interest to disclose.
Corresponding Author: Safi U. Khan, MD, West Virginia University, 1 Medical Center Drive, Morgantown, WV 26505; e-mail, [email protected].
Current Author Addresses: Drs. S.U. Khan, M.U. Khan, and Valavoor: West Virginia University, One Medical Center Drive, Morgantown, WV 26508.
Dr. H. Riaz: Cleveland Clinic, 9500 Euclid Avenue, Cleveland, OH 44195.
Drs. Zhao and Guallar: Johns Hopkins Bloomberg School of Public Health, Welch Center, 2024 East Monument Street, Suite 2600, Baltimore, MD 21205.
Drs. Vaughan and Okunrintemi: East Carolina University, 2100 Stantonsburg Road, Greenville, NC 27834.
Drs. I.B. Riaz and Murad: Mayo Clinic, 200 1st Street Southwest, Rochester, MN 55901.
Dr. M.S. Khan: 903 South Ashland Avenue, Apt 1206, Chicago, IL 60607.
Dr. Kaluski: Guthrie Robert Packer Hospital, One Guthrie Square, Sayre, PA 18840.
Dr. Blaha: Johns Hopkins School of Medicine, 600 North Wolfe Street, Blalock 524-D1, Baltimore, MD 21287.
Dr. Michos: Johns Hopkins School of Medicine, 600 North Wolfe Street, Blalock 524-B, Baltimore, MD 21287.
Author Contributions: Conception and design: S.U. Khan.
Analysis and interpretation of the data: S.U. Khan, D. Zhao, E. Guallar, E.D. Michos.
Drafting of the article: S.U. Khan, H. Riaz, L. Vaughan, V. Okunrintemi, E. Guallar, E.D. Michos.
Critical revision of the article for important intellectual content: S.U. Khan, I.B. Riaz, M.S. Khan, M.H. Murad, M.J. Blaha, E. Guallar, E.D. Michos.
Final approval of the article: S.U. Khan, M.U. Khan, H. Riaz, S. Valavoor, D. Zhao, L. Vaughan, V. Okunrintemi, I.B. Riaz, M.S. Khan, E. Kaluski, M.H. Murad, M.J. Blaha, E. Guallar, E.D. Michos.
Provision of study materials or patients: S.U. Khan, M.U. Khan, S. Valavoor.
Statistical expertise: S.U. Khan, M.H. Murad, D. Zhao, E. Guallar, E.D. Michos.
Administrative, technical, or logistic support: E.D. Michos.
Collection and assembly of data: S.U. Khan, M.U. Khan, S. Valavoor.
This article was published at Annals.org on 9 July 2019.

Metrics & Citations

Metrics

Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. For an editable text file, please select Medlars format which will download as a .txt file. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format





Download article citation data for:
Safi U. Khan, Muhammad U. Khan, Haris Riaz, et al. Effects of Nutritional Supplements and Dietary Interventions on Cardiovascular Outcomes: An Umbrella Review and Evidence Map. Ann Intern Med.2019;171:190-198. [Epub 9 July 2019]. doi:10.7326/M19-0341

View More

Login Options:
Purchase

You will be redirected to acponline.org to sign-in to Annals to complete your purchase.

Access to EPUBs and PDFs for FREE Annals content requires users to be registered and logged in. A subscription is not required. You can create a free account below or from the following link. You will be redirected to acponline.org to create an account that will provide access to Annals. If you are accessing the Free Annals content via your institution's access, registration is not required.

Create your Free Account

You will be redirected to acponline.org to create an account that will provide access to Annals.

View options

PDF/EPUB

View PDF/EPUB

Related in ACP Journals

Full Text

View Full Text

Figures

Tables

Media

Share

Share

Copy the content Link

Share on social media