Reviews
3 October 2006

Narrative Review: Lack of Evidence for Recommended Low-Density Lipoprotein Treatment Targets: A Solvable ProblemFREE

Publication: Annals of Internal Medicine
Volume 145, Number 7

Abstract

Recent national recommendations have proposed that physicians should titrate lipid therapy to achieve low-density lipoprotein (LDL) cholesterol levels less than 1.81 mmol/L (<70 mg/dL) for patients at very high cardiovascular risk and less than 2.59 mmol/L (<100 mg/dL) for patients at high cardiovascular risk. To examine the clinical evidence for these recommendations, the authors sought to review all controlled trials, cohort studies, and case–control studies that examined the independent relationship between LDL cholesterol and major cardiovascular outcomes in patients with LDL cholesterol levels less than 3.36 mmol/L (<130 mg/dL).
For those with LDL cholesterol levels less than 3.36 mmol/L (<130 mg/dL), the authors found no clinical trial subgroup analyses or valid cohort or case–control analyses suggesting that the degree to which LDL cholesterol responds to a statin independently predicts the degree of cardiovascular risk reduction. Published studies had avoidable limitations, such as a reliance on ecological (aggregate) analyses, use of analyses that ignore statins' other proposed mechanisms of action, and failure to account for known confounders (especially healthy volunteer effects). Clear, compelling evidence supports near-universal empirical statin therapy in patients at high cardiovascular risk (regardless of their natural LDL cholesterol values), but current clinical evidence does not demonstrate that titrating lipid therapy to achieve proposed low LDL cholesterol levels is beneficial or safe.

Key Summary Points

No high-quality evidence could be found that suggests that titrating lipid therapy to recommended low-density lipoprotein (LDL) cholesterol targets is superior to empirically prescribing doses of statins used in clinical trials for all patients at high cardiovascular risk.
Studies addressing benefits of achieving LDL cholesterol goals have had avoidable problems, such as reliance on ecological (aggregate) analyses, ignoring statins' other proposed mechanisms of action, and not accounting for known confounders (especially healthy volunteer effects).
Much more reliable evidence on currently proposed LDL cholesterol goals could be expeditiously produced by conducting cohort analyses of past statin trials that control for statin dose and pill adherence.
Dichotomous comparisons (such as comparing those who reach goal vs. those who do not) can mistakenly suggest that not achieving the treatment goal results in moderate risk when in fact almost all of the risk is caused by large deviations from the ideal goal.
Proposals for treatment goals should also consider the risks, patient burden, and societal costs of the treatments that may be needed to reach those goals.
In 2004, a National Cholesterol Education Program (NCEP) expert panel recommended that physicians titrate lipid therapy to reach a low-density lipoprotein (LDL) cholesterol level less than 1.81 mmol/L (<70 mg/dL) in patients at very high risk for cardiovascular events (1, 2). The panel stated that consistent and compelling evidence showed a strong relationship between LDL cholesterol level and cardiovascular outcomes down to this level (1, 2). However, others have reviewed the same literature and have concluded that there is no valid evidence from clinical trials (see Glossary) supporting this conclusion (3, 4). Since the early 1900s, we have known that familial hyperlipidemia syndromes result in premature cardiovascular disease, and in the United States and northern Europe, cohort studies have usually found that LDL cholesterol is a major independent cardiovascular risk factor at levels above 3.75 mmol/L (>145 mg/dL) (5, 6). However, these studies had limited ability to assess whether this relationship continued at lower LDL cholesterol levels, and some suggested that this association was less marked as LDL cholesterol level approached 3.36 mmol/L (130 mg/dL), especially when high-density lipoprotein cholesterol levels were normal (7, 8). Furthermore, studies in southern Europe, where LDL cholesterol levels tend to be lower in general, have often found a less strong association than those conducted in northern Europe, even in the moderate LDL cholesterol range (3.36 to 4.14 mmol/L [130 to 160 mg/dL]) (7, 8). In addition, studies in Asia and in elderly persons have often found no decrease or even an increase in cardiovascular risk when LDL cholesterol level drops below 3.36 mmol/L (130 mg/dL) (9). These results raised questions about whether the strong association found at higher levels of LDL cholesterol could be extended to lower LDL cholesterol levels; they also raised concerns that total LDL cholesterol is an unreliable marker of benefit and may be confounded by dietary factors or LDL subparticles that are the true causal factors (7–11).
These concerns seemed to be allayed when multiple clinical trials showed that statin therapy dramatically decreased cardiovascular events in almost all groups at high risk and that this benefit extended to those with pretreatment LDL cholesterol levels of 2.33 to 2.59 mmol/L (90 to 100 mg/dL) (1, 2, 12–17). Several recent trials have also shown greater benefits for high-dose statin therapy compared with low to moderate doses for those with acute coronary syndromes (14, 17) and known coronary artery disease (15, 16) (although the results in the IDEAL [Incremental Decrease in Endpoints Through Aggressive Lipid Lowering] study [16], in which participants had stable coronary artery disease, did not reach statistical significance). However, these studies generally used fixed doses of statins (placebo vs. statin or low-dose vs. high-dose statin) and therefore cannot directly shed light on whether clinicians should prescribe the doses used in the studies or titrate lipid therapy to achieve recommended LDL cholesterol goals.
This is particularly relevant because statins do much more than decrease LDL cholesterol levels. Although strong mechanistic evidence supports the LDL hypothesis, strong basic science evidence (18) also suggests that the effects of statins on inflammation, thrombosis, and oxidation are plausible mechanisms for mediating the benefits of statin therapy (often referred to as “pleiotropic effects”) (Appendix Table 1). Indeed, some statin trials seem to run counter to the LDL hypothesis. For example, trials have found that statins substantially reduce the risk for stroke, which is more consistent with their hypothesized antithrombotic effects than with their LDL-lowering effects (high LDL levels are not a major independent risk factor for stroke) (19). In addition, a recent large statin trial conducted in patients receiving dialysis found no substantial benefit despite reductions of 42% in LDL cholesterol levels (20), suggesting that even dramatic reductions are not always associated with clinically significant lowering of cardiovascular risk.
Appendix Table 1. Known Lipid-Independent Effects of Statins*
Appendix Table 1. Known Lipid-Independent Effects of Statins*
For clinicians and patients, this issue is much more than an academic debate. Compared with empirically treating patients at high cardiovascular risk with statin doses similar to those used in clinical trials, titrating lipid therapy to recommended LDL cholesterol goals entails considerably greater clinical complexity, frequent use of multidrug therapy, and greater societal and patient out-of-pocket costs; these, in turn, can result in increased patient burden and lower adherence to all treatments (21–23). Fewer than half of those receiving high doses of statins in clinical trials have achieved LDL cholesterol levels less than 1.81 mmol/L (<70 mg/dL) (15–17), and it is unclear whether achieving this goal is truly feasible even if multidrug therapy is used. Most important, if reducing total LDL cholesterol to very low levels is not truly the dominant beneficial mechanism of statin therapy, pursuit of such values using multidrug therapy could result in net harm to patients (22). This concern may be heightened by recent clinical trials suggesting that some treatments that “improve” lipid profiles, such as hormone replacement therapy and muraglitazar, actually increase cardiovascular risk (24–26).
In this paper, we examine the clinical evidence for and against recommended treatment goals for LDL cholesterol levels and outline an approach by which the benefits of these and other proposed treatment goals may be better assessed in the future.

Methods

Implicit in recommendations to pursue a specific treatment goal (such as LDL cholesterol level <1.81 mmol/L [<70 mg/dL]) is the assumption that reaching the goal is a strong predictor of the degree of patient benefit independent of all known confounders, including the treatment or treatments. Otherwise, we would simply give people the treatments used in studies. Therefore, we sought to identify studies that examined whether reaching low LDL cholesterol targets or a more substantial percentage reduction of LDL cholesterol (the 2 goals put forth in the NCEP guidelines) is a strong independent predictor of cardiovascular risk reduction.
We sought to examine all controlled trials, cohort studies (see Glossary), and case–control studies that examined the independent association between LDL cholesterol levels and major cardiovascular outcomes in patients with LDL cholesterol levels less than 3.36 mmol/L (<130 mg/dL). We began by reviewing all of the literature cited in the 2004 NCEP expert panel report (1) that proposed the new treatment goal of less than 1.81 mmol/L (<70 mg/dL). The NCEP expert report does not note whether a formal MEDLINE review was conducted, so we also reviewed all citations from the American College of Physicians lipid guidelines (3, 4), a recent meta-analysis (2), and the Cochrane database (27). In addition, we conducted an updated MEDLINE review (1 April 2004 to 20 May 2006) using the following search: ((low density lipoprotein cholesterol OR ldl cholesterol) AND (cohort study OR case–control study OR case control study OR randomized, controlled study OR clinical trial) [limited to human and adults]. All abstracts of the 1214 articles produced in this search were screened by trained masters-level research associates, and all identified controlled trials, cohort studies, and case–control studies that reported any morbidity or mortality outcomes underwent full independent review by 2 of the authors. Finally, we contacted members of the NCEP expert panel, prominent cardiovascular clinical trialists, and experts in lipid therapy and asked whether they could identify any additional studies that met our inclusion criteria (Appendix).
We began our review by examining the literature and arguments cited by the NCEP in support of its recommendation (1). Next, we reviewed all identified experimental evidence and all valid observational evidence (controlled longitudinal studies [cohort and case–control studies] that used a multivariable regression technique to control for all known major confounders) that met our inclusion criteria (that is, assessed the independent association between LDL cholesterol level and major cardiovascular outcomes in patients with LDL cholesterol levels <3.36 mmol/L [<130 mg/dL]). Criteria for quality ratings of eligible articles were planned by protocol but were rendered unnecessary because no studies met our minimum inclusion criteria. Therefore, we examined methodologic limitations in the studies found in our literature review. Most major problems found in the experimental literature could be classified as not considering the alternative hypotheses and mistaking cohort results for true experimental results. Most major methodologic limitations in the observational literature could be classified as not demonstrating whether the LDL cholesterol association was independent of treatment exposure (that is, how much statin patients were taking), ignoring healthy volunteer effects, using ecological (aggregate) comparisons rather than true cohort (individual) analyses, and relying on dichotomies instead of examining more continuous associations.

Results

Basis of the NCEP Target

The experts from the NCEP stated the following:
Recent clinical trials nonetheless have documented … that for every 1% reduction in LDL-C [low-density lipoprotein cholesterol] levels, relative risk for major CHD [coronary heart disease] events is reduced by approximately 1%. HPS [Heart Protection Study] data suggest that this relationship holds for LDL-C levels even below 100 mg/dL [2.59 mmol/L].
The log-linear LDL hypothesis referred to by the NCEP experts suggests that independent of all other risk factors, the log of the relative risk for cardiovascular events is linearly associated with LDL cholesterol level (1). Figure 1 shows predictions of the log-linear hypothesis for 2 patients with diabetes. Although the relative risk reduction is constant in a log-linear association, the absolute risk reduction has diminishing returns (just as when a piece of paper is serially torn in half and half is thrown away, the halves that are thrown away get smaller and smaller). Sometimes these diminishing returns predict that very few absolute benefits will accrue from pursuing very low treatment goals (such as in low- to moderate-risk patients). However, Figure 1 also demonstrates how patients at high cardiovascular risk could obtain clinically significant benefit from reaching strict LDL cholesterol goals if the log-linear relationship holds for LDL cholesterol levels less than 3.36 mmol/L (<130 mg/dL).
Figure 1. The diminishing returns of the hypothesized log-linear relationship.  The log-linear low-density lipoprotein (LDL) hypothesis suggests that relative risk reduction is constant but that there are diminishing absolute benefits. For example, reducing LDL cholesterol level by 0.78 mmol/L (30 mg/dL) is associated with a 24% relative risk reduction in all instances, but the amount of absolute benefit is much greater when LDL cholesterol level is reduced from 5.69 mmol/L (220 mg/dL) to 4.91 mmol/L (190 mg/dL) than from 2.59 mmol/L (100 mg/dL) to 1.81 mmol/L (70 mg/dL). Absolute benefit is also greater when higher-risk patients (top) compared with lower-risk patients (bottom) are being treated. The top panel predicts reduction in cardiovascular (CV) risk for a 65-year-old white woman with type 2 diabetes mellitus and systolic blood pressure of 145 mm Hg, high-density lipoprotein cholesterol level of 0.54 mmol/L (21 mg/dL), triglyceride level of 3.39 mmol/L (300 mg/dL), and hemoglobin A1c level of 7%. The bottom panel predicts reduction in CV risk for a 60-year-old white woman with type 2 diabetes mellitus and systolic blood pressure of 125 mm Hg, high-density lipoprotein cholesterol level of 1.42 mmol/L (55 mg/dL), triglyceride level of 1.13 mmol/L (100 mg/dL), and hemoglobin A1c level of 7%. To convert LDL cholesterol values to mmol/L, multiply by 0.02586.
Figure 1. The diminishing returns of the hypothesized log-linear relationship.
The log-linear low-density lipoprotein (LDL) hypothesis suggests that relative risk reduction is constant but that there are diminishing absolute benefits. For example, reducing LDL cholesterol level by 0.78 mmol/L (30 mg/dL) is associated with a 24% relative risk reduction in all instances, but the amount of absolute benefit is much greater when LDL cholesterol level is reduced from 5.69 mmol/L (220 mg/dL) to 4.91 mmol/L (190 mg/dL) than from 2.59 mmol/L (100 mg/dL) to 1.81 mmol/L (70 mg/dL). Absolute benefit is also greater when higher-risk patients (top) compared with lower-risk patients (bottom) are being treated. The top panel predicts reduction in cardiovascular (CV) risk for a 65-year-old white woman with type 2 diabetes mellitus and systolic blood pressure of 145 mm Hg, high-density lipoprotein cholesterol level of 0.54 mmol/L (21 mg/dL), triglyceride level of 3.39 mmol/L (300 mg/dL), and hemoglobin A1c level of 7%. The bottom panel predicts reduction in CV risk for a 60-year-old white woman with type 2 diabetes mellitus and systolic blood pressure of 125 mm Hg, high-density lipoprotein cholesterol level of 1.42 mmol/L (55 mg/dL), triglyceride level of 1.13 mmol/L (100 mg/dL), and hemoglobin A1c level of 7%. To convert LDL cholesterol values to mmol/L, multiply by 0.02586.

Experimental Evidence for the LDL Hypothesis When LDL Cholesterol Levels Are Less than 3.36 mmol/L (<130 mg/dL)

Almost all published clinical trials examined fixed doses of statins (placebo vs. statin or low-dose vs. high-dose statins), and no published trial examined titrating lipid therapy to the proposed LDL cholesterol goals. Therefore, the main results of these trials could not be used to support or refute the benefits of titrating lipid therapy to try to achieve these LDL cholesterol targets. We found only 1 valid experimental subgroup analysis of this question, which does not support the log-linear LDL hypothesis (13). In the HPS, all participants received 40 mg of simvastatin (the study drug) before randomization and investigators measured each participant's biological response to statin therapy. This allowed a true experimental subgroup analysis. By giving all study participants a brief trial of 40 mg of simvastatin before randomization, investigators were able to match control and intervention participants according to their response to statin therapy. Contrary to the LDL log-linear hypothesis (which would suggest that those who have a larger LDL cholesterol response from a given statin dose would receive greater benefit), those with the worst prerandomization LDL response (<38% reduction in LDL cholesterol level) received the same benefit as those with the best LDL response (>48% reduction in LDL cholesterol level) (Figure 2). Therefore, we could find no experimental evidence suggesting that the degree of LDL cholesterol reduction is an independent predictor of cardiovascular risk if LDL cholesterol level is less than 3.36 mmol/L (<130 mg/dL) (13).
Figure 2. Results for the Heart Protection Study.  No statistically or clinically significant difference was seen in relative benefit of statin therapy by low-density lipoprotein (LDL) cholesterol level at baseline or prerandomization LDL response. To convert LDL cholesterol values to mg/dL, divide by 0.02586.
Figure 2. Results for the Heart Protection Study.
No statistically or clinically significant difference was seen in relative benefit of statin therapy by low-density lipoprotein (LDL) cholesterol level at baseline or prerandomization LDL response. To convert LDL cholesterol values to mg/dL, divide by 0.02586.

Observational Evidence for the LDL Log-Linear Hypothesis When LDL Cholesterol Levels Are Less than 3.36 mmol/L (<130 mg/dL)

All potentially eligible observational studies (see Glossary) were cohort studies that used data originally collected as part of a statin trial. A cohort study is a type of longitudinal observational study in which risk factors are collected at baseline for a group of people (the cohort) and the researchers then use multivariable analysis to assess which risk factors are strong independent predictors of future outcomes. Cohort studies can be a strong source of evidence for independent associations, but only if the investigators are able to account for all likely confounders (28–30). Because none of the cohort analyses of statin trials adequately controlled for known major confounders, it is impossible to draw sound conclusions on the basis of their results.

Problems with the Experimental Evidence

Not Considering Alternative Hypotheses When Interpreting Experiments

What was the “clinical trial” evidence to which the NCEP report referred? The NCEP report emphasized that clinical trials have found that the degree of relative benefit of statin therapy in high-risk patients is largely independent of baseline LDL cholesterol level. This is consistent with a log-linear association because the log-linear hypothesis predicts that reducing LDL cholesterol levels by 0.78 mmol/L (30 mg/dL) will produce the same relative risk reduction in someone with an LDL cholesterol level of 5.69 mmol/L (220 mg/dL) and someone with an LDL cholesterol level of 2.59 mmol/L (100 mg/dL); only the absolute benefits will differ (Figure 1) (1, 13). However, this argument ignores a basic tenet of the scientific method: For evidence to advance a particular hypothesis, it must be more consistent with the proposed hypothesis than with the competing hypotheses. If the major benefits of statins are mediated through their effects on inflammation, thrombosis, and oxidation (Appendix Table 1) (18), we would also expect the relative benefits of statin therapy to be independent of baseline LDL cholesterol level. Therefore, this finding does not advance the LDL log-linear hypothesis over other possibilities and does not help us determine whether percentage LDL cholesterol reduction or absolute LDL cholesterol level is a valid indicator of the appropriate number and dosage of lipid-lowering therapies for high-risk patients.

Mistaking Cohort Analyses for True Experimental Results

Although the beauty of the true experiment (see Glossary) is that random assignment of large numbers of patients usually protects study results from both known and unknown confounders without a need for statistical adjustment, this protection applies only to the specific intervention tested (28–30). In the case of statin trials, the clinical intervention randomized is statin therapy, not LDL cholesterol levels. Although many researchers have noted that the degree of LDL cholesterol reduction in these trials is associated with the degree of cardiovascular risk reduction in clinical trials (2), this finding is based on 2 postrandomization findings and is therefore observational, not experimental. For this reason, potential confounders must be taken into account.

Problems in Cohort Analyses That Used Clinical Trial Data

Performing cohort analyses of clinical trials can be an excellent way to assess the merits of specific treatment goals (30). Such analyses are often much better able than experiments to directly assess a treatment's mechanism of action and the nature of continuous effects. However, observational analyses using clinical trial data have the same risks for confounding as those in any other observational cohort analysis, even though the data originate from an experiment. In fact, 2 notable major sources of confounding are particularly problematic in such studies, and neither was considered in any of the cohort studies found in our review.

Cohort Analyses Using Clinical Trial Data Must Control for Exposure to the Treatment

Anything that an effective treatment causes (including its side effects) can appear to improve outcomes if researchers do not control for treatment exposure (in this case, treatment exposure is a combination of statin dose and pill adherence). For example, because statin therapy increases myalgia, an uncontrolled cohort analysis of a statin trial will find that patients with myalgia have fewer cardiovascular events than those without myalgia. However, this finding would merely be due to confounding because patients with myalgia are more likely to be taking a statin.
Because clinical trials examining titrating treatments to achieve LDL cholesterol goals are in progress and because such studies are sometimes misinterpreted as demonstrating the importance of reaching a treatment target, we will examine a hypothetical dose-titration trial in more detail (Figure 3). This hypothetical trial has 3 treatment arms: 1) placebo; 2) megastatin, 10 mg; and 3) titrating megastatin (maximum dose, 80 mg) to achieve an LDL cholesterol target of less than 1.81 mmol/L (<70 mg/dL). Figure 3 shows the true results: 1) Megastatin decreases LDL cholesterol level in a dose-dependent manner (the higher the megastatin dose, the greater the reduction); 2) megastatin lowers cardiovascular risk (40 mg is better than 10 mg, but 80 mg is no better than 40 mg); and 3) although megastatin reduces both LDL cholesterol levels and cardiovascular risk, none of the benefits of megastatin are related to its effect on LDL cholesterol.
Figure 3. A hypothetical example of the limitations of dose-titration studies and the importance of controlling for treatment exposure when examining the benefits of reaching treatment targets.  *In this hypothetical example, megastatin reduces both cardiovascular (CV) risk and levels of low-density lipoprotein (LDL) cholesterol, but reduction of the latter is not related to megastatin's benefits. The maximum relative risk reduction (RRR) for CV events is achieved with 40 mg of megastatin, and maximum reduction in LDL cholesterol levels is achieved with 80 mg of megastatin. All results can be calculated from the assumptions in section A or can be obtained from the first author by request. † The adjusted observational (cohort) analysis controls for dose of megastatin and finds that reaching the LDL cholesterol goal is not an independent predictor of degree of CV risk reduction. To convert LDL cholesterol values to mmol/L, multiply by 0.02586.
Figure 3. A hypothetical example of the limitations of dose-titration studies and the importance of controlling for treatment exposure when examining the benefits of reaching treatment targets.
*In this hypothetical example, megastatin reduces both cardiovascular (CV) risk and levels of low-density lipoprotein (LDL) cholesterol, but reduction of the latter is not related to megastatin's benefits. The maximum relative risk reduction (RRR) for CV events is achieved with 40 mg of megastatin, and maximum reduction in LDL cholesterol levels is achieved with 80 mg of megastatin. All results can be calculated from the assumptions in section A or can be obtained from the first author by request. † The adjusted observational (cohort) analysis controls for dose of megastatin and finds that reaching the LDL cholesterol goal is not an independent predictor of degree of CV risk reduction. To convert LDL cholesterol values to mmol/L, multiply by 0.02586.
Figure 3 shows how an unsophisticated interpretation of this dose-titration experiment could lead one to mistakenly conclude that achieving an LDL cholesterol goal less than 1.81 mmol/L (<70 mg/dL) is beneficial. When compared with placebo, the “titrate to goal” study group received considerably greater benefit than the group receiving 10 mg of megastatin (relative risk reduction, 45% vs. 25%, respectively). Furthermore, a cohort analysis that does not control for megastatin dose would seem to support this conclusion, because this uncontrolled analysis will find that those who achieve an LDL cholesterol level less than 1.81 mmol/L (<70 mg/dL) benefit much more than those who do not. However, Figure 3 also demonstrates that when multivariable analysis is used to control for statin doses, LDL cholesterol level is not independently associated with cardiovascular risk reduction. In addition, such an analysis indicates that the optimal clinical strategy is to ignore LDL cholesterol levels completely and simply give all patients 40 mg of megastatin.
Although none of the cohort studies found in our literature review controlled for treatment exposure, some controlled for arm of randomization (31, 32). This may seem adequate (or even preferable), but it is not. In an experimental analysis, researchers should focus on arm of randomization (intention-to-treat analysis). However, in a cohort analysis, where mechanism of action rather than drug efficacy is being studied, researchers need to focus on actual exposure, such as treatment received and pill adherence, to examine which of the factors that the treatment affects, such as LDL cholesterol or C-reactive protein levels, are independently related to lower risk for outcomes. This is particularly important because in statin trials, up to 15% to 20% of those randomly assigned to statins do not continue to receive treatment and up to 20% to 30% of those randomly assigned to placebo cross over to statin therapy (13).
In summary, unless a cohort study adequately controls for degree of exposure to treatment, it should not be considered evidence of the importance of achieving a treatment goal. Even in a dose-titration trial, a properly conducted cohort analysis may be necessary to examine whether the benefits achieved in the study are more strongly associated with achieving the treatment goal or whether achieving the goal is a marker for receiving more medication.

The “Healthy Volunteer” Effect Can Severely Bias Studies Evaluating Treatment Targets

Even after controlling for a host of confounders, rigorous cohort studies consistently found that postmenopausal hormone replacement therapy (HRT) was an independent predictor of better cardiovascular outcomes (33). When clinical trials demonstrated that HRT actually increases cardiovascular risk (25, 26), much of the medical world was shocked, but it should not have been. It has long been known that improved adherence to treatment (even to a placebo treatment) can be a strong independent predictor of better cardiovascular outcomes (34–36). Noting this finding, Barrett-Connor (37) pointed out that many women declined HRT even when it was recommended by their physicians and that many women stopped taking HRT in the first year of treatment. Therefore, those who were taking HRT over the long term were a highly selected group, and the improved cardiovascular outcomes could be due to a healthy volunteer bias (that is, those who were receiving long-term HRT were a particularly health-conscious group) (37). When consistent findings from rigorous cohort analyses have later been proved incorrect, high levels of selection, such as self-selection (healthy volunteer bias) or provider selection (referral or transfer bias), have usually been involved (38–42). There are many similar examples in the epidemiologic literature, such as better outcomes for patients with higher intake of β-carotene (clinical trials found that supplements are harmful) or better outcomes for patients with higher vitamin E serum levels (clinical trials have found no benefit of supplements) (38–41).
Counterintuitively, the healthy volunteer bias can be particularly problematic when we use clinical trial data to conduct cohort analyses (30). For example, in a randomized trial of statin therapy, achieving an LDL cholesterol level less than 1.81 mmol/L (<70 mg/dL) is influenced in part by unbiased assignment to arm of randomization but will largely depend on tolerance to statin therapy (influenced by hardiness, comorbid conditions, and a healthy volunteer effect), level of adherence to the treatment (a healthy volunteer effect), and whether someone in the conventional treatment arm crosses over to statin treatment (a healthy volunteer effect). This presents an additional reason why controlling for treatment exposure, not arm of randomization, is critically important in a cohort analysis (Appendix Table 2) (31, 32). Bias due to selection is perhaps the most major and vexing source of confounding in observational analyses, and more advanced statistical methods, such as instrumental variables or propensity scores, should be used whenever possible to try to better account for selection (43–45). However, we could find no evidence that any of the published cohort studies that used data from statin trials considered drug adherence or drug intolerance.
Appendix Table 2. Key Factors That Influence whether a Participant Reaches a Treatment Target in a Clinical Trial
Appendix Table 2. Key Factors That Influence whether a Participant Reaches a Treatment Target in a Clinical Trial

Ecological Comparisons Are a Very Weak Source of Evidence

Often, arguments for the log-linear LDL hypothesis have been based on ecological comparisons (1, 2, 15). An ecological study (see Glossary) involves comparing differences between groups of individuals (aggregate data), thus ignoring differences between individuals within those groups (for example, noting that clinical trials that achieved greater average change in LDL cholesterol level have also tended to achieve greater relative cardiovascular benefits) (1, 2, 15, 45, 46). The simplicity of presenting aggregate data can have great intuitive appeal, but it is actually an extremely weak source of epidemiologic evidence, having been characterized as “dangerous at best and disastrous at worst” (45, 46). Ecological comparisons have inherent risks related to confounding hidden within the aggregate data (“the ecological fallacy”) and often have so few data points that their sample sizes are insufficient to even allow attempts to control for confounders. Both of these problems are true of the ecological comparisons cited in support of titrating treatment to reach LDL cholesterol levels less than 1.81 mmol/L (<70 mg/dL) (2, 14).
Figure 4 presents a widely quoted ecological comparison based on the average LDL cholesterol values and average outcome rates of 12 groups (5 placebo groups and 7 statin-treated groups taken from 6 clinical trials) (14). On the surface, the top panel of Figure 4 seems to definitively show that achieving very low LDL cholesterol levels is a very strong predictor of the degree of cardiovascular risk. However, these 6 studies differ from each other in many ways, such as time period, country, baseline risk, crossover, and treatment adherence rates. Therefore, drawing a line through the 12 data points plotted against just one of these variables (LDL cholesterol level) can be arbitrary. For example, because cardiovascular outcomes have dramatically improved as a result of therapeutic advances, such as more aggressive use of angiotensin-converting enzyme inhibitors and angiotensin-receptor blockers, it is hard to justify comparing outcome rates in a study conducted from 1988–1994 (4S [Scandinavian Simvastatin Survival Study]) and a study conducted from 1998–2004 (TNT [Treating to New Targets] Study). When each study population is used as its own control (thus controlling for both time period and patient populations), the relationship between LDL cholesterol levels and cardiovascular events changes substantially, becoming less strong and less uniform (Figure 4, bottom). However, with only 12 data points, it is still not possible to control for other potential confounders between these studies, such as differences in treatment exposure (due to drug intolerance and crossover rates) and changes in other potential mechanisms of statin therapy (for example, C-reactive protein level).
Figure 4. Summary of lipid studies.   Top. Event rate assuming a single association between low-density lipoprotein (LDL) cholesterol and outcome. Bottom. The LDL–outcome associations found within each study. 4S= Scandinavian Simvastatin Survival Study; CARE= Cholesterol and Recurrent Events Study; HPS= Heart Protection Study; LIPID= Long-Term Intervention with Pravastatin in Ischaemic Disease Study; TNT= Treating to New Targets Study. To convert LDL cholesterol values to mmol/L, multiply by 0.02586.
Figure 4. Summary of lipid studies.
Top. Event rate assuming a single association between low-density lipoprotein (LDL) cholesterol and outcome. Bottom. The LDL–outcome associations found within each study. 4S= Scandinavian Simvastatin Survival Study; CARE= Cholesterol and Recurrent Events Study; HPS= Heart Protection Study; LIPID= Long-Term Intervention with Pravastatin in Ischaemic Disease Study; TNT= Treating to New Targets Study. To convert LDL cholesterol values to mmol/L, multiply by 0.02586.
In contrast with these ecological comparisons, the use of individual-level data and modern multilevel modeling techniques would allow one to simultaneously analyze aggregate and individual-level effects, thus producing rigorous cohort analyses that eliminate many of the gross errors that are so common in ecological analyses (47). Finally, simply because a test is associated with better outcomes on average does not mean that the measure is sufficiently accurate to be useful in clinical practice. Patient-level analyses are needed to support patient-level recommendations (45).

Framing Treatment Goals as False Dichotomies

Finally, we did not find a single cohort analysis that tried to examine a more continuous relationship between LDL cholesterol levels and outcome rates. Although it may seem appropriate to think of treatment goals as dichotomies to be congruent with the dichotomous nature of clinical treatment decisions (intervene vs. do not intervene), such dichotomies can be misleading. The degree of absolute benefit is the difference between risks if untreated versus risks if treated and therefore always exists along a continuum that varies according to patients' individual circumstances and what treatment is being used to achieve the proposed goal (22, 30, 48). Therefore, analyses that relate benefits of a continuous risk factor (such as LDL cholesterol level or blood pressure) by measuring “treatment goal achieved” versus “treatment goal not achieved” are usually highly misleading. This is because those who do not achieve the treatment goal can represent a very heterogeneous group: those with small, moderate, and extreme deviations from the recommended goal (22). In medicine, modest deviations from “ideal” levels (for example, a hemoglobin A1c level of 7.5% vs. a goal of <7% or a sodium level of 132 mmol/L vs. a goal of 135 to 145 mmol/L) often result in trivial risk. Marked deviations from treatment targets, however, are often associated with dramatic and often logarithmic increases in risk (22, 30, 49–52). In fact, a recent report from the Framingham Heart Study suggested that this is true for a variety of cardiovascular risk factors, including cholesterol levels (49). If the only comparison made is between those who reach the strict goal and all others, we can mistakenly think that not achieving the treatment goal results in moderate risk when almost all of the risk is caused by more substantial deviations from the goal.
The articles we reviewed often advocated for tight LDL cholesterol goals without discussing possible risks, patient burden, and societal costs associated with the treatments needed to reach those goals. This is particularly important because achieving moderate clinical control is often easy whereas achieving the ideal goal often requires substantial costs and patient burden, such as polypharmacy. Many treatments also carry at least some risk for harm. Therefore, failure to recognize this phenomenon can result in promoting unsafe treatment recommendations for those with small to moderate deviations from the proposed treatment goal (22).

Discussion

In this review, we found no high-quality clinical evidence to support currently proposed treatment goals for LDL cholesterol. However, we conclude that there are no intrinsic barriers to producing such evidence. For example, a large clinical trial like the HPS provides excellent statistical power for a cohort analysis to assess the LDL hypothesis at low LDL cholesterol levels. This cohort analysis would control for pre-event values of known cardiovascular risk factors, treatment status (placebo vs. statin, assessing interactions with deviations from arm of randomization), and pill adherence (Figure 5). To measure adherence, pill counts or pharmacy data are preferred; however, at a minimum, collecting information by patient self-report is always feasible and can be done inexpensively and easily (53).
Figure 5. Diagram of a cohort study assessing whether lipid lowering is an independent predictor for the degree of benefit derived from statin therapy.  Experiments (top) generally assess interventions but can rarely directly assess their mechanisms of action. Cohort analyses (bottom) can provide evidence for or against proposed mechanisms of action by examining whether a marker for the proposed mechanism of action (i.e., low-density lipoprotein [LDL] cholesterol level) is an independent predictor of lower risk after controlling for treatment exposure, adherence, and other known risk factors for the outcome being studied. CV= cardiovascular.
Figure 5. Diagram of a cohort study assessing whether lipid lowering is an independent predictor for the degree of benefit derived from statin therapy.
Experiments (top) generally assess interventions but can rarely directly assess their mechanisms of action. Cohort analyses (bottom) can provide evidence for or against proposed mechanisms of action by examining whether a marker for the proposed mechanism of action (i.e., low-density lipoprotein [LDL] cholesterol level) is an independent predictor of lower risk after controlling for treatment exposure, adherence, and other known risk factors for the outcome being studied. CV= cardiovascular.
Although conducting cohort analyses as discussed here would produce much stronger evidence regarding the hypothesized LDL log-linear relation at LDL cholesterol levels less than 3.36 mmol/L (<130 mg/dL), such evidence will still have important limitations. Any observational analysis can be incorrect because of unknown confounding, even if it controls for treatment exposure and adherence. As we and others have pointed out previously, however, clinical trials have their own limitations for adequately informing clinical practice, and never considering observational evidence is not a viable option (29, 30, 54). For example, if researchers refuse to consider high-quality observational evidence, some outlandish conclusions could result (54). No clinical trials support the benefits of cervical cancer screening, show that aspirin therapy causes Reyes syndrome in children, or prove that improved hemoglobin A1c levels reduce long-term serious morbidity in type 2 diabetes. However, strong, persuasive observational evidence supports each of these conclusions. What we must not do is fall into the trap of dismissing high-quality observational evidence when it runs counter to our hypotheses and accept poor-quality evidence (such as ecological comparisons and cohort analyses that do not control for likely confounders) when it supports our favored position.
To be clear, we think valid cohort studies have a strong likelihood of showing that LDL cholesterol levels are a good marker of statins' benefits. Our point is not that there is strong evidence against the current recommendations; it is that there is no valid clinical evidence to suggest that using treatments other than statins to pursue proposed LDL cholesterol goals is safe or effective. Even with regard to statin therapy for patients at high cardiovascular risk, a strong argument can be made that the current evidence supports ignoring LDL cholesterol altogether and titrating to high doses of statins as tolerated, especially given the potential complexities of LDL subparticles and interactions (3, 7–11, 21). Finally, even if more valid future cohort analyses demonstrate that LDL cholesterol level is a substantial independent marker for patient benefit, it may still be preferable to suggest that large clinical trials should be conducted using multidrug lipid therapy instead of assuming that multidrug therapy is safe without such large-scale clinical testing.
We conclude that there is clear and compelling evidence that most patients at high risk for cardiovascular disease should be taking at least a moderate dose of a statin if tolerated, even if their natural LDL cholesterol level is low. We could find no published high-quality clinical evidence supporting titration of lipid therapy based on proposed LDL cholesterol targets. However, the errors in previous examinations of this issue appear to be avoidable. We strongly suggest that those with access to these data conduct further analyses to provide more valid evidence on this important clinical and scientific question.

Appendix: List of Experts in Cardiovascular Disease and Research

These experts were contacted and were asked to identify any published experimental, cohort, or case–control study that examined the independent relationship between LDL cholesterol and major cardiovascular outcomes for participants with LDL cholesterol levels less than 3.36 mmol/L (<130 mg/dL): Jane Armitage, Oxford University, Oxford, United Kingdom; Elizabeth Barrett-Connor, University of California, San Diego, San Diego, California; Robert Brook, Harvard University, Cambridge, Massachusetts; Christopher Cannon, Harvard University, Cambridge, Massachusetts; Jean-Charles Fruchart, Institut Pasteur de Lille, Lille, France; Paul Durrington, University of Manchester, Manchester, United Kingdom; Kim Eagle, University of Michigan, Ann Arbor, Michigan; Heiner Greten, Universität-Krankenhaus Eppendorf, Hamburg, Germany; Scott Grundy, University of Texas Southwestern, Dallas, Texas; Steven Haffner, University of Texas, San Antonio, Texas; Donald B. Hunninghake, University of Minnesota, Minneapolis, Minnesota; John J.P. Kastelein, Academic Medical Center of Amsterdam, Amsterdam, the Netherlands; Anthony Keech, University of Sydney, Sydney, Australia; Harlan Krumholz, Yale University, New Haven, Connecticut; John C. LaRosa, Tulane University, New Orleans, Louisiana; Richard Peto, Oxford University, Oxford, United Kingdom; Bertram Pitt, University of Michigan, Ann Arbor, Michigan; Paul Ridker, Harvard University, Cambridge, Massachusetts; Melvin Rubenfire, University of Michigan, Ann Arbor, Michigan; D.L. Sprecher, Cleveland Clinic, Cleveland, Ohio; and Nanette K. Wenger, Emory University, Atlanta, Georgia.

Glossary

Clinical trial: A type of true experiment conducted on humans, usually used to describe studies that evaluate an intervention's impact on clinically important patient outcomes (such as morbidity or mortality). Large clinical trials are the gold standard for evaluating the effectiveness and safety of clinical interventions (grade A evidence). However, experimental analyses of clinical trials are usually unable to provide direct experimental evidence regarding the intervention's mechanism of action. Clinical trial data are often used to conduct cohort analyses, which can often examine whether evidence for or against a treatment target (such as low-density lipoprotein cholesterol) is an independent predictor of patient benefit, but such analyses must control for all potential confounders just like any other observational analysis.
Cohort study: A longitudinal, observational study in which potential risk factors are identified in a group (cohort) of study subjects at baseline and independent associations between these baseline risk factors and future outcomes are assessed by using multivariable regression techniques. Cohort analyses are often conducted using clinical trial data to evaluate study questions that cannot easily be evaluated by the true experiment, such as examining potential mechanisms or markers for the intervention's degree of benefit (or harm).
Ecological study: An observational design that can be either cross-sectional or longitudinal and examines risk factors and outcomes of groups by using aggregate data (such as noting that countries with high-fiber diets have lower rates of colon cancer, or that statin trials with greater average reductions in low-density lipoprotein cholesterol have greater average relative risk reductions). Ecological studies are sometimes useful for hypothesis generation but are generally considered an extremely poor source of evidence for hypothesis testing.
Observational study: A general term used to describe nonexperimental epidemiologic research. With rigorous control for potential confounders, some observational study designs (especially cohort and case–control studies) can produce strong grade B evidence for causal influence (but not grade A evidence). However, some observational designs (such as ecological and cross-sectional designs) are generally considered extremely weak sources of causal evidence.
True experiment: An epidemiologic study design in which subjects are randomly assigned to different treatment arms. When the sample size is sufficiently large (to make clinically important chance differences between the randomized arms very unlikely), true experiments are the gold standard for evaluating whether an intervention results in benefits or harms.

References

1.
Grundy SMCleeman JIMerz CNBrewer HB JrClark LTHunninghake DBet al. Implications of recent clinical trials for the National Cholesterol Education Program Adult Treatment Panel III guidelines. Circulation. 2004;110:227-39. [PMID: 15249516]
2.
Baigent CKeech AKearney PMBlackwell LBuck GPollicino Cet al. Efficacy and safety of cholesterol-lowering treatment: prospective meta-analysis of data from 90, 056 participants in 14 randomised trials of statins. Lancet. 2005;366:1267-78. [PMID: 16214597]
3.
Vijan SHayward RA. Pharmacologic lipid-lowering therapy in type 2 diabetes mellitus: background paper for the American College of Physicians. Ann Intern Med. 2004;140:650-8. [PMID: 15096337]
4.
Snow VAronson MDHornbake ERMottur-Pilson CWeiss KB. Lipid control in the management of type 2 diabetes mellitus: a clinical practice guideline from the American College of Physicians. Ann Intern Med. 2004;140:644-9. [PMID: 15096336]
5.
Law MRWald NJThompson SG. By how much and how quickly does reduction in serum cholesterol concentration lower risk of ischaemic heart disease? BMJ. 1994;308:367-72. [PMID: 8043072]
6.
Law MRWald NJ. An ecological study of serum cholesterol and ischaemic heart disease between 1950 and 1990. Eur J Clin Nutr. 1994;48:305-25. [PMID: 8055847]
7.
Verschuren WMJacobs DRBloemberg BPKromhout DMenotti AAravanis Cet al. Serum total cholesterol and long-term coronary heart disease mortality in different cultures. Twenty-five-year follow-up of the seven countries study. JAMA. 1995;274:131-6. [PMID: 7596000]
8.
Nam BHKannel WBD'Agostino RB. Search for an optimal atherogenic lipid risk profile: from the Framingham Study. Am J Cardiol. 2006;97:372-5. [PMID: 16442398]
9.
Barzi FPatel AWoodward MLawes CMOhkubo TGu Det al. A comparison of lipid variables as predictors of cardiovascular disease in the Asia Pacific region. Ann Epidemiol. 2005;15:405-13. [PMID: 15840555]
10.
Nakaya NKita TMabuchi HMatsuzaki MMatsuzawa YOikawa Set al. Large-scale cohort study on the relationship between serum lipid concentrations and risk of cerebrovascular disease under low-dose simvastatin in Japanese patients with hypercholesterolemia: sub-analysis of the Japan Lipid Intervention Trial (J-LIT). Circ J. 2005;69:1016-21. [PMID: 16127179]
11.
Olsson AGSchwartz GGSzarek MSasiela WJEzekowitz MDGanz Pet al. High-density lipoprotein, but not low-density lipoprotein cholesterol levels influence short-term prognosis after acute coronary syndrome: results from the MIRACL trial. Eur Heart J. 2005;26:890-6. [PMID: 15764620]
12.
Collins RArmitage JParish SSleigh PPeto R. MRC/BHF Heart Protection Study of cholesterol-lowering with simvastatin in 5963 people with diabetes: a randomised placebo-controlled trial. Lancet. 2003;361:2005-16. [PMID: 12814710]
13.
MRC/BHF Heart Protection Study of cholesterol lowering with simvastatin in 20, 536 high-risk individuals: a randomised placebo-controlled trial. Lancet. 2002;360:7-22. [PMID: 12114036]
14.
Cannon CPBraunwald EMcCabe CHRader DJRouleau JLBelder Ret al. Intensive versus moderate lipid lowering with statins after acute coronary syndromes. N Engl J Med. 2004;350:1495-504. [PMID: 15007110]
15.
LaRosa JCGrundy SMWaters DDShear CBarter PFruchart JCet al. Intensive lipid lowering with atorvastatin in patients with stable coronary disease. N Engl J Med. 2005;352:1425-35. [PMID: 15755765]
16.
Pedersen TRFaergeman OKastelein JJOlsson AGTikkanen MJHolme Iet al. High-dose atorvastatin vs usual-dose simvastatin for secondary prevention after myocardial infarction: the IDEAL study: a randomized, controlled trial. JAMA. 2005;294:2437-45. [PMID: 16287954]
17.
Ray KKCannon CPMcCabe CHCairns RTonkin AMSacks FMet al. Early and late benefits of high-dose atorvastatin in patients with acute coronary syndromes: results from the PROVE IT-TIMI 22 trial. J Am Coll Cardiol. 2005;46:1405-10. [PMID: 16226162]
18.
Liao JKLaufs U. Pleiotropic effects of statins. Annu Rev Pharmacol Toxicol. 2005;45:89-118. [PMID: 15822172]
19.
Van de Wiel ACaillard CA. Statins and the stroke-cholesterol paradox. Neth J Med. 2002;60:4-9. [PMID: 12074043]
20.
Wanner CKrane VMarz WOlschewski MMann JFRuf Get al. Atorvastatin in patients with type 2 diabetes mellitus undergoing hemodialysis. N Engl J Med. 2005;353:238-48. [PMID: 16034009]
21.
Shepherd J. Resource management in prevention of coronary heart disease: optimising prescription of lipid-lowering drugs. Lancet. 2002;359:2271-3. [PMID: 12103306]
22.
Hayward RAKent DMVijan SHofer TP. Reporting clinical trial results to inform providers, payers, and consumers. Health Aff (Millwood). 2005;24:1571-81. [PMID: 16284031]
23.
Colley CALucas LM. Polypharmacy: the cure becomes the disease. J Gen Intern Med. 1993;8:278-83. [PMID: 8505690]
24.
Nissen SEWolski KTopol EJ. Effect of muraglitazar on death and major adverse cardiovascular events in patients with type 2 diabetes mellitus. JAMA. 2005;294:2581-6. [PMID: 16239637]
25.
Rossouw JEAnderson GLPrentice RLLaCroix AZKooperberg CStefanick MLet al. Risks and benefits of estrogen plus progestin in healthy postmenopausal women: principal results From the Women's Health Initiative randomized, controlled trial. JAMA. 2002;288:321-33. [PMID: 12117397]
26.
Hulley SGrady DBush TFurberg CHerrington DRiggs Bet al. Randomized trial of estrogen plus progestin for secondary prevention of coronary heart disease in postmenopausal women. Heart and Estrogen/progestin Replacement Study (HERS) Research Group. JAMA. 1998;280:605-13. [PMID: 9718051]
27.
The Cochrane Library. Accessed at www3.interscience.wiley.com/cgi-bin/mrwhome/106568753/HOME?CRETRY=1&SRETRY=0 on 29 December 2005. doi: 106568753/HOME
28.
Sackett DLStrauss SERichardson WSRosenberg WHaynes RB. Evidence-Based Medicine: How to Practice and Teach EBM. London: Churchill Livingstone; 2000.
29.
Concato JShah NHorwitz RI. Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med. 2000;342:1887-92. [PMID: 10861325]
30.
Vijan SKent DMHayward RA. Are randomized, controlled trials sufficient evidence to guide clinical practice in type II (non–insulin-dependent) diabetes mellitus? Diabetologia. 2000;43:125-30. [PMID: 10672454]
31.
Ridker PMCannon CPMorrow DRifai NRose LMMcCabe CHet al. C-reactive protein levels and outcomes after statin therapy. N Engl J Med. 2005;352:20-8. [PMID: 15635109]
32.
Nissen SETuzcu EMSchoenhagen PCrowe TSasiela WJTsai Jet al. Statin therapy, LDL cholesterol, C-reactive protein, and coronary artery disease. N Engl J Med. 2005;352:29-38. [PMID: 15635110]
33.
Grady DRubin SMPetitti DBFox CSBlack DEttinger Bet al. Hormone therapy to prevent disease and prolong life in postmenopausal women. Ann Intern Med. 1992;117:1016-37. [PMID: 1443971]
34.
Horwitz RIHorwitz SM. Adherence to treatment and health outcomes. Arch Intern Med. 1993;153:1863-8. [PMID: 8250647]
35.
Granger BBSwedberg KEkman IGranger CBOlofsson BMcMurray JJet al. Adherence to candesartan and placebo and outcomes in chronic heart failure in the CHARM programme: double-blind, randomised, controlled clinical trial. Lancet. 2005;366:2005-11. [PMID: 16338449]
36.
Influence of adherence to treatment and response of cholesterol on mortality in the coronary drug project. N Engl J Med. 1980;303:1038-41. [PMID: 6999345]
37.
Barrett-Connor E. Postmenopausal estrogen and prevention bias. Ann Intern Med. 1991;115:455-6. [PMID: 1872493]
38.
Omenn GSGoodman GEThornquist MDBalmes JCullen MRGlass Aet al. Effects of a combination of beta carotene and vitamin A on lung cancer and cardiovascular disease. N Engl J Med. 1996;334:1150-5. [PMID: 8602180]
39.
Omenn GSGoodman GEThornquist MDBalmes JCullen MRGlass Aet al. Risk factors for lung cancer and for intervention effects in CARET, the Beta-Carotene and Retinol Efficacy Trial. J Natl Cancer Inst. 1996;88:1550-9. [PMID: 8901853]
40.
Lee IMCook NRGaziano JMGordon DRidker PMManson JEet al. Vitamin E in the primary prevention of cardiovascular disease and cancer: the Women's Health Study: a randomized, controlled trial. JAMA. 2005;294:56-65. [PMID: 15998891]
41.
Tornwall MEVirtamo JKorhonen PAVirtanen MJTaylor PRAlbanes Det al. Effect of alpha-tocopherol and beta-carotene supplementation on coronary heart disease during the 6-year post-trial follow-up in the ATBC study. Eur Heart J. 2004;25:1171-8. [PMID: 15231376]
42.
Rosenberg ALHofer TPStrachan CWatts CMHayward RA. Accepting critically ill transfer patients: adverse effect on a referral center's outcome and benchmark measures. Ann Intern Med. 2003;138:882-90. [PMID: 12779298]
43.
Newhouse JPMcClellan M. Econometrics in outcomes research: the use of instrumental variables. Annu Rev Public Health. 1998;19:17-34. [PMID: 9611610]
44.
Chan PSHayward RA. Mortality reduction by implantable cardioverter-defibrillators in high-risk patients with heart failure, ischemic heart disease, and new-onset ventricular arrhythmia: an effectiveness study. J Am Coll Cardiol. 2005;45:1474-81. [PMID: 15862422]
45.
Aitkin MALongford N. Statistical modeling issues in school effectiveness studies. Journal of the Royal Statistical Society. 1986;149:1-43.
46.
Robinson WS. Ecological correlations and the behavior of individuals. Am Sociol Rev. 1950;15:351-7.
47.
Snijders TABosker RJ. Multilevel Analysis. London: Sage; 1999.
48.
Rothwell PM. Treating individuals 2. Subgroup analysis in randomised controlled trials: importance, indications, and interpretation. Lancet. 2005;365:176-86. [PMID: 15639301]
49.
Vasan RSSullivan LMWilson PWSempos CTSundstrom JKannel WBet al. Relative importance of borderline and elevated levels of coronary heart disease risk factors. Ann Intern Med. 2005;142:393-402. [PMID: 15767617]
50.
Kent DMHayward RAGriffith JLVijan SBeshansky JRCaliff RMet al. An independently derived and validated predictive model for selecting patients with myocardial infarction who are likely to benefit from tissue plasminogen activator compared with streptokinase. Am J Med. 2002;113:104-11. [PMID: 12133748]
51.
Vijan SHofer TPHayward RA. Estimated benefits of glycemic control in microvascular complications in type 2 diabetes. Ann Intern Med. 1997;127:788-95. [PMID: 9382399]
52.
Kravitz RLDuan NBraslow J. Evidence-based medicine, heterogeneity of treatment effects, and the trouble with averages. Milbank Q. 2004;82:661-87. [PMID: 15595946]
53.
Heisler MSmith DMHayward RAKrein SLKerr EA. How well do patients' assessments of their diabetes self-management correlate with actual glycemic control and receipt of recommended diabetes services? Diabetes Care. 2003;26:738-43. [PMID: 12610031]
54.
Smith GCPell JP. Parachute use to prevent death and major trauma related to gravitational challenge: systematic review of randomised controlled trials. BMJ. 2003;327:1459-61. [PMID: 14684649]

Comments

0 Comments
Sign In to Submit A Comment
Manfred Gogol 11 October 2006
Statins and quality of research

TO THE EDITOR: The review of Hayward et al. (1) is nice to read and lead "“ I hope so "“ the view of clinicians and researchers to a lot of problems in now published research. But also this paper neglected two key problems. First, the limited representation of study populations "“ usual white men in the sixties "“ and the missing of representative proportions of women, elderly and ethnicity minorities (2,3). This, together with the almost "“ sometimes overwhelming "“ generalizing conclusions and recommendations without recognizing this limitations and the missing critical discussion about the limitations of a study and the results led to lots of doubt. Second, the point of the role of study sponsor and the interaction of the physician-industrial relationship (4,5) is usual not enough recognized, also in the accompanying editorials (6,7). For both points the now published secondary analysis of the Treatment to New Target trial is a good example (8,9). Overall, evidence-based medicine (EBM) stands at the crossroads. If EBM will be recognised as a serious and truthfull tool in future its necessary to take account for a better quality of studies and publishing.

1. Hayward RA, Hofer TP, Vijan S. Narrative review: Lack of evidence for recommended low-density lipoprotein treatment targets. Ann Intern Med 2006;145:520-30.

2. Birch LM "“ Unanswered questions: The use of statins in older people to prevent cardiovascular event effects of statins on risk of coronary disease: A meta-analysis of randomized controlled trials. J Am Ger Soc 2002;50:391-93.

3. Bartlett C, Davey P, Dieppe P, et al. "“ Women, older persons, and ethnic minorities: factors associated with their inclusion in randomised trials of statin 1990 to 2001. Heart 2003;89:327-28.

4. Bhandari M, Busse JW, Jackowski D, et al. Association between industry funding and statistically significant pro-industry findings in medical and surgical randomized trials. CMAJ 2004;170:477-80.

5. Lexchin J, Bero LA, Djulbegovic B, et al. Pharmaceutical industry sponsorship and research outcome and quality: a systematic review. BMJ 2003;326:1167-70.

6. LaRosa JC, Grundy SM, Waters DD, et al. Intensive lipid lowering with Atorvastatin in patients with stable coronary disease. N Engl J Med 2005;352:1425-35.

7. Pitt B. Low-density lipoprotein cholesterol in patients with stable coronary heart disease "“ is it time to shift our goals? N Engl J Med 2005;352:1483-4.

8. Deedwania P, Barter P, Carmena R, et al. Reduction of low-density lipoprotein cholesterol in patients with coronary heart disease and metabolic syndrome: analysis of the Treating to New Targets study. Lancet 2006;368:919-28.

9. Gogol M. TNT study. Lancet 2006; http://www.thelancet.com/journals/lancet/article/PIIS0140673606692921/comments?action=view&totalComments=1

Conflict of Interest:

None declared

Uffe Ravnskov 17 October 2006
Lowest possible statin dose better than a low LDL cholesterol

Hayward and coworkers rightly point to the extreme weakness of ecological comparisons between statin trials (1). Their concern is justified by the lack of dose-response between degree of cholesterol lowering and clinical (2,3) or angiographic (4) outcome found in the trials where dose-response was calculated using individual data. That those with the worst prerandomization LDL response received the same benefit as those with the best one strongly indicate that most if not all benefits from the statins are mediated through their pleiotropic effects, not through cholesterol lowering. But even if cholesterol lowering is unimportant we should have expected dose-response because both cholesterol lowering and the pleiotropic effects are due to the same drug. The lack of dose-response suggests that high LDL cholesterol may have a protective effect and thus counteracts the expected (but false) dose-response in accordance with the findings. Indeed, numerous observations and experiments have shown that cholesterol, or rather the LDL molecule itself, protects against infections, probably by binding and inactivating bacterial endotoxin (5). In accordance, many cohort studies have shown that high cholesterol is not a risk factor for old people and that old people with high cholesterol live longer than old people with low cholesterol (5). As statin treatment is aimed for the rest of the patient´s life it would therefore be more relevant to find the lowest effective statin dose rather than to titrate to an arbitrarily determined unnecessarily low LDL level. 

1.      Hayward RA, Hofer TP,  Vijan S.Narrative Review: Lack of Evidence for Recommended Low-Density Lipoprotein Treatment Targets: A Solvable Problem. Ann Intern Med. 2006; 145: 520-30 [Abstract] [Full text] [PDF]

2.      Sacks FM, Moye LA, Davis BR, Cole TG, Rouleau JL, Nash DT et al. Relationship between plasma LDL concentrations during treatment with pravastatin and recurrent coronary events in the cholesterol and recurrent events trial. Circulation. 1998; 97:1446"“52.[Abstract/Free Full Text]

3.      Schwartz GG, Olsson AG, Ezekowitz MD, Ganz P, Oliver MF, Waters D et al. Myocardial Ischemia Reduction with Aggressive Cholesterol Lowering (MIRACL) Study Investigators. Effects of atorvastatin on early recurrent ischemic events in acute coronary syndromes: the MIRACL study: a randomized controlled trial. JAMA. 2001; 285:1711"“18. [Abstract]

4.      Ravnskov U. Is atherosclerosis caused by high cholesterol? QJM. 2002; 95: 397-403 [Abstract/FreeFull Text] [PDF]

5.      Ravnskov U. High cholesterol may protect against infections and atherosclerosis. QJM. 2003;96:927-34. [Abstract/Free Full Text] [PDF]

 

Conflict of Interest:

None declared

Paul J Rosch 18 October 2006
Why Current Guidelines For Statin Therapy Should Be Revised Immediately

As indicated, there is no evidence that increasing statin dosage to achieve arbitrarily selected low LDL levels is either salubrious or safe. (1) The observation that any cardioprotective rewards are similar regardless of LDL cholesterol concentrations (2) and the rapidity of clinical improvement with statins in acute coronary syndromes (3) suggests that any such benefits are not due to lipid lowering but reduction of inflammation or other pleiotrophic effects. Support comes from one study showing that the incidence of recurrent myocardial infarction or coronary mortality was lower for patients in whom statin therapy resulted in CRP levels < 2 mg/l regardless of the level of LDL cholesterol achieved. (4) The proposal that the lower the LDL the better as well as current guidelines for statin therapy that mandate lowering LDL to a goal that is often difficult to attain will only result in higher and higher doses that provide no benefit but will significantly increase serious side effects. As with aspirin, the statin dosage required to reduce inflammation may be much lower than that commonly used for other indications. In view of the millions of healthy people taking statins because of an elevated cholesterol or LDL, current treatment guidelines and objectives should be revised as soon as possible.

1. Hayward RA, Hofer TP, Vijan S. Narrative Review: Lack of Evidence for Recommended Low-Density Lipoprotein Treatment Targets: A Solvable Problem. Ann Intern Med. 2006; 145: 520-30.

2. Sacks FM, Moye LA, Davis BR, Cole TG, Rouleau JL, Nash DT et al. Relationship between plasma LDL concentrations during treatment with pravastatin and recurrent coronary events in the cholesterol and recurrent events trial. Circulation. 1998; 97:1446"“52.

3. Schwartz GG, Olsson AG, Ezekowitz MD, Ganz P, Oliver MF, Waters D et al. Myocardial Ischemia Reduction with Aggressive Cholesterol Lowering (MIRACL) Study Investigators. Effects of atorvastatin on early recurrent ischemic events in acute coronary syndromes: the MIRACL study: a randomized controlled trial. JAMA. 2001; 285:1711"“18.

4. Ridker PM, Cannon CP, Morrow D, et al. C-reactive protein levels and outcomes after statin therapy. N Engl J Med. 2005; 352:20-8.

Conflict of Interest:

None declared

Attilio Rigotti 19 October 2006
Positive evidence for further lowering of LDL cholesterol?

We read with much interest the review article of Hayward et al. on the currently available evidence for recommending low LDL cholesterol treatment goals (1). We agree with the authors that there are no well-designed clinical studies demonstrating unequivocally that titration of cholesterol-lowering therapy to achieve lower LDL cholesterol targets is indeed the leading beneficial mechanism of statins on atherosclerotic cardiovascular disease. As an important caveat against the recommendation that "lower LDL cholesterol is better", authors propose that previous studies have not considered alternative hypothesis as confounding factors, including treatment exposure (what type and and dose of statin was used in low-dose vs. high-dose statin comparisons) (2).

However, a post-hoc analysis of the PROVE-IT trial (2,3) somewhat addressed this latter criticism. Wiviott et al. examined the clinical benefit and safety of patients obtaining very low levels of cholesterol within the intensive statin treatment group (3). This approach avoided potential confounding effects of the interaction between LDL cholesterol levels achieved and the specific statin and dosing to which patients were randomized. When the primary end point of the trial (death, myocardial infarction, stroke, revascularization and unstable angina requiring hospitalization) was examined, there was a trend to better clinical outcomes in the groups achieving lower LDL levels, even after adjustments for age, gender, baseline calculated LDL cholesterol, diabetes, and prior myocardial infarction. Even though the findings of this postrandomization analysis were based on observational cohort data, they are consistent with the hypothesis that reaching lower LDL cholesterol targets can improve clinical events independent of statin type and dosing.

We hope that further properly designed and conducted studies will more unambiguously address this clinically and scientifically relevant issue.

Attilio Rigotti, MD, and Antonio Arteaga, MD, Escuela de Medicina, Pontificia Universidad Católica, Santiago, Chile,

REFERENCES 1. Hayward RA, Hofer TP, Vijan S. Lack of evidence for recommended low- density lipoprotein treatment targets: a solvable problem. Ann Intern Med. 2006; 145: 520-530

2. Cannon CP, Braunwald E, McCabe CH, Rader DJ, Rouleau JL, Belder R, Joyal SV, Hill KA, Pfeffer MA, Skene AM; Pravastatin or Atorvastatin Evaluation and Infection Therapy-Thrombolysis in Myocardial Infarction 22 Investigators. Intensive versus moderate lipid lowering with statins after acute coronary syndromes. N Engl J Med. 2004; 350:1495-1504

3. Wiviott SD, Cannon CP, Morrow DA, Ray KK, Pfeffer MA, Braunwald E; PROVE IT-TIMI 22 Investigators. Can low-density lipoprotein be too low? The safety and efficacy of achieving very low low-density lipoprotein with intensive statin therapy: a PROVE IT-TIMI 22 substudy. J Am Coll Cardiol. 2005; 46:1411-1416

Conflict of Interest:

None declared

Kenneth A Hoekstra 7 November 2006
The other benefits of statins

The recent review article by Hayward et al. highlight the importance of continued statin therapy in patients at high risk for cardiovascular disease (1). To further emphasize the importance of statin therapy outside of lowering serum LDL levels in hypercholesterolemic patients, Minami et al. (2) have shown that elevated cholesterol levels themselves are involved in the regulation of blood pressure, and following a course ofcholesterol-lowering therapy lipid levels normalized and patients were normotensive (3). Furthermore, support for 'aggressive' statin therapy lies well beyond lower LDL levels as heart failure events are reported to be lower (4), and psychological stress levels may be decreased (3, 5).

1.Hayward RA, Hofer TP, Vijan S.Narrative review: lack of evidence for recommended low-density lipoprotein treatment targets: a solvable problem. Ann Intern Med. 2006 Oct 3;145(7):520-30.

2. Minami M, Atarashi K, Ishiyama A, Hirata Y, Goto A, Omata M. Pressor hyperreactivity to mental and hand-grip stresses in patients with hypercholesterolemia. J Hypertens. 1999 Feb;17(2):185-92.

3. Minami M, Atarashi K, Ishiyama A, Hirata Y, Goto A, Omata M. Effects of cholesterol-lowering therapy on pressor hyperreactivity to stress in hypercholesterolemic patients.Hypertens Res. 2003 Apr;26(4):273- 80.

4. Go AS, Lee WY, Yang J, Lo JC, Gurwitz JH. Statin therapy and risks for death and hospitalization in chronic heart failure. JAMA. 2006 Nov 1;296(17):2105-11.

5. Sebregts EH, Falger PR, Bar FW, Kester AD, Appels A. Cholesterol changes in coronary patients after a short behavior modification program. Int J Behav Med. 2003;10(4):315-30.

Conflict of Interest:

None declared

Geoffrey A. Modest 7 November 2006
LDL Treatment Goals

Although the Narrative Review on LDL Treatment Targets (1) raises several important issues, one glaring ommision in the relevant studies is that HDL values are not incorporated into the model. Many clinical studies have found that the relationship between LDL and HDL is more predictive of cardiac events than LDL alone (2). There are impressive data that HDL is cardioprotective through several mechanisms, including its role in reverse transport of LDL as well as its role through transporting antioxidants to LDL, making the LDL less susceptible to oxidation and presumably less atherogenic. In addition HDL decreases blood viscosity, improves endothelial dysfunction (it is nitric oxide-promoting), stabilizes prostacyclin, inhibits platelets, inhibits adhesion molecule expression, and blocks matrix metalloproteinase expression (3). It might well be that a patient with coronary artery disease whose LDL is brought down to 100 mg/dl but has an HDL of 55 mg/dl might have a lower likelihood of another cardiac event than one with an LDL of less than 70 mg/dl but an HDL of 35 mg/dl. This information is extremely important clinically and may dictate a more rational use of lipid-lowering agents. Some data may be gleaned from further analysis of previous studies which have reported LDL goals only and should be evaluated prospectively in future studies.

References:

1.Hayward RA, Hofer TP, Vigan S. Narrative review: Lack of evidence for recommended low-density lipoprotein treatment targets: a solvable problem. Ann Intern Med 2006; 145: 520-30.

2.Kinosian B, Glick H, Garland G: Cholesterol and coronary heart disease: predicting risks by levels and ratios. Ann Intern Med 1994; 121: 641-647.

3.Brewer HB, Jr. Increasing HDL cholesterol levels. N Engl J Med 2004; 350: 1491-4.

Conflict of Interest:

None declared

Information & Authors

Information

Published In

cover image Annals of Internal Medicine
Annals of Internal Medicine
Volume 145Number 73 October 2006
Pages: 520 - 530

History

Published online: 3 October 2006
Published in issue: 3 October 2006

Keywords

Authors

Affiliations

Rodney A. Hayward, MD
From the Department of Veterans Affairs, VA Center for Practice Management and Outcomes Research, VA Ann Arbor Healthcare System, and University of Michigan Schools of Medicine and Public Health, Ann Arbor, Michigan.
Timothy P. Hofer, MD, MSc
From the Department of Veterans Affairs, VA Center for Practice Management and Outcomes Research, VA Ann Arbor Healthcare System, and University of Michigan Schools of Medicine and Public Health, Ann Arbor, Michigan.
Sandeep Vijan, MD, MSc
From the Department of Veterans Affairs, VA Center for Practice Management and Outcomes Research, VA Ann Arbor Healthcare System, and University of Michigan Schools of Medicine and Public Health, Ann Arbor, Michigan.
Acknowledgments: The authors thank Robert Chang, MD, for assistance with the literature review and David Kent, MD, MSc, for reviewing an earlier draft of this manuscript.
Grant Support: By the VA Health Services Research and Development Service's Quality Enhancement Research Initiative (QUERI DIB 98-001) and by the National Institute of Diabetes and Digestive and Kidney Diseases, National Institutes of Health (P60 DK-20572).
Disclosures: None disclosed.
Corresponding Author: Rodney A. Hayward, MD, VA Center for Practice Management and Outcomes Research, P.O. Box 130170, Ann Arbor, MI 48113-0170; e-mail, [email protected].
Current Author Addresses: Drs. Hayward, Hofer, and Vijan: VA Center for Practice Management and Outcomes Research, P.O. Box 130170, Ann Arbor, MI 48113-0170.

Metrics & Citations

Metrics

Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. For an editable text file, please select Medlars format which will download as a .txt file. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format





Download article citation data for:
Rodney A. Hayward, Timothy P. Hofer, Sandeep Vijan. Narrative Review: Lack of Evidence for Recommended Low-Density Lipoprotein Treatment Targets: A Solvable Problem. Ann Intern Med.2006;145:520-530. [Epub 3 October 2006]. doi:10.7326/0003-4819-145-7-200610030-00010

View More

Login Options:
Purchase

You will be redirected to acponline.org to sign-in to Annals to complete your purchase.

Access to EPUBs and PDFs for FREE Annals content requires users to be registered and logged in. A subscription is not required. You can create a free account below or from the following link. You will be redirected to acponline.org to create an account that will provide access to Annals. If you are accessing the Free Annals content via your institution's access, registration is not required.

Create your Free Account

You will be redirected to acponline.org to create an account that will provide access to Annals.

Figures

Tables

Media

Share

Share

Copy the content Link

Share on social media