Home | About | Journals | Submit | Contact Us | Français |

**|**BMC Med Res Methodol**|**v.12; 2012**|**PMC3305608

Formats

Article sections

- Abstract
- Background
- Methods
- Results
- Discussion
- Conclusion
- Abbreviations
- Competing interests
- Authors' contributions
- Pre-publication history
- References

Authors

Related links

BMC Med Res Methodol. 2012; 12: 14.

Published online 2012 February 15. doi: 10.1186/1471-2288-12-14

PMCID: PMC3305608

Fredi A Diaz-Quijano: moc.nsm@qzaiderf

Received 2011 August 1; Accepted 2012 February 15.

Copyright ©2012 Diaz-Quijano; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

This article has been cited by other articles in PMC.

Odds ratios (OR) significantly overestimate associations between risk factors and common outcomes. The estimation of relative risks (RR) or prevalence ratios (PR) has represented a statistical challenge in multivariate analysis and, furthermore, some researchers do not have access to the available methods. Objective: To propose and evaluate a new method for estimating RR and PR by logistic regression.

A provisional database was designed in which events were duplicated but identified as non-events. After, a logistic regression was performed and effect measures were calculated, which were considered RR estimations. This method was compared with binomial regression, Cox regression with robust variance and ordinary logistic regression in analyses with three outcomes of different frequencies.

ORs estimated by ordinary logistic regression progressively overestimated RRs as the outcome frequency increased. RRs estimated by Cox regression and the method proposed in this article were similar to those estimated by binomial regression for every outcome. However, confidence intervals were wider with the proposed method.

This simple tool could be useful for calculating the effect of risk factors and the impact of health interventions in developing countries when other statistical strategies are not available.

The odds ratio (OR) is commonly used to assess associations between exposure and outcome and can be estimated by logistic regression, which is widely available in statistics software. OR has been considered an approximation to the prevalence ratio (PR) in cross-sectional studies or the risk ratio (RR, which is mathematically equivalent to PR) in cohort studies or clinical trials. This is acceptable when the outcome is relatively rare (< 10%). However, since many health outcomes are common, the interpretation of OR as RR is questionable because OR overstates RR, sometimes dramatically [1-3]. Moreover, the OR has been considered an "unintelligible" effect measure in some contexts [3].

Binomial regression has been recommended for the estimation of RRs (and PRs) in multivariate analysis [4]. However, sometimes this statistical method cannot estimate RR because convergence problems are frequent. Therefore, the Cox regression with robust variance has been recommended as a suitable method for estimating RRs [5,6].

However, these statistical methods (binomial and Cox regression) are not widely available in freeware (such as Epidat or Epi-Info). Therefore, the ability to estimate PRs and RRs in multivariate models could be limited in research groups with scant resources. In this article, a strategy for estimating RRs with ordinary logistic regression is proposed. This new method could be useful for identifying risk factors and estimating the impact of health interventions in developing countries.

A database of 1000 observations with dichotomous variables was created to simulate a cohort study in which a common event (incidence of 50%) would be strongly related to two independent predictors (*A *and *B*). These predictors would also be statistically associated with one another, resulting in a moderate confounding effect. Then, a third independent variable with a prevalence of 40% was included (predictor *C*). This variable was randomly distributed, but more often in positive than negative predictor *A *group. Thus, this variable was statistically associated with the outcome in a univariate analysis but the association would be explained by the presence of predictor *A *in a multivariate model. Finally, additional dependent variables were generated by randomly selecting a proportion of cases. Thus, outcome variables with frequencies of 20% and 5% were obtained. The first table shows the hypothetical distribution of subjects according to the predictors and outcomes (Table (Table11).

Statistical analysis was performed using STATA software (STATA^{®}/IC 11.0). RRs and 95% confidence intervals (CI) were estimated by applying log-binomial regression and Cox regression with a constant in the time variable [6]. In order to obtain corrected CIs by Cox regression, the robust variance option was applied [7]. ORs and their correspondent CIs were also estimated using an ordinary logistic regression. After univariate estimations were calculated, ORs and RRs were obtained in multivariate models including all independent variables (predictors A, B and C).

The log-binomial model is similar to logistic regression in assuming a binomial distribution of the outcome. However, in a logistic regression the link function is the logarithm of the odds, which is the ratio between cases and non-cases, while in binomial regression the link function is the logarithm of the proportion, i.e., the ratio between cases and cases plus non-cases [4].

In a binomial regression model with k covariates, the function is written as:

$$\mathsf{\text{Log}}\left[\mathsf{\text{a}}/\left(\mathsf{\text{a}}+\mathsf{\text{b}}\right)\right]\mathsf{\text{}}={\beta}_{0}+\mathsf{\text{}}{\beta}_{1}{X}_{1}+\dots +{\beta}_{k}{X}_{k}$$

where *a *is the number of cases and *b *is the number of non-cases, and *X _{i }*the covariates. Thus, a/(a + b) is the probability of success (e. g., the proportion of sick persons in a group), and the RR (or PR) estimated of a given covariate X

On the other hand, in a logistic regression model, the function is written as:

$$\mathsf{\text{Log}}\left(\mathsf{\text{a}}/\mathsf{\text{b}}\right)\mathsf{\text{}}={\beta}_{0}+\mathsf{\text{}}{\beta}_{1}{X}_{1}+\mathsf{\text{}}\dots \mathsf{\text{}}+\mathsf{\text{}}{\beta}_{k}{X}_{k}$$

where a/b is the odds of success and the OR estimated of a given covariate X_{i }is *e*^{βi}.

In order for the case information to be included in the denominator of the estimates in a logistic regression, all observed cases were duplicated in a provisional database and identified as *non-cases*. Thus, a number of observations was included equaling that of the cases and containing the same information about the covariates. Thus, this new logistic function could be written as:

$$\mathsf{\text{Log}}\left[\mathsf{\text{a}}/\left(\mathsf{\text{y}}\right)\right]\mathsf{\text{}}={\beta}_{0}+\mathsf{\text{}}{\beta}_{1}{X}_{1}+\mathsf{\text{}}\dots \mathsf{\text{}}+\mathsf{\text{}}{\beta}_{k}{X}_{k}$$

where *y *includes non-cases as well as cases, although all of them are identified as non-cases. Afterwards, a logistic regression procedure was performed with the modified dataset. The "ORs" obtained were considered direct estimations of RRs because β_{i }defined the relationship between X_{i }and the Log [a/(y)], which in this model would be mathematically similar to Log [a/(a + b)] of the log-binomial model. For each outcome, a provisional database was prepared.

This strategy for logistic regression recognizes an entire cohort as controls. This trick is innovative but analogous to the analysis of case-cohort studies. In that design, cases of a particular outcome are compared with a sample (sub-cohort) of the entire cohort that gave rise to all cases [8]. The objective of selecting this sub-cohort is to estimate the frequency of exposure in the entire cohort. For this reason, such studies have also been called case-exposure studies [9].

This sub-cohort may include some cases, which would consequently be overrepresented in the analysis. Then, by comparing the frequency of exposure between the cases and the sub-cohort set, we obtain a direct estimate of RR (not OR) [9-11]. Similarly, in the method proposed here, the cases would be compared against the entire cohort and thus all cases would be overrepresented. This affects the variance of the estimates and for this reason the CIs are wider [11]. Therefore, an inflation factor for the Standard Error (SE) of each predictor and outcome incidence was calculated as the ratio between SE obtained with the proposed method and SE resulting from binomial regression (as reference method).

For the rarer event (incidence of 5%), RRs estimated by log-binomial were similar to those calculated both by the Cox regressions and the proposed method (modified logistic regression) (Table (Table2).2). Few differences were identified among the CIs of RRs: CIs from the modified method were wider than those estimated by log-binomial and Cox regression with the robust variance option. ORs estimated by ordinary logistic regression were close to RR values. Predictors *A *and *B *were statistically associated with the outcome in univariate analysis but only *A *was independently associated in the multivariate model (Table (Table22).

RRs and ORs and corresponding CIs of associations between a rare event (incidence = 5%) and three independent variables, estimated by Log-binomial regression, ordinary logistic regression, Cox regression with robust variance and logistic regression with **...**

For the second and third outcomes, with incidences of 20% and 50% respectively, the differences between RRs in log-binomial regression and ORs in ordinary logistic regression were more evident (Tables (Tables33 and and4).4). This was especially remarkable for the commonest event, where the ORs of predictors A and B were at least twice the corresponding RR values (Table (Table44).

RRs and ORs and corresponding CIs of associations between an intermediate frequency event (incidence = 20%) and three independent variables, estimated by Log-binomial regression, ordinary logistic regression, Cox regression with robust variance and logistic **...**

RRs and ORs and corresponding CIs of associations between a common event (incidence = 50%) and three independent variables, estimated by Log-binomial regression, ordinary logistic regression, Cox regression with robust variance and logistic regression **...**

On the other hand, RRs estimated in Cox regressions and modified logistic regression were similar or virtually identical to those estimated by log-binomial regression. However, the CIs outputted by the proposed method were wider than those obtained by the other models (Tables (Tables33 and and4).4). Consequently, the SE inflation factor rose for each predictor as the outcome frequency increased (Figure (Figure11).

The use of an adjusted odds ratio to estimate an adjusted relative risk or prevalence ratio is appropriate for studies of rare outcome but may be misleading when the outcome is common. Such overestimation may inappropriately affect clinical decision-making or policy development [3]. For example, overestimation of the importance of a risk factor may lead to unintentional errors in the economical analysis of potential intervention programs or treatment, which could be particularly harmful in developing countries.

The ordinary logistic model estimates OR (not RR) and was initially adapted for case-control studies since data from this type of study design can only determine OR [12]. Moreover, a case-control study is an optimal choice for analyzing rare-event risk factors, for which OR is a close approximation of RR. Thus, ordinary logistic regression is eminently useful for case- control studies mainly because the numeric value of OR mimics RR [12].

On the other hand, RR and PR can be directly determined from data based on cohort and cross-sectional studies, respectively, which are practical only for relatively common outcomes. However, in such circumstances OR estimated by ordinary logistic regression will be more discrepant than RR (or PR). This was exemplified in the results of this paper in that ORs progressively overestimated RRs as the outcome frequency increased.

Indeed, OR will always be greater than RR if RR is greater than 1 (adverse event) and OR will also be less than RR if RR less than 1 (protective effect). Therefore, the uncritical application of logistic regression and the misinterpretation of OR as RR can lead to serious errors in determination of both the importance of risk factors and the impact of interventions on clinical practice and public health [13].

For these reasons, several strategies for estimating RRs in multivariate analysis have been proposed [7,14-16]. Binomial regression is considered the most adequate choice. However, binomial models often predict probabilities greater than *one *and sometimes this regression cannot find possible values and converge in a model. Consequently, other alternative methods have been proposed when binomial regression cannot converge in a model. Cox regression with robust variance using a constant in the time variable seems like a good alternative [7]. However, these options and other statistical alternatives are only available in sophisticated software that some research groups cannot afford.

This paper presents a strategy for logistic regression that recognizes an entire cohort as controls. As the results show, this method can appropriately estimate RRs or PRs, even in analyses with common outcomes. Moreover, the method proposed in this article could be easily performed using free statistics programs that include only logistic regression for multivariate analysis of dichotomous outcomes.

However, the proposed method is associated with SE inflation, which increases confidence intervals. A simple and practical correction factor cannot be established for this problem because, in a multivariate regression, the standard error for each predictor depends on its correlation with all variables included in the model.

Therefore, since the obtained CIs can be wider than those estimated by other models, investigators must be aware that the risk of Type II error could be higher. For this reason, when an association is not statistically significant with the proposed method, ordinary logistic regression could be used for testing the hypothesis that association measure is different than unity. This is possible since the null hypothesis is mathematically equivalent for both OR and RR, because when RR is equal to 1, OR is also equal to 1.

The proposed method may be useful for estimating RRs or PRs appropriately in analysis of common outcomes. However, because the resultant CIs are wider than those derived from other methods, this strategy should be employed when logistic regression is the only method available. This new method may help research groups from developing countries where access to sophisticated programs is limited.

CI: Confidence interval; OR: Odds ratio; PR: Prevalence ratio; RR: Relative risk; SE: Standard Error

The author declares that they have no competing interests.

FAD conceived the study, created the database, designed and executed the analysis, and wrote the manuscript.

The pre-publication history for this paper can be accessed here:

- McNutt LA, Wu C, Xue X, Hafner JP. Estimating the relative risk in cohort studies and clinical trials of common outcomes. Am J Epidemiol. 2003;157:940–3. doi: 10.1093/aje/kwg074. [PubMed] [Cross Ref]
- Zhang J, Yu KF. What's the Relative Risk? A Method of Correcting the Odds Ratio in Cohort Studies of Common Outcomes. JAMA. 1998;280:1690–1691. doi: 10.1001/jama.280.19.1690. [PubMed] [Cross Ref]
- Pearce N. Effect measure in prevalence studies. Environ Health Perspect. 2004;112:1047–1050. doi: 10.1289/ehp.6927. [PMC free article] [PubMed] [Cross Ref]
- Wacholder S. Binomial regression in GLIM: estimating risk ratios and risk differences. Am J Epidemiol. 1986;123:174–184. [PubMed]
- Nijem K, Kristensen P, Al-Khatib A, Bjertness E. Application of different statistical methods to estimate risk for self-reported health complaints among shoe factory workers exposed to organic solvents and plastic compounds. Norsk Epidemiologi. 2005;15:111–116.
- Lee J, Chia KS. Estimation of prevalence rate ratios for cross sectional data: an example in occupational epidemiology. Br J Ind Med. 1993;50:861–862. [PMC free article] [PubMed]
- Barros AJD, Hirakata VN. Alternatives for logistic regression in cross-sectional studies: an empirical comparison of models that directly estimate the prevalence ratio. BMC Med Res Methodol. 2003;3:21. doi: 10.1186/1471-2288-3-21. [PMC free article] [PubMed] [Cross Ref]
- Kulathinal S, Karvanen J, Saarela O, Kuulasmaa K. Case-cohort design in practice - experiences from the MORGAM Project. Epidemiol Perspect Innov. 2007;4:15. [PMC free article] [PubMed]
- Flanders WD. Limitations of the case-exposure study. Epidemiology. 1990;1:34–38. doi: 10.1097/00001648-199001000-00008. [PubMed] [Cross Ref]
- Sato T. Estimation of a common risk ratio in stratified case-cohort studies. Stat Med. 1992;11:1599–605. doi: 10.1002/sim.4780111207. [PubMed] [Cross Ref]
- Sato T. Risk ratio estimation in case-cohort studies. Environ Health Perspect. 1994;102(Suppl 8):53–6. doi: 10.1289/ehp.94102s853. [PMC free article] [PubMed] [Cross Ref]
- Lee J, Tan CS, Chia KS. A practical guide for multivariate analysis of dichotomous outcomes. Ann Acad Med Singapore. 2009;38:714–719. [PubMed]
- Schwartz LM, Woloshin S, Welch HG. Misunderstandings about the effects of race and sex on physicians' referrals for cardiac catheterization. N Engl J Med. 1999;341:279–83. doi: 10.1056/NEJM199907223410411. [PubMed] [Cross Ref]
- Localio AR, Margolis DJ, Berlin JA. Relative risks and confidence intervals were easily computed indirectly from multivariable logistic regression. J Clin Epidemiol. 2007;60:874–882. doi: 10.1016/j.jclinepi.2006.12.001. [PubMed] [Cross Ref]
- Thompson ML, Myers JE, Kriebel D. Prevalence odds ratio or prevalence ratio in the analysis of cross sectional data: what is to be done? Occup Environ Med. 1998;55:272–277. doi: 10.1136/oem.55.4.272. [PMC free article] [PubMed] [Cross Ref]
- Coutinho LM, Scazufca M, Menezes PR. Methods for estimating prevalence ratios in cross-sectional studies. Rev Saude Publica. 2008;42:992–998. doi: 10.1590/S0034-89102008000600003. [PubMed] [Cross Ref]

Articles from BMC Medical Research Methodology are provided here courtesy of **BioMed Central**

PubMed Central Canada is a service of the Canadian Institutes of Health Research (CIHR) working in partnership with the National Research Council's national science library in cooperation with the National Center for Biotechnology Information at the U.S. National Library of Medicine(NCBI/NLM). It includes content provided to the PubMed Central International archive by participating publishers. |