PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of hsresearchLink to Publisher's site
 
Health Serv Res. 2008 April; 43(2): 569–581.
PMCID: PMC2442364

Physician Characteristics and the Reported Effect of Evidence-Based Practice Guidelines

Abstract

Objective

To explore characteristics that may contribute to the effect practice guidelines have on the practice of medicine.

Data Sources

From the third round of the Community Tracking Study, Physician Survey, 2000–2001.

Study Design

An ordinal logistic regression model was estimated to capture the full range of responses.

Principal Findings

Recent medical school graduates, women, minorities, ob-gyn specialists, physicians who use computers for information in their practices, and physicians in nonsolo practice types were significantly more likely to state practice guidelines had an effect on their practice.

Conclusions

Many barriers have prevented wide acceptance of practice guidelines among the medical community. Our findings suggest there will be positive results on guideline effects as recent graduates, women, and minorities enter the physician workforce.

Keywords: Evidence-based practice guidelines, physician characteristics

In 2002, health spending in the United States had climbed to 14.9 percent of the gross domestic product (GDP), advancing much faster than the rest of the U.S. economy and is projected to rise to $3.4 trillion or 18.4 percent in 2013 (Centers for Medicare and Medicaid Services 2004; Levit et al. 2004). Concerns about the rapid growth in health expenditures are coupled with disturbing reports, such as those published by the Institute of Medicine (IOM), that attribute up to 98,000 unnecessary inpatient deaths per year due to medical error (IOM 2000) and suggest Americans are not receiving care that is based on the best scientific knowledge (IOM 2001). Although the IOM reports contributed significantly to increasing safety and quality awareness issues among health care providers, leaders are calling for a national commitment toward improving patient safety and quality of care (Leape and Berwick 2005).

A promising tool for reducing medical error, improving quality of care, and lowering health care cost is the development and use of evidence-based clinical practice guidelines (Cydulka et al. 2003; Maue et al. 2004; Timmermans and Mauck 2005). Hauck, Adler, and Mulla (2004) found that patients with community-acquired pneumonia (CAP) who were placed on a CAP clinical practice guideline had a decreased length of stay, lower odds of hospital mortality, and decreased total patient charges. Similarly, researchers found that patients with unstable angina pectoris and non–ST-segment elevation myocardial infarction who received care concordant with evidence-based practice guidelines had substantially improved long-term survival rates (Allen et al. 2004).

In 1999, the American College of Obstetricians and Gynecologists (ACOG) issued a practice guideline on vaginal birth after cesarean section (VBAC) and trial of labor (TOL). The guideline recommended that a physician be immediately available during TOL in the rare case of complications. Since the 1999 update of this clinical practice guideline, obstetrical providers in Utah have decreased use of TOL and more repeat cesarean sections are performed (Gochnour, Ratcliffe, and Stone 2005). Evidence-based clinical guidelines for acute respiratory tract infections, such as acute otitis media and acute sinusitis, have been associated with improving quality of care by assisting physicians to accurately diagnose these conditions, provide treatment rationales, and reduce the costs associated with inappropriate antibiotic prescriptions (McCracken 2001).

While the above examples illustrate compelling evidence for the use of clinical practice guidelines, the preponderance of literature examines reasons for poor implementation and adherence to practice guidelines. There is, additionally, limited research examining the characteristics of the physicians who use practice guidelines. The purpose of this paper is to identify and explore physician and practice characteristics that contribute to the effect physicians report practice guidelines have on their practice of medicine.

REVIEW OF LITERATURE

Between 1992 and 1996, the Agency for Health Care Policy and Research (AHCPR), now the Agency for Healthcare Research and Quality (AHRQ), began publishing clinical practice guidelines for many different health diagnoses and problems (AHRQ 2004). AHCPR ended its clinical guidelines program in 1996 and a year later launched its initiative to promote evidence-based practice by establishing 12 Evidence-Based Practice Centers (AHRQ 2005). To disseminate the evidence, AHCPR partnered with the American Medical Association (AMA) and the American Association of Health Plans (AAHP) Foundation to sponsor the development of the National Guideline Clearinghouse™ (NGC): a worldwide web-based database of evidence-based clinical practice guidelines (NGC 2005).

The literature supports many barriers to both the implementation of practice guidelines and compliance of use (Pathman et al. 1996; Cabana et al. 1999; Katz 1999; Halm et al. 2000; Ward et al. 2002). Barriers to adherence were generally focused on physician knowledge about clinical practice guidelines (Liu, Shilkret, and Finelli 1998), attitudes about guidelines such as loss of autonomy or “cookbook” medicine, and organizational factors including formats and accessibility (Harris et al. 2000). A relatively low adherence to guidelines usage was found among students, residents, and medical school faculty (Kogan, Reynolds, and Shea 2001). One study suggests barriers centered on concern over professional autonomy (Maue et al. 2004).

METHODS

Participants

The data for this analysis were obtained from the third round of the Community Tracking Study Physician Survey, 2000–2001 (CTS). The CTS is a longitudinal study conducted by the Center for Studying Health System Change (HSC) and funded by the Robert Wood Johnson Foundation to document changes and track the effects of the evolving U.S. health care system over time. The Physician Survey is a component of the CTS. Every 2 years since 1996, the Gallup Organization has conducted a telephone survey of more than 12,000 physicians from 60 communities that were selected using stratified sampling with a probability proportional to population size in order to provide a representative profile of the nation as a whole. The physicians must have spent at least 20 hours per week in direct patient care. Within each site, physicians were randomly selected from sampling frames stratified by primary care physician status. To increase the precision of national estimates, a supplemental sample, selected with stratified probability sampling, was included in the survey. Additionally, primary care physicians were over sampled in the site sample (Health and Medical Care Archive 2004).

Dependent and Key Independent Variables

The survey question most pertinent to this study and defined as the dependent variable was, “How large an effect does your use of formal, written practice guidelines such as those generated by physician organizations, insurance companies or HMOs, or government agencies have on your practice of medicine?” The key independent variables for this analysis were selected based upon prior research and the literature review. The first of these was the number of years since graduation from medical school. The thinking was that more recent graduates may have had greater exposure during medical school to the use of clinical practice guidelines as a method of practicing evidence-based medicine and additionally, may have had more exposure to information technology as methodologies for learning (Lee et al. 2004; Wolfe, Sharp, and Wang 2004; Choudhry, Fletcher, and Soumarai 2005).

Other independent variables were selected based on physician and practice characteristics that may contribute to the development of a clinical practice guideline user profile. Survey questions relevant to this analysis include: practice specialty type such as internal medicine, surgery, or obstetrics (Freed et al. 1998; Waldrop, Prejean, and Singleton 1998; Lee et al. 2004); board certification (Waldrop, Prejean, and Singleton 1998; Maue et al. 2004); the type of practice such as solo or two-man (Freed et al. 1998; Wolfe, Sharp, and Wang 2004); the use of computers to obtain information about treatment alternatives or recommended guidelines; and internet accessibility (Wolfe, Sharp, and Wang 2004).

Statistical Analysis

Preliminary analysis was conducted using the public-use data file. Once significant p-values were identified, the restricted data-use file was obtained through Inter-University Consortium for Political and Social Research (ICPSR), University of Michigan. The restricted-use version preserves physician anonymity while it contains more variables. It contains the sample design variables which allowed calculation of the corrected standard error estimates. The software used for the analyses was IntercooledStata8.1® (Stata Corporation 2003).

The method of maximum likelihood was used in estimating the ordinal logit coefficients:

equation image

where Y: probability of the effect of practice guidelines on a physician's practice; Gen: gender as female, male; Race: white/Caucasian, Asian/Pacific Islander, African American/black, Native American/Alaska Native/other; Yr Grad: year of graduation from medical school; Spec: practice specialty; Bd Cert: board certification; Prac Type: type of practice; Computer: use of computer to obtain treatment information; Internet: Internet access at place where providing patient care.

The dependent variable, the effect of practice guidelines on practice, was measured using a Likert Scale and was ranked as 0=no effect to 5=a very large effect. Reference categories for the four categorical independent variables were: white/Caucasian; graduation from medical school before 1961; the practice specialty of internal medicine; and solo or group practice type of no more than two physicians.

RESULTS

Descriptive Statistics

The distributions of the dependent and independent variables are shown in Table 1 along with the proportion estimates and standard errors. Physicians reporting that the use of guidelines had a moderate effect on their practice were the most prevalent response at 33 percent. Slightly more than half (56 percent) of responding physicians stated that practice guidelines had a moderate to very large effect on their practice. The median for medical school graduation years was 1981–1985 at 19.6 percent. About 39 percent of the respondents were practicing in primary care: internal medicine, family practice, and pediatrics. The largest group of respondents was physicians practicing in medical specialties such as cardiology, oncology, or pulmonology. Physicians practicing obstetrics and gynecology were the smallest population at about 6.3 percent. About 65 percent of the population practiced in a solo or group practice as opposed to practicing within an HMO or as a hospital employee.

Table 1
Descriptive Statistics for Effect of Practice Guidelines on Practice and Independent Variables

Ordinal Logistic Regression

The binary logistic regression methods are applied when there is a categorical response of the simplest possible form—dichotomous. These methods require collapsing data when there are more than two possible values, thus, causing loss in information. A variety of methods have been developed for determining categorical responses that have more than two possible values. The best known and most highly developed are methods for ordinal response variables, called ordinary logistic regression methods. In this project, initially, binary logistic regression models were estimated to identify factors correlated to the effect of practice guidelines. Then an ordinal logistic regression model was estimated where the full range of the response categories was included. The ordinal model was found to be a better fit to the data and is included in the paper. The fitted model assumes proportional odds for the independent variables for each of the effects variable categories.

Table 2 shows the results of this model. The F statistic of 27 (p<.001) indicates that the predictive value of this model is significant. Females are significantly more likely to indicate perceived effects of practice guidelines than males (β = −.222, p<.01). Asians and physicians from the Pacific Islands indicated a strong positive effect of practice guideline (β = .624, p<.001) and African-American physicians indicated a significant effect of practice guidelines (β = .421, p<.01). Physicians graduating in 1996 or after are correlated with a strong effect of practice guidelines (β = .513, p<.01). Three practice specialty categories showed significant findings. Ob-gyn physicians showed a strong effect of practice guidelines (β = .426, p<.01) while medical and surgical specialists were less likely to show an effect of guidelines in this ordinal model. All practice types had significant positive logit coefficients when compared with the reference group of solo or two physician practices groups. Physicians who use a computer to obtain information about alternative treatments or recommended guidelines showed a significant effect of practice guidelines (β = .411, p<.001).

Table 2
Survey Ordinal Logistic Regression Analysis for Effect of Practice Guidelines on Practice

Threshold coefficients for each of the categories of effect of practice guidelines are shown in Table 3. All of these, except the “moderate effect” category, were significantly different from the “no effect” reference category with the coefficients of small to very small having negative logit coefficients (lower probabilities) and the categories of large to very large effect having positive (higher probabilities) than the “no effect” category.

Table 3
Thresholds for the Effect of Practice Guidelines on Practice as Compared with No Effect

DISCUSSION

No graduation year from before 1960 and up to 1995 was significant for effect of guidelines. This may be explained by the fact that practice guideline development and implementation did not begin until the early 1990s. Our results suggest, as the proportion of practicing physicians graduating after 1996 increases, so will the effect of practice guidelines. Because more women have been graduating from medical school in recent years and our results showed that practice guidelines had a greater effect on their practice than on their male colleagues, our findings imply this will also have a positive effect on the use of practice guidelines.

Compared with white/Caucasian physicians, Asian and African-American physicians showed significant associations with increased effect of practice guidelines. We do not know why this finding was significant. Perhaps one reason may be that their minority status encourages them to be more attentive to using established medical practices.

A surprising finding was that access to the Internet did not contribute significantly to the model. This may be because before 1998, agencies such as the National Guideline Clearinghouse™ did not post their practice guidelines on the Internet. However, computer use to obtain information about treatment and recommended guidelines did contribute significantly to the model. This may be because of increasing third party payer and federal and state requirements for electronic communication of administrative data and patient health information. Thus, the accessibility of computers in the work environment may lead to increased use of computers for information gathering.

Several factors, however, were found to have no significant associations on the effect of practice guidelines. In fact, physicians practicing in a medical or surgical specialty were less likely to indicate that practice guidelines had an effect on their practice. This is despite the fact that the literature supports that many medical specialty groups have developed and published practice guidelines specific to their specialty. Medical specialty groups may benefit from further educational efforts to their membership regarding practice guidelines.

No specialty practice area except ob-gyn positively contributed to the likelihood of the effect of guidelines. This specialty is often closely scrutinized in our litigious environment, which may lead to attentiveness to published guidelines.

We found it interesting that board-certified physicians are less likely to state practice guidelines had an effect on their practice than nonboard-certified physicians. This finding may suggest board certified physicians are more secure in their knowledge base and therefore, would be less influenced by guidelines to assist them in their decisions about appropriate health care for specific clinical circumstances.

The findings suggest further research to identify other factors affecting the effect of practice guidelines. More research related to behavior, attitudes and perceptions related to loss of autonomy would be a valuable addition to the body of knowledge. In addition, we believe the succeeding rounds of the CTS Physician Survey will support our findings because many of the characteristics correlated to effects of practice guidelines have a temporal aspect.

This study does have limitations. The sample of physicians selected for the survey was not a simple random sample of the population of all physicians. The sampling frame was physicians practicing in designated cities, ranging from very large to small. Therefore, the findings should not be generalized to all physicians, particularly not to those in rural practice. Interpretation of the findings should consider that physicians were asked for perceptions of the impact of practice guidelines on their own practice. No direct measures of this impact were available.

IMPLICATIONS FOR POLICY AND PRACTICE

Because studies have shown positive correlations between the use of practice guidelines and improved quality and patient safety and decreased costs (McCracken 2001; Hauck, Adler, and Mulla 2004; Gochnour, Ratcliffe, and Stone 2005), our findings suggest that there will be positive results on health care as recent graduates, women, and minorities continue to enter the physician workforce. Additionally, as computer usage becomes more prevalent in clinical practice, the influence of guidelines on physician practice will have a positive effect on health care in the United States.

Policy initiatives such as the promotion or requirement for information technology in health care should reinforce the tendencies found in this study. Furthermore, the introduction and requirements for medical students to learn and use computer technologies from the outset of their clinical training should also increase the effects of guidelines on practice. Additionally, the inclusion of women and minorities in the medical profession reinforces these policy and practice developments.

Acknowledgments

The authors appreciate the reviewer's thoughtful and constructive comments. The authors also appreciate the suggestions made by Romana Hasnain-Wynia, Ph.D., Senior Associate Editor and Harold S. Luft, Ph.D., Co-Editor-in-Chief.

REFERENCES

  • Agency for Healthcare Research and Quality (AHRQ) 2004. [October 26, 2004]. “Clinical Practice Guidelines Online”. Available at http://www.ahrq.gov/clinic/cpgonline.htm. [PubMed]
  • Agency for Healthcare Research and Quality (AHRQ) 2005. [May 23, 2005]. “Evidence-Based Practice Centers”. Available at http://www.ahrq.gov/clinic/epc.
  • Allen L A, O'Donnell C J, Giugliano R P, Camargo C A, Jr, Lloyd-Jones D M. Care Concordant with Guidelines Predicts Decreased Long-Term Mortality in Patients with Unstable Angina Pectoris and Non-ST-Elevation Myocardial Infarction. American Journal of Cardiology. 2004;93(10):1218–22. [PubMed]
  • Cabana M D, Rand C S, Powe N R, Wu B W, Wilson M H, Abboud P C, Rubin H R. Why Don't Physicians Follow Clinical Practice Guidelines? Journal of the American Medical Association. 1999;282(15):1458–65. [PubMed]
  • Centers for Medicare and Medicaid Services. 2004. [May 4, 2005]. “National Health Care Expenditures”. Available at http://www.cms.hhs.gov/publications/overview-medicare-medicaid/default2.asp.
  • Choudhry N K, Fletcher R H, Soumerai S B. Systematic Review: The Relationship between Clinical Experience and Quality of Health Care. Annals of Internal Medicine. 2005;142(4):260–73. [PubMed]
  • Cydulka R K, Rowe B H, Clark S, Emerman C L, Camargo C A. Emergency Department Management of Acute Exacerbations of Chronic Obstructive Pulmonary Disease in the Elderly: The Multicenter Airway Research Collaboration. Journal of the American Geriatric Society. 2003;51:908–16. [PubMed]
  • Freed G L, Pathman D E, Konrad T R, Freeman V A, Clark S J. Adopting Immunization Recommendations: A New Dissemination Model. Maternal and Child Health Journal. 1998;2(4):231–9. [PubMed]
  • Gochnour G, Ratcliffe S, Stone M B. The UTAH VBAC Study. Maternal and Child Health Journal. 2005;9(2):181–8. [PubMed]
  • Halm E A, Atlas S J, Borowsky L H, Benzer T I, Metlay J P, Chang Y C, Singer D E. Understanding Physician Adherence with a Pneumonia Practice Guideline: Effects of Patient, System, and Physician Factors. Archives of Internal Medicine. 2000;160:98–104. [PubMed]
  • Harris J S, Mueller K, Low P, Peplowski B, Koziol-McLain J. Suggested Improvements in Practice Guidelines: Market Research to Support Clinical Quality Improvement. Journal of Occupational and Environmental Medicine. 2000;42(4):377–84. [PubMed]
  • Hauck L D, Adler L M, Mulla Z D. Clinical Pathway Care Improves Outcomes among Patients Hospitalized for Community-Acquired Pneumonia. American Journal of Epidemiology. 2004;14(9):669–75. [PubMed]
  • Health and Medical Care Archive. [October 17, 2004]. Available at http://www.icpsr.umich.edu/HMCA.
  • Institute of Medicine. To Err Is Human: Building a Safer Health System. Washington, DC: National Academy Press; 2000.
  • Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academy Press; 2001.
  • Katz D A. Barriers between Guidelines and Improved Patient Care: An Analysis of AHCPR's Unstable Angina Clinical Practice Guideline. Health Services Research. 1999;34(1, part 2):377–89. [PMC free article] [PubMed]
  • Kogan J R, Reynolds E E, Shea J A. Resident and Faculty Adherence to Common Guidelines. Academic Medicine. 2001;76(10):S27–9. [PubMed]
  • Leape L L, Berwick D M. Five Years after To Err Is Human: What Have We Learned? Journal of the American Medical Association. 2005;293(19):2384–90. [PubMed]
  • Lee K C, Finkelstein J A, Miroshnik I L, Rusinak D, Santoli J M, Lett S M, Lieu T A. Pediatricians' Self-Reported Clinical Practices and Adherence to National Immunization Guidelines: The Introduction of Pneumococcal Conjugate Vaccine. Archives of Pediatrics and Adolescent Medicine. 2004;158(7):695–701. [PubMed]
  • Levit K, Smith C, Cowan C, Sensenig A, Catlin A. Health Spending Rebound Continues in 2002. Health Affairs. 2004;23(1):147–59. [PubMed]
  • Liu Z, Shilkret K L, Finelli L. Initial Drug Regimens for the Treatment of Tuberculosis: Evaluation of Physician Prescribing Practices in New Jersey, 1994 to 1995. Chest. 1998;113(6):1446–51. [PubMed]
  • Maue S K, Segal R, Kimberlin C L, Lipowski E E. Predicting Physician Guideline Compliance: An Assessment of Motivators and Perceived Barriers. American Journal of Managed Care. 2004;10(6):383–91. [PubMed]
  • McCracken G H., Jr. Clinical Practice Guidelines for the Diagnosis and Treatment of Respiratory Tract Infections. American Journal of Managed Care. 2001;7(6 suppl):S183–91. [PubMed]
  • National Guideline Clearinghouse™ 2005. [July 24, 2005]. What Is the National Guideline Clearinghouse™?”. Available at http://www.ahrq.gov/clinic/ngcfact.htm.
  • Pathman D E, Konrad T R, Freed G L, Freeman V A, Koch G G. The Awareness-to-Adherence Model of the Steps to Clinical Guideline Compliance: The Case of Pediatric Vaccine Recommendations. Medical Care. 1996;34(9):873–89. [PubMed]
  • Stata Corporation. Inter-Cooled Stata 8.1 for Windows®. College Station, Texas: Stata Corporation; 2003.
  • Timmermans S, Mauck A. The Promises and Pitfalls of Evidence-Based Medicine. Health Affairs. 2005;24(1):18–28. [PubMed]
  • Waldrop R D, Prejean C, Singleton R. Overuse of Parenteral Antibiotics for Wound Care in an Urban Emergency Department. American Journal of Emergency Medicine. 1998;16(4):343–5. [PubMed]
  • Ward M M, Vaughn T E, Uden-Holman T, Doebbeling B N, Clarke W R, Woolson R F. Physician Knowledge, Attitudes and Practices Regarding a Widely Implemented Guideline. Journal of Evaluation in Clinical Practice. 2002;8(2):155–62. [PubMed]
  • Wolfe R M, Sharp L K, Wang R M. Family Physicians Opinions and Attitudes to Three Clinical Practice Guidelines. Journal of the American Board of Family Practice. 2004;17(2):150–57. [PubMed]

Articles from Health Services Research are provided here courtesy of Health Research & Educational Trust