To assess the applicability of the Prostate Cancer Prevention Trial High Grade (Gleason grade ≥ 7) Risk Calculator (PCPTHG) in ten international cohorts, representing a range of populations.
25,512 biopsies from 10 cohorts (6 European, 1 UK, and 3 US) were included; 4 implemented 6-core biopsies and the remaining had 10- or higher schemes; 8 were screening cohorts and 2 were clinical. PCPTHG risks were calculated using prostate-specific antigen (PSA), digital rectal examination, age, African origin and history of prior biopsy and evaluated in terms of calibration plots, areas underneath the receiver operating characteristic curve (AUC), and net benefit curves.
The median AUC of the PCPTHG for high grade disease detection in the 10- and higher-core cohorts was 73.5% (range 63.9% to 76.7%) compared to a median of 78.1 (range = 72.0 to 87.6) among the four 6-core cohorts. Only the 10-core Cleveland Clinic cohort showed clear evidence of under-prediction by the PCPTHG, and this was restricted to risk ranges less than 15%. The PCPTHG demonstrated higher clinical net benefit in higher- compared to six-core biopsy cohorts, and among the former, there were no notable differences observed between clinical and screening cohorts, nor between European and US cohorts.
The PCPTHG requires minimal patient information and can be applied across a range of populations. PCPTHG risk thresholds ranging from 5 to 20%, depending on patient risk averseness, are recommended for clinical prostate biopsy decision-making.
Calibration; Discrimination; Net Benefit; High Grade Prostate Cancer; Risk; Prostate Cancer Prevention Trial
Although numerous risk-prediction models exist in patients presenting with acute coronary syndromes (ACS), they are subject to important short-comings, including lack of contemporary information. Short-term models are frequently biased by in-hospital events. Accordingly, we sought to create contemporary risk-prediction models for clinical outcomes following ACS up to 1 year following discharge. Models were constructed for death at 30 days and 1 year, death/myocardial infarction (MI)/revascularization at 30 days and death/MI at 1 year in consecutive patients presenting with ACS at our institution between 2006 and 2008, and discharged alive. Logistic regression was used to model the 30 day outcomes and Cox proportional hazards were used to model the 1 year outcomes. No linearity assumptions were made for continuous variables. The final model coefficients were used to create a prediction nomogram, which was incorporated into an online risk calculator. A total of 2,681 patients were included, of which about 9.5% presented with ST-elevation MI. All-cause mortality was 2.6% at 30 days and 13% at 1 year. Demographic, past medical history, laboratory, pharmacological and angiographic parameters were identified as being predictive of adverse ischemic outcomes at 30 days and 1 year. The c-indices for these models ranged from 0.73 to 0.82. Our study thus identified risk factors that are predictive of short- and long-term ischemic and revascularization outcomes in contemporary patients with ACS, and incorporated them into an easy-to-use online calculator, with equal or better discriminatory power than currently available models.
Mortality; myocardial infarction; predictors; registry; revascularization
Cancer staging determines extent of disease, facilitating prognostication and treatment decision making. The American Joint Committee on Cancer (AJCC) TNM classification system is the most commonly used staging algorithm for colon cancer, categorizing patients on the basis of only these three variables (tumor, node, and metastasis). The purpose of this study was to extend the seventh edition of the AJCC staging system for colon cancer to incorporate additional information available from tumor registries, thereby improving prognostic accuracy.
Records from 128,853 patients with primary colon cancer reported to the Surveillance, Epidemiology and End Results Program from 1994 to 2005 were used to construct and validate three survival models for patients with primary curative-intent surgery. Independent training/test data sets were used to develop and test alternative models. The seventh edition TNM staging system was compared with models supplementing TNM staging with additional demographic and tumor variables available from the registry by calculating a concordance index, performing calibration, and identifying the area under receiver operating characteristic (ROC) curves.
Inclusion of additional registry covariates improved prognostic estimates. The concordance index rose from 0.60 (95% CI, 0.59 to 0.61) for the AJCC model, with T- and N-stage variables, to 0.68 (95% CI, 0.67 to 0.68) for the model including tumor grade, number of collected metastatic lymph nodes, age, and sex. ROC curves for the extended model had higher sensitivity, at all values of specificity, than the TNM system; calibration curves indicated no deviation from the reference line.
Prognostic models incorporating readily available data elements outperform the current AJCC system. These models can assist in personalizing treatment and follow-up for patients with colon cancer.
Background. Propensity score usage seems to be growing in popularity leading researchers to question the possible role of propensity scores in prediction modeling, despite the lack of a theoretical rationale. It is suspected that such requests are due to the lack of differentiation regarding the goals of predictive modeling versus causal inference modeling. Therefore, the purpose of this study is to formally examine the effect of propensity scores on predictive performance. Our hypothesis is that a multivariable regression model that adjusts for all covariates will perform as well as or better than those models utilizing propensity scores with respect to model discrimination and calibration.
Methods. The most commonly encountered statistical scenarios for medical prediction (logistic and proportional hazards regression) were used to investigate this research question. Random cross-validation was performed 500 times to correct for optimism. The multivariable regression models adjusting for all covariates were compared with models that included adjustment for or weighting with the propensity scores. The methods were compared based on three predictive performance measures: (1) concordance indices; (2) Brier scores; and (3) calibration curves.
Results. Multivariable models adjusting for all covariates had the highest average concordance index, the lowest average Brier score, and the best calibration. Propensity score adjustment and inverse probability weighting models without adjustment for all covariates performed worse than full models and failed to improve predictive performance with full covariate adjustment.
Conclusion. Propensity score techniques did not improve prediction performance measures beyond multivariable adjustment. Propensity scores are not recommended if the analytical goal is pure prediction modeling.
Prediction; Propensity score; Calibration curve; Concordance index; Multivariable regression
Purpose: An estimated 24%–45% of patients with cancer develop brain metastases. Individualized estimation of survival for patients with brain metastasis could be useful for counseling patients on clinical outcomes and prognosis. Methods: De-identified data for 2367 patients with brain metastasis from 7 Radiation Therapy Oncology Group randomized trials were used to develop and internally validate a prognostic nomogram for estimation of survival among patients with brain metastasis. The prognostic accuracy for survival from 3 statistical approaches (Cox proportional hazards regression, recursive partitioning analysis [RPA], and random survival forests) was calculated using the concordance index. A nomogram for 12-month, 6-month, and median survival was generated using the most parsimonious model. Results: The majority of patients had lung cancer, controlled primary disease, no surgery, Karnofsky performance score (KPS) ≥ 70, and multiple brain metastases and were in RPA class II or had a Diagnosis-Specific Graded Prognostic Assessment (DS-GPA) score of 1.25–2.5. The overall median survival was 136 days (95% confidence interval, 126–144 days). We built the nomogram using the model that included primary site and histology, status of primary disease, metastatic spread, age, KPS, and number of brain lesions. The potential use of individualized survival estimation is demonstrated by showing the heterogeneous distribution of the individual 12-month survival in each RPA class or DS-GPA score group. Conclusion: Our nomogram provides individualized estimates of survival, compared with current RPA and DS-GPA group estimates. This tool could be useful for counseling patients with respect to clinical outcomes and prognosis.
brain metastases; nomogram; prediction; prognosis; survival
Introduction. The objective of this study was to create a tool that accurately predicts the risk of morbidity and mortality in patients with type 2 diabetes according to an oral hypoglycemic agent.
Materials and Methods. The model was based on a cohort of 33,067 patients with type 2 diabetes who were prescribed a single oral hypoglycemic agent at the Cleveland Clinic between 1998 and 2006. Competing risk regression models were created for coronary heart disease (CHD), heart failure, and stroke, while a Cox regression model was created for mortality. Propensity scores were used to account for possible treatment bias. A prediction tool was created and internally validated using tenfold cross-validation. The results were compared to a Framingham model and a model based on the United Kingdom Prospective Diabetes Study (UKPDS) for CHD and stroke, respectively.
Results and Discussion. Median follow-up for the mortality outcome was 769 days. The numbers of patients experiencing events were as follows: CHD (3062), heart failure (1408), stroke (1451), and mortality (3661). The prediction tools demonstrated the following concordance indices (c-statistics) for the specific outcomes: CHD (0.730), heart failure (0.753), stroke (0.688), and mortality (0.719). The prediction tool was superior to the Framingham model at predicting CHD and was at least as accurate as the UKPDS model at predicting stroke.
Conclusions. We created an accurate tool for predicting the risk of stroke, coronary heart disease, heart failure, and death in patients with type 2 diabetes. The calculator is available online at http://rcalc.ccf.org under the heading “Type 2 Diabetes” and entitled, “Predicting 5-Year Morbidity and Mortality.” This may be a valuable tool to aid the clinician’s choice of an oral hypoglycemic, to better inform patients, and to motivate dialogue between physician and patient.
Type 2 diabetes mellitus; Prediction; Propensity; Coronary heart disease; Heart failure; Stroke; Mortality; Electronic health record; Hypoglycemic agents
• To validate previously published nomograms for predicting insignificant prostate cancer (PCa) that incorporate clinical data, percentage of biopsy cores positive (%BC+) and magnetic resonance imaging (MRI) or MRI/MR spectroscopic imaging (MRSI) results.
• We also designed new nomogram models incorporating magnetic resonance results and clinical data without detailed biopsy data.
• Nomograms for predicting insignificant PCa can help physicians counsel patients with clinically low-risk disease who are choosing between active surveillance and definitive therapy.
Patients and methods
• In total, 181 low-risk PCa patients (clinical stage T1c–T2a, prostate-specific antigen level < 10 ng/mL, biopsy Gleason score of 6) had MRI/MRSI before surgery.
• For MRI and MRI/MRSI, the probability of insignificant PCa was recorded prospectively and independently by two radiologists on a scale from 0 (definitely insignificant) to 3 (definitely significant PCa).
• Insignificant PCa was defined on surgical pathology.
• There were four models incorporating MRI or MRI/MRSI and clinical data with and without %BC+ that were compared with a base clinical model without %BC and a more comprehensive clinical model with %BC+.
• Prediction accuracy was assessed using areas under receiver–operator characteristic curves.
• At pathology, 27% of patients had insignificant PCa, and the Gleason score was upgraded in 56.4% of patients.
• For both readers, all magnetic resonance models performed significantly better than the base clinical model (P ≤ 0.05 for all) and similarly to the more comprehensive clinical model.
• Existing models incorporating magnetic resonance data, clinical data and %BC+ for predicting the probability of insignificant PCa were validated.
• All MR-inclusive models performed significantly better than the base clinical model.
magnetic resonance imaging; magnetic resonance spectroscopic imaging; nomograms; prostate neoplasms
To evaluate the discrimination, calibration and net benefit performance of the Prostate Cancer Prevention Trial Risk Calculator (PCPTRC) across five European Randomized study of Screening for Prostate Cancer (ERSPC), 1 United Kingdom, 1 Austrian and 3 US biopsy cohorts.
PCPTRC risks were calculated for 25,733 biopsies using prostate-specific antigen (PSA), digital rectal examination, family history and history of prior biopsy, and single imputation for missing covariates. Predictions were evaluated using the areas underneath the receiver operating characteristic curves (AUC), discrimination slopes, chi-square tests of goodness of fit, and net benefit decision curves.
AUCs of the PCPTRC ranged from a low of 56% in the ERSPC Goeteborg Rounds 2-6 cohort to a high of 72% in the ERSPC Goeteborg Round 1 cohort, and were statistically significantly higher than that of PSA in 6 out of the 10 cohorts. The PCPTRC was well-calibrated in the SABOR, Tyrol and Durham cohorts. There was limited to no net benefit to using the PCPTRC for biopsy referral compared to biopsying all or no men in all five ERSPC cohorts and benefit within a limited range of risk thresholds in all other cohorts.
External validation of the PCPTRC across ten cohorts revealed varying degree of success highly dependent on the cohort, most likely due to different criteria for and work-up before biopsy. Future validation studies of new calculators for prostate cancer should acknowledge the potential impact of the specific cohort studied when reporting successful versus failed validation.
receiver operating characteristic curve; risk; prostate cancer; calibration; net benefit
New markers may improve prediction of diagnostic and prognostic outcomes. We review various measures to quantify the incremental value of markers over standard, readily available characteristics. Widely used traditional measures include the improvement in model fit or in the area under the receiver operating characteristic (ROC) curve (AUC). New measures include the net reclassification index (NRI) and decision–analytic measures, such as the fraction of true positive classifications penalized for false positive classifications (‘net benefit’, NB).
For illustration we discuss a case study on the presence of residual tumor versus benign tissue in 544 patients with testicular cancer. We assessed 3 tumor markers (AFP, HCG, and LDH) for their incremental value over currently standard clinical predictors. AUC and R2 values suggested adding continuous LDH and AFP whereas NB only favored HCG as a potentially promising marker at a clinically defendable decision threshold of 20% risk. Results based on the NRI fell in the middle, suggesting reclassification potential of all three markers.
We conclude that improvement in standard discrimination measures, which focus on finding variables that might be promising across all decision thresholds, may not detect the most informative markers at a specific threshold of particular clinical relevance. When a marker is intended to support decision making, calculation of the improvement in a decision–analytic measure, such as NB, is preferable over an overall judgment as obtained from the AUC in ROC analysis.
prediction; logistic regression model; performance measures; incremental value
The performance of prediction models can be assessed using a variety of different methods and metrics. Traditional measures for binary and survival outcomes include the Brier score to indicate overall model performance, the concordance (or c) statistic for discriminative ability (or area under the receiver operating characteristic (ROC) curve), and goodness-of-fit statistics for calibration.
Several new measures have recently been proposed that can be seen as refinements of discrimination measures, including variants of the c statistic for survival, reclassification tables, net reclassification improvement (NRI), and integrated discrimination improvement (IDI). Moreover, decision–analytic measures have been proposed, including decision curves to plot the net benefit achieved by making decisions based on model predictions.
We aimed to define the role of these relatively novel approaches in the evaluation of the performance of prediction models. For illustration we present a case study of predicting the presence of residual tumor versus benign tissue in patients with testicular cancer (n=544 for model development, n=273 for external validation).
We suggest that reporting discrimination and calibration will always be important for a prediction model. Decision-analytic measures should be reported if the predictive model is to be used for making clinical decisions. Other measures of performance may be warranted in specific applications, such as reclassification metrics to gain insight into the value of adding a novel predictor to an established model.
We have previously demonstrated that there is a learning curve for open radical prostatectomy. In this study we sought to determine whether the effects of the learning curve are modified by patient risk as defined by preoperative tumor characteristics.
The study included 7,683 eligible prostate cancer patients treated with open radical prostatectomy by one of 72 surgeons. Surgeon experience was coded as the total prior number of radical prostatectomies conducted by the surgeon prior to a patient’s surgery. Multivariable survival-time regression models were used to evaluate the association between surgeon experience and biochemical recurrence, separately for each preoperative risk group.
We saw no evidence that patient risk affects the learning curve: there was a statistically significant association between biochemical recurrence and surgeon experience in all analyses. The absolute risk difference for a patient receiving treatment from a surgeon with 10 compared to 250 prior radical prostatectomies was 6.6% (95% C.I. 3.4%, 10.3%), 12.0% (6.9%, 18.2%) and 9.7% (1.2%, 18.2%) for patients at low, medium and high preoperative risk patients. Recurrence-free probability for patients with low risk disease approached 100% for the most experienced surgeons
Cancer control after radical prostatectomy improves with increasing surgeon experience irrespective of patient risk. Excellent rates of cancer control for patients with low risk disease treated by the most experienced surgeons suggests that the primary reason such patients recur is inadequate surgical technique. The results have significant implications for clinical care.
Radical prostatectomy; prostate cancer; surgery
Purpose: To identify and examine polymorphisms of genes associated with aggressive and clinical significant forms of prostate cancer among a screening cohort.
Experimental Design: We conducted a genome-wide association study among patients with aggressive forms of prostate cancer and biopsy-proven normal controls ascertained from a prostate cancer screening program. We then examined significant associations of specific polymorphisms among a prostate cancer screened cohort to examine their predictive ability in detecting prostate cancer.
Results: We found significant associations between aggressive prostate cancer and five single nucleotide polymorphisms (SNPs) in the 10q26 (rs10788165, rs10749408, and rs10788165, p value for association 1.3 × 10−10 to 3.2 × 10−11) and 15q21 (rs4775302 and rs1994198, p values for association 3.1 × 10−8 to 8.2 × 10−9) regions. Results of a replication study done in 3439 patients undergoing a prostate biopsy, revealed certain combinations of these SNPs to be significantly associated not only with prostate cancer but with aggressive forms of prostate cancer using an established classification criterion for prostate cancer progression (odds ratios for intermediate to high-risk disease 1.8–3.0, p value 0.003–0.001). These SNP combinations were also important clinical predictors for prostate cancer detection based on nomogram analysis that assesses prostate cancer risk.
Conclusions: Five SNPs were found to be associated with aggressive forms of prostate cancer. We demonstrated potential clinical applications of these associations.
OBJECTIVE—The objective of this study was to create a tool that predicts the risk of mortality in patients with type 2 diabetes.
RESEARCH DESIGN AND METHODS—This study was based on a cohort of 33,067 patients with type 2 diabetes identified in the Cleveland Clinic electronic health record (EHR) who were initially prescribed a single oral hypoglycemic agent between 1998 and 2006. Mortality was determined in the EHR and the Social Security Death Index. A Cox proportional hazards regression model was created using medication class and 20 other predictor variables chosen for their association with mortality. A prediction tool was created using the Cox model coefficients. The tool was internally validated using repeated, random subsets of the cohort, which were not used to create the prediction model.
RESULTS—Follow-up in the cohort ranged from 1 day to 8.2 years (median 28.6 months), and 3,661 deaths were observed. The prediction tool had a concordance index (i.e., c statistic) of 0.752.
CONCLUSIONS—We successfully created a tool that accurately predicts mortality risk in patients with type 2 diabetes. The incorporation of medications into mortality predictions in patients with type 2 diabetes should improve treatment decisions.
Accurate preoperative and postoperative risk assessment has been critical for counseling patients regarding radical prostatectomy for clinically localized prostate cancer. In addition to other treatment modalities, neoadjuvant or adjuvant therapies have been considered. The growing literature suggested that the experience of the surgeon may affect the risk of prostate cancer recurrence. The purpose of this study was to develop and internally validate nomograms to predict the probability of recurrence, both preoperatively and postoperatively, with adjustment for standard parameters plus surgeon experience.
The study cohort included 7724 eligible prostate cancer patients treated with radical prostatectomy by 1 of 72 surgeons. For each patient, surgeon experience was coded as the total number of cases conducted by the surgeon before the patient’s operation. Multivariable Cox proportional hazards regression models were developed to predict recurrence. Discrimination and calibration of the models was assessed following bootstrapping methods, and the models were presented as nomograms.
In this combined series, the 10-year probability of recurrence was 23.9%. The nomograms were quite discriminating (preoperative concordance index, 0.767; postoperative concordance index, 0.812). Calibration appeared to be very good for each. Surgeon experience seemed to have a quite modest effect, especially postoperatively.
Nomograms have been developed that consider the surgeon’s experience as a predictor. The tools appeared to predict reasonably well but were somewhat little improved with the addition of surgeon experience as a predictor variable.
prostate cancer; surgeon experience; recurrence; predictive value; nomogram
The prognosis of men with clinically localized prostate cancer is highly variable, and it is difficult to counsel a man who may be considering avoiding, or delaying, aggressive therapy. After collecting data on a large cohort of men who received no initial active prostate cancer therapy, we sought to develop, and to internally validate, a nomogram for prediction of disease-specific survival.
Working with 6 cancer registries within England and numerous hospitals in the region, we constructed a population-based cohort of men diagnosed with prostate cancer between 1990 and 1996. All men had baseline serum prostate specific antigen (PSA) measurements, centralized pathologic grading, and centralized review of clinical stage assignment. Based upon the clinical and pathological data from 1,911 men, we developed and validated a statistical model that served as the basis for the nomogram. The discrimination and calibration of the nomogram were assessed with use of one third of the men, who were omitted from modeling and used as a test sample.
The median age of the included men was 70.4 years. The 25th and 75th percentiles of PSA were 7.3 and 32.6 ng/ml respectively, and the median was 15.4 ng/ml. Forty-two percent of the men had high grade disease. The nomogram predicted well with a concordance index of 0.73 and had good calibration.
We have developed an accurate tool for predicting the probability that a man with clinically localized prostate cancer will survive his disease for 120 months if the cancer is not treated with curative intent immediately. The tool should be helpful for patient counseling and clinical trial design.
Greater understanding of the biology and epidemiology of prostate cancer in the last several decades have led to significant advances in its management. Prostate cancer is now detected in greater numbers at lower stages of disease and is amenable to multiple forms of efficacious treatment. However, there is a lack of conclusive data demonstrating a definitive mortality benefit from this earlier diagnosis and treatment of prostate cancer. It is likely due to the treatment of a large proportion of indolent cancers that would have had little adverse impact on health or lifespan if left alone. Due to this overtreatment phenomenon, active surveillance with delayed intervention is gaining traction as a viable management approach in contemporary practice. The ability to distinguish clinically insignificant cancers from those with a high risk of progression and/or lethality is critical to the appropriate selection of patients for surveillance protocols versus immediate intervention. This chapter will review the ability of various prediction models, including risk groupings and nomograms, to predict indolent disease and determine their role in the contemporary management of clinically localized prostate cancer.
prediction model; prostate cancer; prostatic neoplasms; screening
An existing preoperative nomogram predicts the probability of prostate cancer recurrence, defined by prostate-specific antigen (PSA), at 5 years after radical prostatectomy based on clinical stage, serum PSA, and biopsy Gleason grade. In an updated and enhanced nomogram, we have extended the predictions to 10 years, added the prognostic information of systematic biopsy results, and enabled the predictions to be adjusted for the year of surgery. Cox regression analysis was used to model the clinical information for 1978 patients treated by two high-volume surgeons from our institution. The nomogram was externally validated on an independent cohort of 1545 patients with a concordance index of 0.79 and was well calibrated with respect to observed outcome. The inclusion of the number of positive and negative biopsy cores enhanced the predictive accuracy of the model. Thus, a new preoperative nomogram provides robust predictions of prostate cancer recurrence up to 10 years after radical prostatectomy.
Physicians often order periodic bone scans (BS) to check for metastases in patients with an increasing prostate-specific antigen (PSA; biochemical recurrence [BCR]) after radical prostatectomy (RP), but most scans are negative. We studied patient characteristics to build a predictive model for a positive scan.
Patients and Methods
From our prostate cancer database we identified all patients with detectable PSA after RP. We analyzed the following features at the time of each bone scan for association with a positive BS: preoperative PSA, time to BCR, pathologic findings of the RP, PSA before the BS (trigger PSA), PSA kinetics (PSA doubling time, PSA slope, and PSA velocity), and time from BCR to BS. The results were incorporated into a predictive model.
There were 414 BS performed in 239 patients with BCR and no history of androgen deprivation therapy. Only 60 (14.5%) were positive for metastases. In univariate analysis, preoperative PSA (P = .04), seminal vesicle invasion (P = .02), PSA velocity (P < .001), and trigger PSA (P < .001) predicted a positive BS. In multivariate analysis, only PSA slope (odds ratio [OR], 2.71; P = .03), PSA velocity (OR, 0.93; P = .003), and trigger PSA (OR, 1.022; P < .001) predicted a positive BS. A nomogram for predicting the bone scan result was constructed with an overfit-corrected concordance index of 0.93.
Trigger PSA, PSA velocity, and slope were associated with a positive BS. A highly discriminating nomogram can be used to select patients according to their risk for a positive scan. Omitting scans in low-risk patients could reduce substantially the number of scans ordered.
Statistical models predicting cancer recurrence after surgery are based on biologic variables. We have previously shown that prostate cancer recurrence is related both to tumor biology and to surgical technique. Here we evaluate the association between several biological predictors and biochemical recurrence across varying surgical experience. The study included two separate cohorts: 6091 patients treated by open radical prostatectomy and an independent replication set of 2298 patients treated laparoscopically. We calculated the odds ratios for biological predictors of biochemical recurrence– stage, Gleason grade and prostate-specific antigen (PSA) – and also the predictive accuracy (AUC) of a multivariable model, for subgroups of patients defined by the experience of their surgeon. In the open cohort, the odds ratio for Gleason score 8+ and advanced pathologic stage, though not PSA or Gleason score 7, increased dramatically when patients treated by surgeons with lower levels of experience were excluded (Gleason 8+: odds ratios 5.6 overall vs. 13.0 for patients treated by surgeons with 1000+ prior cases; locally advanced disease: odds ratios of 6.6 vs. 12.2 respectively). The AUC of the multivariable model was 0.750 for patients treated by surgeons with 50 or fewer cases compared to 0.849 for patients treated by surgeons with 500 or more. Although predictiveness was overall lower for the independent replication set cohort, the main findings were replicated. Surgery confounds biology. Although our findings have no direct clinical implications, studies investigating biological variables as predictors of outcome after curative resection of cancer should consider the impact of surgeon specific factors.
prostate cancer; prediction; molecular markers; outcome studies; surgeon
Although the American Board of Internal Medicine (ABIM) certification is valued as a reflection of physicians’ experience, education, and expertise, limited methods exist to predict performance in the examination.
The objective of this study was to develop and validate a predictive tool based on variables common to all residency programs, regarding the probability of an internal medicine graduate passing the ABIM certification examination.
The development cohort was obtained from the files of the Cleveland Clinic internal medicine residents who began training between 2004 and 2008. A multivariable logistic regression model was built to predict the ABIM passing rate. The model was represented as a nomogram, which was internally validated with bootstrap resamples. The external validation was done retrospectively on a cohort of residents who graduated from two other independent internal medicine residency programs between 2007 and 2011.
Of the 194 Cleveland Clinic graduates used for the nomogram development, 175 (90.2%) successfully passed the ABIM certification examination. The final nomogram included four predictors: In-Training Examination (ITE) scores in postgraduate year (PGY) 1, 2, and 3, and the number of months of overnight calls in the last 6 months of residency. The nomogram achieved a concordance index (CI) of 0.98 after correcting for over-fitting bias and allowed for the determination of an estimated probability of passing the ABIM exam. Of the 126 graduates from two other residency programs used for external validation, 116 (92.1%) passed the ABIM examination. The nomogram CI in the external validation cohort was 0.94, suggesting outstanding discrimination.
A simple user-friendly predictive tool, based on readily available data, was developed to predict the probability of passing the ABIM exam for internal medicine residents. This may guide program directors’ decision-making related to program curriculum and advice given to individual residents regarding board preparation.
board examination; in-training examination; internal medicine; residents; program directors
Introduction: 5-alpha reductase inhibitors can reduce the risk of prostate cancer (PCa) but can be associated with significant side effects. A library of nomograms which predict the risk of clinical endpoints relevant to dutasteride treatment may help determine if chemoprevention is suited to the individual patient. Methods: Data from the REDUCE trial was used to identify predictive factors for 9 endpoints relevant to dutasteride treatment. Using the treatment and placebo groups from the biopsy cohort, Cox proportional hazards (PH) and competing risks regression (CRR) models were used to build 18 nomograms, whose predictive ability was measured by concordance index (CI) and calibration plots. Results: A total of 18 nomograms assessing the risks of cancer, high grade cancer, high grade prostatic intraepithelial neoplasia (HGPIN), atypical small acinar proliferation (ASAP), erectile dysfunction (ED), acute urinary retention (AUR), gynecomastia, urinary tract infection (UTI) and BPH-related surgery either on or off dutasteride were created. The nomograms for cancer, high grade cancer, ED, AUR, and BPH-related surgery demonstrated good discrimination and calibration while those for gynecomastia, UTI, HGPIN, and ASAP predicted no better than random chance. Conclusions: To aid patients in determining whether the benefits of dutasteride use outweigh the risks, we have developed a comprehensive metagram that can generate individualized risks of 9 outcomes relevant to men considering chemoprevention. Better models based on more predictive markers are needed for some of the endpoints but the current metagram demonstrates potential as a tool for patient counseling and decision-making that is accessible, intuitive, and clinically relevant.
prostatic neoplasms; nomogram; chemoprevention; prediction
To compare the predictive performance and potential clinical usefulness of risk calculators of the European Randomized Study of Screening for Prostate Cancer (ERSPC RC) with and without information on prostate volume.
We studied 6 cohorts (5 European and 1 US) with a total of 15,300 men, all biopsied and with pre-biopsy TRUS measurements of prostate volume. Volume was categorized into 3 categories (25, 40, and 60 cc), to reflect use of digital rectal examination (DRE) for volume assessment. Risks of prostate cancer were calculated according to a ERSPC DRE-based RC (including PSA, DRE, prior biopsy, and prostate volume) and a PSA + DRE model (including PSA, DRE, and prior biopsy). Missing data on prostate volume were completed by single imputation. Risk predictions were evaluated with respect to calibration (graphically), discrimination (AUC curve), and clinical usefulness (net benefit, graphically assessed in decision curves).
The AUCs of the ERSPC DRE-based RC ranged from 0.61 to 0.77 and were substantially larger than the AUCs of a model based on only PSA + DRE (ranging from 0.56 to 0.72) in each of the 6 cohorts. The ERSPC DRE-based RC provided net benefit over performing a prostate biopsy on the basis of PSA and DRE outcome in five of the six cohorts.
Identifying men at increased risk for having a biopsy detectable prostate cancer should consider multiple factors, including an estimate of prostate volume.
PSA; Risk; Prostate cancer; Prostate volume; Calibration; Net benefit
Sulfonylureas have historically been analyzed as a medication class, which may be inappropriate given the differences in properties inherent to the individual sulfonylureas (hypoglycemic risk, sulfonylurea receptor selectivity, and effects on myocardial ischemic preconditioning). The purpose of this study was to assess the relationship of individual sulfonylureas and the risk of overall mortality in a large cohort of patients with type 2 diabetes.
RESEARCH DESIGN AND METHODS
A retrospective cohort study was conducted using an academic health center enterprise-wide electronic health record (EHR) system to identify 11,141 patients with type 2 diabetes (4,279 initiators of monotherapy with glyburide, 4,325 initiators of monotherapy with glipizide, and 2,537 initiators of monotherapy with glimepiride), ≥18 years of age with and without a history of coronary artery disease (CAD) and not on insulin or a noninsulin injectable at baseline. The patients were followed for mortality by documentation in the EHR and Social Security Death Index. Multivariable Cox models were used to compare cohorts.
No statistically significant difference in the risk of overall mortality was observed among these agents in the entire cohort, but we did find evidence of a trend toward an increased overall mortality risk with glyburide versus glimepiride (hazard ratio 1.36 [95% CI 0.96–1.91]) and glipizide versus glimepiride (1.39 [0.99–1.96]) in those with documented CAD.
Our results did not identify an increased mortality risk among the individual sulfonylureas but did suggest that glimepiride may be the preferred sulfonylurea in those with underlying CAD.
To design a decision-support tool to facilitate evidence-based treatment decisions in clinically localized prostate cancer, as individualized risk assessment and shared decision-making can decrease distress and decisional regret in patients with prostate cancer, but current individual models vary or only predict one outcome of interest.
We searched Medline for previous reports and identified peer-reviewed articles providing pretreatment predictive models that estimated pathological stage and treatment outcomes in men with biopsy-confirmed, clinical T1-3 prostate cancer. Each model was entered into a spreadsheet to provide calculated estimates of extracapsular extension (ECE), seminal vesicle invasion (SVI), and lymph node involvement (LNI). Estimates of the prostate-specific antigen (PSA) outcome after radical prostatectomy (RP) or radiotherapy (RT), and clinical outcomes after RT, were also entered. The data are available at http://www.capcalculator.org.
Entering a patient’s 2002 clinical T stage, Gleason score and pretreatment PSA level, and details from core biopsy findings, into the CaP Calculator provides estimates from predictive models of pathological extent of disease, four models for ECE, four for SVI and eight for LNI. The 5-year estimates of PSA relapse-free survival after RT and 10-year estimates after RP were available. A printout can be generated with individualized results for clinicians to review with each patient.
The CaP Calculator is a free, online ‘clearing house’ of several predictive models for prostate cancer, available in an accessible, user-friendly format. With further development and testing with patients, the CaP Calculator might be a useful decision-support tool to help doctors promote evidence-based shared decision-making in prostate cancer.
prostate cancer; decision support; surgery; radiotherapy; shared decision-making