|Home | About | Journals | Submit | Contact Us | Français|
Point-of-care practice audits allow documentation of procedural outcomes to support quality improvement in endoscopic practice.
To evaluate a colonoscopists’ practice audit tool that provides point-of-care data collection and peer-comparator feedback.
A prospective, observational colonoscopy practice audit was conducted in academic and community endoscopy units for unselected patients undergoing colonoscopy. Anonymized colonoscopist, patient and practice data were collected using touchscreen smart-phones with automated data upload for data analysis and review by participants. The main outcome measures were the following colonoscopy quality indicators: colonoscope insertion and withdrawal times, bowel preparation quality, sedation, immediate complications and polypectomy, and biopsy rates.
Over a span of 16 months, 62 endoscopists reported on 1279 colonoscopy procedures. The mean cecal intubation rate was 94.9% (10th centile 84.2%). The mean withdrawal time was 8.8 min and, for nonpolypectomy colonoscopies, 41.9% of colonoscopists reported a mean withdrawal time of less than 6 min. Polypectomy was performed in 37% of colonoscopies. Independent predictors of polypectomy included the following: endoscopy unit type, patient age, interval since previous colonoscopy, bowel preparation quality, stable inflammatory bowel disease, previous colon polyps and withdrawal time. Withdrawal times of less than 6 min were associated with lower polyp removal rates (mean difference −11.3% [95% CI −2.8% to −19.9%]; P=0.01).
Cecal intubation rates exceeded 90% and polypectomy rates exceeded 30%, but withdrawal times were frequently shorter than recommended. There are marked practice variations consistent with previous observations.
Real-time, point-of-care practice audits with prompt, confidential access to outcome data provide a basis for targeted educational programs to improve quality in colonoscopy practice.
Les vérifications de la pratique au chevet du patient permettent de consigner l’issue de l’intervention afin de favoriser l’amélioration de la qualité en endoscopie.
Évaluer l’outil de vérification de la pratique d’un coloscopiste qui permet de colliger les données au chevet du patient et d’obtenir des comparatifs avec les collègues.
Les chercheurs ont procédé à la vérification prospective et par observation de la pratique de coloscopie dans des unités d’endoscopie universitaires et communautaires auprès de patients non sélectionnés qui subissaient une coloscopie. Ils ont colligé des données anonymisées sur le coloscopiste, le patient et la pratique au moyen de téléphones tactiles intelligents dotés d’un téléchargement automatisé des données en vue de leur analyse et de leur examen par les participants. Les principales mesures d’issue étaient constituées des indicateurs de qualité suivants de la coloscopie : durée d’insertion et de retrait du coloscope, qualité de la préparation intestinale, sédation, complications immédiates, taux de polypectomies et de biopsies.
En l’espace de 20 mois, 62 coloscopistes ont fait le compte rendu de 1 279 coloscopies. Le taux d’intubation cæcale moyen était de 94,9 % (10e centile 84,2 %). Le taux de retrait moyen était de 8,8 minutes et, dans le cas des coloscopies sans polypectomies, 41,9 % des coloscopistes déclaraient un taux de retrait moyen de moins de 6 minutes. Des polypectomies accompagnaient 37 % des coloscopies. Les prédicteurs indépendants de polypectomie incluaient le type d’unité d’endoscopie, l’âge du patient, l’intervalle depuis la coloscopie précédente, la qualité de la préparation intestinale, une maladie inflammatoire de l’intestin stable, des polypes antérieurs du côlon et le délai de retrait. Un délai de retrait de moins de 6 minutes s’associait à un taux de retrait de polypes moins élevé (différence moyenne −11,3 % [95 % IC −2,8 % à −19,9 %]; P=0,01).
EXPOSÉ : Les taux d’intubation cæcale étaient supérieurs à 90 % et les taux de polypectomie, supérieurs à 30 %, mais les délais de retrait étaient souvent plus courts que ne l’indiquent les recommandations. Conformément aux observations antérieures, on constate des variations marquées de la pratique.
La vérification de la pratique de coloscopie au chevet du patient en temps réel assurant un accès confidentiel et rapide aux données d’issues fournissait des assises pour donner des programmes de formation ciblée en vue d’améliorer la qualité des pratiques de coloscopie.
The advent of colon cancer screening has prompted many organizations (1–6) to identify specific colonoscopy quality indicators (such as appropriate surveillance interval, cecal intubation rate, adenoma detection rate, colonoscope withdrawal time, quality of colon preparation, sedation and assistants’ experience) that are considered to be clinically relevant (7–11) and easily measurable (5,6). Quality improvement requires these indicators to be measured and linked to educational interventions that enable individual endoscopists or institutions to correct identified deficiencies.
Recognizing the critical importance of quality outcomes for endoscopy, the Canadian Association of Gastroenterology (CAG) developed credentialing guidelines (6,12) and practice audit methods (13–15) to support quality improvement in clinical endoscopic practice.
The aims of the present study were to audit colonoscopists’ practice using a novel, point-of-care data collection method and to compare the results with those of a previous practice audit program (13). Prompt, anonymous, peer-comparator feedback would then enable the identification of practice gaps, the provision of targeted educational programs and subsequent re-evaluation of endoscopic practice.
A steering committee with expertise in practice audit and quality programs oversaw the project with respect to concept development, practice audit logistics management, data reporting and data analysis. No patient identifiers were required (13–15); therefore, the study was deemed to be a quality assurance program and, thus, did not require formal research ethics board approval.
Endoscopists at 19 Canadian centres audited colonoscopies over periods of at least two weeks using data collection software on a touch-screen smartphone (Treo 650, Palm Inc, Canada) linked to a secure website (ReForm XT, Goanyware Software, USA). The smartphones displayed only one question per screen and, in most cases, all text was visible without scrolling. After confirmed completion of data entry for each patient, data were saved and uploaded immediately if network access was available; otherwise, data were uploaded automatically when network access was re-established.
After descriptive analysis and verification, summary data were displayed at a password-protected website (ECD Solutions, USA) enabling participants to compare their data with other participants’ aggregate data (Figure 1). The start and end times of each participant’s website access, and the pages visited were tracked. Participants could download a record of accredited educational hours spent evaluating or reflecting on their audit (16).
Participants’ baseline personal data including age, practice type and years in practice (Table 1) were entered only once and linked to all subsequent practice audit data. Participants were required to answer all questions on a ‘screen’ before advancing; they could only select one answer for a question unless it had been marked as ‘select all that apply’.
Practice audit data could be collected only at the time of the procedure; anonymized data were collected on the reason for colonoscopy (‘investigation of abnormality’, ‘screening’ or ‘surveillance’), specific indications, the time elapsed since referral and consultation (‘wait times’), the duration of the procedure, preparation quality (using the Ottawa bowel preparation scale ), sedation and any interventions (Table 2). For procedure times, participants or an assistant tapped the touch screen to indicate the time when the following occurred: the colonoscope entered the rectum; the cecum (or furthest point in the colon) was reached; withdrawal was started; and the colonoscope was withdrawn completely.
Uploaded data were reviewed for validity and plausibility. Invalid data included the following: insertion or withdrawal times of less than 30 s; wait times from referral or consultation if the consultation date preceded the referral date, if the procedure date preceded the consultation or referral dates, or if the referral or consultation dates were ‘out of range’. ‘Out of range’ dates occurred when the default date (procedure date) had not been reset or had been entered as ‘1999’ because the referral or consultation dates were unavailable.
Results were presented as mean or median values with 95% CIs or 10th, 25th and 75th centile values, as appropriate. Multivariate logistic regression analysis (SAS version 9.2, SAS Institute Inc, USA) identified independent predictors of colonoscopy withdrawal times (using logarithmic transforms of withdrawal times) and polyp removal rates. Results were presented as the least squares means of withdrawal times (including 95% CIs); polyp removal (none versus one or more) was used as the response for multiple logistic regression analysis. Multiple comparison adjustment was applied for all pair-wise comparisons.
From February 2008 to June 2009, 62 endoscopists (Nova Scotia [n=5], Quebec [n=6], Ontario [n=21], Manitoba [n=4], Saskatchewan [n=14], Alberta [n=9] and British Columbia [n=3]; 46 gastroenterologists and 16 surgeons) from 19 centres audited 1279 colonoscopy procedures (mean 20.6 procedures per participant). More participants (69.4%) practised in an academic- versus a community-based hospital setting (30.6%); 9.7% of participants also practised in another setting (eg, a private out-of-hospital clinic). Participants’ experience (ie, years in practice) was recorded as less than five years (29.0%), six to 10 years (16.1%), 11 to 20 years (35.5%) and more than 20 years (17.7%). Data regarding insertion times were invalid for 55 procedures (4.3%) and on wait times from referral for 88 procedures (6.9%). Patients’ age ranged from 18 to 40 years (9.8%), 41 to 50 years (16.7%), 51 to 60 years (31.5%) and 61 to 70 years (24.9%), to older than 70 years of age (17.0%). The most common indications (Figure 2) were a family history of colon cancer (21.7%) and a history of gastrointestinal blood loss or anemia (21.4%); a positive fecal occult blood test was the indication for only 3.8% of procedures. Overall, 577 procedures (45.1%) were performed for the investigation of abnormal symptoms and/or signs, or previous test abnormalities, 475 (37.1%) for colon cancer screening and 227 (17.7%) for surveillance.
Most patients received sedation: 96.5% received a benzodiazepine with or without an opiate, while 2.0% received propofol and 1.5% received no sedation. Bowel preparation was excellent (Ottawa bowel scale score of less than 5) in 75.6% of cases. Immediate complications were reported for nine cases (0.7%) including respiratory problems (n=4), bleeding (n=3), perforation (n=1) and cardiac problems (n=1).
The mean intubation rate for the cecum or ileum was 94.9% (median 97.5%), and 43.3% (43.4%) for the ileum. Mean cecal intubation rates ranged from 93.5% (investigation of abnormality) and 95.5% (screening) to 96.6% (surveillance). The 10th centile for cecal intubation was 84.2% (ie, 10% of participants had a mean cecal intubation rate below 85%), ranging from 78.9% (investigation of abnormality) and 90.9% (screening) to 83.3% (surveillance). Mean ileal intubation rates varied among provinces (Figure 3) but not with respect to the reason for colonoscopy (data not shown).
Overall, the mean withdrawal time was 8.8 min (median 7.9 min); mean withdrawal times were longer for patients who underwent polypectomy (12.0 min; median 10.9 min) than for those who did not (6.8 min; median 6.3 min). For nonpolypectomy procedures, 26 participants (41.9%) recorded a mean withdrawal time of less than 6 min; in the same procedures, the median of the mean withdrawal times was 6.3 min (Figure 4) and the 10th centile was 4.0 min (ie, 10% of participants reported a mean withdrawal time of 4 min or less).
Multiple logistic regression analysis (1185 colonoscopies with valid data) identified eight variables associated with a difference in withdrawal time (Table 3): the reason for colonoscopy(P<0.0001), years in specialist practice(P=0.0002), patient age (P=0.0317), bowel preparation quality (P<0.0001), propofol sedation (P=0.0358), furthest extent of examination (P<0.0001), the number of polyps removed (P<0.0001) and stable inflammatory bowel disease (IBD) (P=0.0492). In addition, there were five significant interaction effects: years in specialist practice according to reason for colonoscopy (P=0.0088); reason for colonoscopy according to stable IBD (P<0.0001); preparation quality according to propofol sedation (P=0.0135); furthest extent of examination according to biopsies taken (P=0.0023); and the number of polyps removed according to biopsies taken (P<0.0001).
Overall, the mean percentage of colonoscopies performed by each endoscopist involving one or more polypectomies was 37.0% (median 34.0%) (Figure 4), and the mean number of polypectomies was 0.9 (median 0.7) for all procedures and 2.2 (median 2.0) for procedures in which at least one polyp was removed. However, 10% of participants reported polypectomy in 13.3% or fewer of their colonoscopies (Figure 5). Multiple logistic regression analysis (1177 colonoscopies with valid data) identified the following seven variables that were significantly associated with differences in polypectomy rates (Table 4): centre type (P<0.004), patient age (P<0.0001), interval since most recent colonoscopy (P<0.0001), bowel preparation quality (P<0.02), stable IBD (P<0.02), history of previous colon polyps (P<0.0001) and shorter withdrawal times (P<0.0001). In addition, there was one significant interaction effect: withdrawal time according to family history of colon cancer (P<0.004). For patients with a family history of colon cancer, the OR for polypectomy was 1.536 (95% CI 1.348 to 1.749) per 1 min increase in withdrawal time while, for those with no family history, the OR was 1.257 (95% CI 1.204 to 1.312).
More prolonged withdrawal times for nonpolypectomy procedures were associated with polypectomy in a greater proportion of colonoscopies (Figure 6). Participants (n=26) who had a mean (± SD) withdrawal time of shorter than 6 min (4.57±1.27 min) for procedures when they did not remove a polyp had a lower polyp removal rate (29.3±17.3% versus 40.7±15.9%; P=0.01; mean difference −11.3% [95% CI −2.8 to −19.9%]) than participants (n=35) who had a mean withdrawal time of 6 min or longer (8.43±3.24 min) for nonpolypectomy procedures.
The overall mucosal biopsy rate (32.4%) did not differ with respect to polypectomy, but was markedly lower for screening colonoscopies than for colonoscopies investigating abnormal signs or symptoms, or for surveillance (Figure 7).
The present prospective, multicentre, national program demonstrated the feasibility of point-of-care practice audit (13), and provided baseline data on widely endorsed colonoscopy quality indicators (2–6). These data will support repeat peer-comparator programs for quality improvement in gastroenterology and endoscopy allied to personal continuing professional development. The current study was smaller than the earlier study (13); however, it represented approximately 5% of practising Canadian endoscopists (18). The higher proportion of screening colonoscopies in the current study (37% versus 25% ) was probably due to the increase in colorectal cancer screening across Canada.
These results identify several indicators that are amenable to intervention and improvement. Only 73% of bowel preparations were rated as excellent (17), indicating the need for improved bowel preparation strategies. The mean cecal intubation rate (94.9%) increased slightly from 92% (13) but, although it appears acceptable (2–4), 10% of participants reported a mean rate of less than 85%. Ileal intubation rates were higher (43.3%) than previously reported (29.1% ) but, unlike mucosal biopsy rates, provincial variations did not appear to be related to the reason for colonoscopy.
The mean withdrawal time of 8.8 min exceeded recommendations (longer than 6 min [8,9]), but 38.7% of participants reported shorter withdrawal times for procedures during which they did not remove polyps and this was associated, as in previous studies (8), with lower polypectomy rates. Polypectomy, rather than adenoma confirmation or polyp detection, was used as an outcome measure to ensure documentation of clinically relevant lesions while avoiding delays needed to assure adenoma confirmation; the reported rates suggest that polypectomy is comparable with these other measures as a surrogate end point.
The nonlinear relationship between experience and withdrawal time suggests a complex interaction among clinical judgment, technical expertise and practice pressures that may be difficult to modify. Other predictors of withdrawal time, such as the choice of bowel preparation and sedation, are modifiable and should respond to an educational intervention. The identification of outcome predictors does not confirm a causal relationship, but it may indicate why practice and outcomes differ with respect to centre type, colonoscopy indication, bowel preparation adequacy and withdrawal time.
The results of the present study are open to bias because the procedures were selected by the participant and the data were self-reported. However, the outcome of the procedure was unknown when data entry began, thus limiting the participant’s ability to select favourable cases. Bias arising from self-reporting was, perhaps, lessened because data were known to be confidential; additionally, in many cases, procedural data were recorded or confirmed by an endoscopy nurse to reduce the risk of bias.
Ideally, practice audits should include data on delayed adverse events and adenoma detection rates; however, this would have required delayed data entry, including patient identifiers, which is incompatible with point-of-care data collection. Data from national registries such as the Clinical Outcomes Research Initiative (USA) (19) suggest that 30-day complication rates for screening and surveillance colonoscopy are very low (20); thus, the reporting requirements for delayed events are inconsistent with the present type of practice audit.
The strengths of the reported methodology are its rapidity, simplicity and ability to collect real-time data with low infrastructure costs. The questionnaire content and format were managed entirely by the investigators and the cost per completed questionnaire was less than US$1.00 (ReForm XT, GoAnyWare Solutions, USA). Questionnaire data were in a standard format, suitable for automated analysis and display at a secure, password-protected, independent website providing rapid practice audit feedback to participants.
The present study indicated that practising colonoscopists were willing and able to undertake practice audit using a flexible, low-cost, platform-independent methodology. The data do not constitute an outcomes registry such as the Clinical Outcomes Research Initiative (19) or an epidemiological study – the case mix depends on the participating physicians and there is no independent data verification. However, the validity of the data is supported by the finding that the results were broadly similar to those of a previous national program (13) and by the finding that shorter withdrawal times are associated with lower polyp removal rates (8,9).
Although practice audit enables quality improvement and continuing professional development, it does pose challenges. If participants accept that their performance (eg, cecal intubation rates) is suboptimal, it is not clear who should provide, fund or evaluate their remediation. If, on the other hand, participants do not accept that their outcomes (eg, ileal intubation, mucosal biopsy and polypectomy rates) are inappropriate (21–23), it is not clear who should set the appropriate standards.
Overall, performance in the present audit appeared acceptable but some individuals’ performance indicators fell below the norm. Practice audit enables these individuals to confidentially identify their own needs and to seek remedies without stigma. Practice audit also documents systematic differences in practice differences, for example, with respect to ileal intubation or sedation (13). These needs assessments for individuals and national groups provide a basis for the development of targeted education programs and national guidelines.
Point-of-care, peer-comparator colonoscopy practice audit is suitable for other areas of practice (eg, Barrett’s esophagus or IBD) and for other health care professionals in different practice settings. In the future, other information technology systems may improve on the current methodology but, for the present, this approach provides a standard, widely available platform to collect and analyze practice audit data using existing technology at a relatively low cost, with minimal reliance on local legacy institutional technology and resources.
What is already known about this topic:
What the present study adds to our knowledge:
The authors acknowledge Joanne Cabrera RN for her participation in the QiG-E steering committee and the Canadian Association of Gastroenterology for its continued support of the practice audit program.