Implementation of automated reporting of estimated glomerular filtration rate among Veterans Affairs laboratories: a retrospective study

doi:10.1186/1472-6947-12-69

BMC Med Inform Decis Mak. 2012; 12: 69.

Published online 2012 July 12. doi: 10.1186/1472-6947-12-69

PMCID: PMC3441329

Implementation of automated reporting of estimated glomerular filtration rate among Veterans Affairs laboratories: a retrospective study

Rasheeda K Hall,^1,² Virginia Wang,^1,² George L Jackson,^1,² Bradley G Hammill,² Matthew L Maciejewski,^1,² Elizabeth M Yano,^3,⁴ Laura P Svetkey,^2,⁵ and Uptal D Patel^1,^2,⁶

¹Center for Health Services Research in Primary Care, Veterans Affairs Health Services Research & Development, Durham, NC, USA

²Department of Medicine, Duke University School of Medicine, Durham, NC, USA

³Center for the Study of Healthcare Provider Behavior, Veterans Affairs Health Services Research & Development, Sepulveda, CA, USA

⁴Department of Health Services, University of California at Los Angeles, Los Angeles, CA, USA

⁵Sarah W. Stedman Nutrition and Metabolism Center, Duke University Medical Center, Durham, NC, USA

⁶Duke Clinical Research Institute, Duke University School of Medicine, Durham, NC, USA

Corresponding author.

Rasheeda K Hall: rasheeda.stephens/at/dm.duke.edu; Virginia Wang: virginia.wang/at/dm.duke.edu; George L Jackson: george.l.jackson/at/dm.duke.edu; Bradley G Hammill: brad.hammill/at/dm.duke.edu; Matthew L Maciejewski: matthew.maciejewski/at/duke.edu; Elizabeth M Yano: elizabeth.yano/at/va.gov; Laura P Svetkey: laura.svetkey/at/dm.duke.edu; Uptal D Patel: uptal.patel/at/dm.duke.edu

Received November 21, 2011; Accepted June 25, 2012.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Automated reporting of estimated glomerular filtration rate (eGFR) is a recent advance in laboratory information technology (IT) that generates a measure of kidney function with chemistry laboratory results to aid early detection of chronic kidney disease (CKD). Because accurate diagnosis of CKD is critical to optimal medical decision-making, several clinical practice guidelines have recommended the use of automated eGFR reporting. Since its introduction, automated eGFR reporting has not been uniformly implemented by U. S. laboratories despite the growing prevalence of CKD. CKD is highly prevalent within the Veterans Health Administration (VHA), and implementation of automated eGFR reporting within this integrated healthcare system has the potential to improve care. In July 2004, the VHA adopted automated eGFR reporting through a system-wide mandate for software implementation by individual VHA laboratories. This study examines the timing of software implementation by individual VHA laboratories and factors associated with implementation.

Methods

We performed a retrospective observational study of laboratories in VHA facilities from July 2004 to September 2009. Using laboratory data, we identified the status of implementation of automated eGFR reporting for each facility and the time to actual implementation from the date the VHA adopted its policy for automated eGFR reporting. Using survey and administrative data, we assessed facility organizational characteristics associated with implementation of automated eGFR reporting via bivariate analyses.

Results

Of 104 VHA laboratories, 88% implemented automated eGFR reporting in existing laboratory IT systems by the end of the study period. Time to initial implementation ranged from 0.2 to 4.0 years with a median of 1.8 years. All VHA facilities with on-site dialysis units implemented the eGFR software (52%, p<0.001). Other organizational characteristics were not statistically significant.

Conclusions

The VHA did not have uniform implementation of automated eGFR reporting across its facilities. Facility-level organizational characteristics were not associated with implementation, and this suggests that decisions for implementation of this software are not related to facility-level quality improvement measures. Additional studies on implementation of laboratory IT, such as automated eGFR reporting, could identify factors that are related to more timely implementation and lead to better healthcare delivery.

Background

Since its development, automated laboratory reporting of estimated glomerular filtration rate (eGFR) has facilitated diagnosis and management of chronic kidney disease (CKD) [1]. To report eGFR, clinical laboratories implement software that calculates eGFR from equations based on serum creatinine and demographic variables. As a result, clinicians who receive laboratory reports of eGFR in addition to serum creatinine may make more informed clinical decisions. The importance of automated eGFR reporting was established by National Kidney Foundation clinical guidelines in 2002, and, later, endorsed by the National Kidney Disease Education Program and International Society of Nephrology in subsequent years [2-4]. Despite these endorsements, automated eGFR reporting uptake has been slow; only 40% of U.S. clinical laboratories had eGFR reporting software by 2007 [5]. In other words, more than half of US laboratories had not implemented eGFR reporting by 2007, and physicians served by those laboratories may have missed opportunities for early detection of CKD. Because of the complications associated with late detection of CKD and increasing prevalence of CKD [6,7], it is important to understand the mechanisms associated with implementation of automated eGFR reporting. Implementation of automated eGFR reporting could be explained by organizational characteristics [8], but that relationship has not been studied to date.

For clinicians within the Veterans Health Administration (VHA), detection of CKD is important because the prevalence of CKD among veterans is expected to grow due to aging and increasing prevalence of diabetes and hypertension [6]. To enhance detection and management of CKD, the VHA adopted system-wide automated eGFR reporting by providing a software patch for existing laboratory information technology (IT) systems in 2004. The software patch was programming code that enabled each laboratory’s IT system to calculate eGFR with the Modification of Diet in Renal Disease (MDRD) equation and report eGFR values with every serum creatinine. To implement automated eGFR reporting, each laboratory had to install and activate the software patch. Although software patch implementation is typically issued as a mandate, for unclear reasons, implementation of this patch was left to the discretion of individual laboratories. Without a mandate or a central mechanism for simultaneous implementation in all laboratories, the VHA laboratories provide a natural experiment for observing implementation of automated eGFR reporting in a large, national, vertically-integrated healthcare system. Individual VHA laboratories may have rates of implementation of automated eGFR reporting that differ from non-VHA laboratories because the VHA is a highly integrated health system with a system-wide electronic health record and a strong reputation in quality performance [9]. This study examines the timing of implementation of automated eGFR reporting across the VHA. In addition, we sought to identify organizational characteristics that could explain the rate of implementation observed not only in the VHA, but also within laboratories in other healthcare systems.

Methods

Study Design and Population

We performed a retrospective observational study of VHA laboratories and their affiliated clinical facilities. The study population was derived from VHA community-based outpatient clinics (CBOCs) or Veteran Affairs medical centers (VAMCs) with available laboratory data between July 2004 and September 2009. VHA facilities that did not have complete laboratory and organizational data, or were not independent VHA facilities (e.g., skilled nursing facilities, rehabilitation centers, and domiciliaries) were excluded. This study was approved by the Institutional Review Board of the Durham Veterans Affairs Medical Center.

Data Sources

Time to eGFR software implementation at each VHA laboratory was derived from administrative data in the VHA Decision Support System’s Laboratory Results National Data Extract (DSS-NDE) between July 2004 and September 2009. Each of the creatinine and eGFR laboratory results had an associated date on which the laboratory tests were measured. These dates were used to identify the presence and timing of eGFR implementation by VHA facility.

Organizational data come from several sources. The primary source of organizational data was the 2006 VHA Clinical Practice Organizational Survey-Chief of Staff Module (CPOS-COS survey), a survey of facility quality improvement (QI) characteristics and activities. Survey items were carefully selected to match organizational domains of our conceptual model (Table (Table1).1). Additional organizational characteristics were obtained from VHA administrative data. Facility complexity was captured through the 2005 VHA Facility Complexity Score Model, maintained by the VHA National Leadership Board. VHA facilities with dialysis services were identified through clinic-specific utilization codes in the DSS-NDE.

Table 1

Domains, Definitions, and Variables of the Conceptual Model of Implementation of eGFR reporting

Measurement

We developed three eGFR implementation outcomes for each facility: 1) a dichotomous indicator of implementation status by September 2009; 2) time to initial implementation of automated eGFR reporting (between July 2004 and September 2009); and 3) time to full implementation of automated eGFR reporting (between July 2004 and September 2009). For time to initial implementation, time zero was defined as the date of VHA’s issued mandate for eGFR reporting to laboratory information managers (July 14, 2004). Based on administrative data, some facilities appeared to intermittently report eGFR values after time zero before consistently reporting eGFR per the mandate. Thus, initial implementation date was based on consistent eGFR reporting, with consistency attained when at least 1% of the median creatinine tests per month were accompanied by a reported eGFR. Time to full implementation was defined as the time between initial implementation and the day when at least 90% of median creatinine tests per month were accompanied by a reported eGFR. Lastly, facilities were categorized into implementation stages (early, mid, and late-stage) based on tertile distributions of time to initial implementation. Facilities that did not implement eGFR reporting by the end of our observation period were grouped separately.

To identify organizational characteristics associated with implementation of automated eGFR reporting, we selected a conceptual model that has been used in prior studies to evaluate organizational characteristics associated with implementing new clinical innovations within the VHA. We applied Van Deusen Lukas and colleagues’ conceptual model of implementation, which posits that implementation of a clinical innovation is influenced by 1) facility context, 2) implementation activities and structures, and 3) staff awareness and capabilities[10]. Then, we identified variables to match this conceptual model to test for association with implementation of automated eGFR reporting (Table (Table1).1). The facility context domain includes characteristics of each VHA facility, such as availability and demand for specific clinical services, which may affect implementation. The next domain, implementation activities and structures, assesses the use of methods that facilitate spread of implementation. Variables for this domain were CPOS-COS survey questions that measured methods for QI and clinical practice guideline implementation (Table (Table2).2). Each of the methods selected have been considered important facilitators of QI activities [11]. Other CPOS-COS survey QI activities were not included in our primary analysis because they did not seem relevant to implementation of automated eGFR reporting. Instead, these QI activities were included in a sum to assess for an association between total QI activities and implementation of automated eGFR reporting. The final domain of the conceptual model, staff awareness and capabilities, acknowledges that staff opinions on the implementation of automated eGFR reporting are important. Variables for this domain are derived from CPOS-COS survey questions (Table (Table22).

Table 2

Survey items extracted from the VHA clinical practice organizational survey chief of staff module

CPOS-COS survey questions were deliberately selected to match the domain definitions of the conceptual model. Although these questions are not specific to automated eGFR reporting, they have been validated for general QI innovations (unpublished data from co-author Elizabeth M. Yano). Data for each variable was obtained from Likert scale questions by collapsing four-level or five-level survey responses into dichotomous variables. The distribution of responses to the five-level survey questions was examined to classify the middle level responses into either dichotomous variable. As dichotomous variables, the survey responses were interpreted as the presence or absence of the organizational characteristics of interest.

Analysis

To detect variation in time to initial implementation and time to full implementation of eGFR reporting, we examined univariate distributions. To identify differences by implementation status and between implementation stages, we conducted ANOVA and t-tests for continuous variables and Chi-square or Fisher’s exact tests for categorical variables. We performed simple logistic regressions to determine the strength of association between each organizational characteristic and implementation of eGFR reporting. To test for association with time to implementation, survival analysis was performed using proportional hazards models. Variables forced into the multivariable regression model included presence of a dialysis unit, presence of nephrologists, and affiliation with an academic medical center. A backwards elimination procedure was performed to fit additional variables into the model if the significance level was less than 0.2. Nonparametric tests were applied when data were not normally distributed. Alpha levels for statistical significance were set at 0.05.

Results

Implementation Rates

Although we identified 135 eligible facilities, only 104 facilities had complete organizational data, so 31 facilities were excluded from the analyses. Of the 104 facilities included, 92 (88%) facilities implemented eGFR reporting by the end of the study period. Time to initial implementation varied widely, from 0.2 to 4.0 years (median=1.8 years) from the VHA’s initial mandate for adoption (Figure (Figure1).1). Among the excluded facilities, 18 of 31 (58%) implemented automated eGFR reporting with a similar median time to initial implementation (1.6 years), while the remaining facilities did not implement.

Figure 1

Proportion of Facilities that Implemented Automated eGFR Reporting over time. For the facilities that implemented automated eGFR reporting during the study period (n=92), this line plot depicts time to initial implementation measured in years from the (more ...)

After the initial implementation of eGFR reporting software, several months passed before eGFR values were automatically reported consistently with all creatinine results at many facilities. The median time between initial implementation and full implementation (defined as the time between initial implementation and the date when ≥90% of median creatinine tests were accompanied by a reported eGFR) was 0.8 years (IQR=0.42). By the end of the study period, 5 of the 92 facilities that initiated the software did not attain full implementation.

Organizational characteristics associated with implementation

Facility context was associated with implementation of automated eGFR reporting to some extent. Facilities operating a dialysis unit were more likely to implement automated eGFR reporting (52%, p<.001) (Table (Table3).3). However, implementation status was not associated with facility size (e.g., number of beds), facility complexity, presence of practicing nephrologists, or academic affiliation.

Table 3

Organizational characteristics by implementation status

Measures of implementation activities and structures were favorable for most VHA facilities. A majority of facilities (>85%) utilized clinical champions and monitoring of guideline implementation (general measure across conditions, not specific to CKD treatment), and there were no statistically significant differences by implementation status (p=0.60 and p=0.52, respectively) (Table (Table3).3). Similarly, the use of key implementation steps and collaboration between facilities were common for both facilities that implemented the software and facilities that did not implement (p=1.00 and p=0.70, respectively). Only a minority of facility chiefs of staff (29%) perceived adequacy of financial resources to support innovations, and this perception was similar in both groups (p=0.30). Regardless of implementation status, there was high use of QI activities, median=10 (maximum=11, IQR=3 for facilities that did implement, IQR=1.5 for facilities that did not implement, p=0.27). For measures of staff awareness and capabilities, resistance from primary care, subspecialists, and support staff as a barrier to QI was uncommon, and these measures also did not differ by implementation status (p=0.20, p=0.12, and p=0.59, respectively). Odds ratios (shown in Table

3) revealed no significant associations between the variables derived from the CPOS-COS survey and implementation of automated eGFR reporting.

To relate timing of implementation to organizational characteristics, facilities were categorized into stages of implementation, early, mid, or late stage with median time to implementation of 0.6, 1.8, and 3.2 years, respectively. In our examination of these stages, early stage facilities tended to be associated with more acute care beds, higher facility complexity scores, and more nephrology services compared to mid stage and late stage facilities (Table (Table4).4). However, none of these measures of facility context were significantly different between these groups or in a comparison of early and late stage facilities. In addition, there were no significant differences between facility stages for measures of implementation activities and structures (including total QI activities) and staff awareness and capabilities.

Table 4

Organizational characteristics by stage of initial implementation

Unadjusted hazard ratios of the organizational characteristics revealed no associations with time to implementation of automated eGFR reporting. In a multivariable model for time to implementation, “presence of teamwork for implementation” was retained in a model with three other variables (presence of dialysis unit, presence of nephrologist, and affiliation with academic medical center), although this organizational characteristic was not statistically significant in the full model.

Discussion

Despite an emphasis on quality performance and a system-wide electronic health record, implementation of automated eGFR reporting among VHA laboratories was incomplete and varied over many years following its adoption mandate. This wide variation could not be explained by facility-level organizational characteristics as there were no significant differences in these characteristics between the stages of implementation. There was only one significant difference by implementation status: presence of dialysis services was associated with implementation. Importantly, delayed or absent implementation of automated eGFR reporting could have translated into missed opportunities for earlier diagnoses of CKD among US veterans. Also, these findings illustrate that implementation of laboratory IT is not associated with level of healthcare system integration or presence of facility-level QI characteristics.

Rates of implementation of automated eGFR reporting have been evaluated in other studies. A survey from non-VHA settings in 2007 revealed that 40% of U.S. clinical laboratories reported eGFR with creatinine values in 2007 [5].That same year, the College of American Pathologists’ Annual Survey revealed eGFR reporting was used in approximately 50% of laboratories [12]. In the current study, we found that approximately 68% of VHA laboratories were reporting eGFR by 2007. Although these approximations of automated eGFR reporting usage were obtained by different methods, they all show a similar trend of incomplete implementation many years from initial software availability and consensus recommendations. This data suggests VHA laboratories had higher prevalence of automated eGFR reporting than non-VHA laboratories in 2007, and this may be explained by the VHA’s highly integrated healthcare system and electronic health record. Although when compared to another large integrated healthcare system, Alberta Health Services in Alberta, Canada, VHA laboratories had gradual implementation. In 2004, both healthcare systems adopted eGFR reporting software, but only Alberta Health Services had complete implementation of automated eGFR reporting software in its laboratories within that year [13]. Given that implementation of this innovation can vary regardless of system integration, more specific organizational characteristics likely explain this variation.

We sought to identify specific organizational characteristics that describe the variation in implementation of automated eGFR reporting within the VHA. Our analyses revealed that facilities that implemented the software were more likely to provide dialysis services than facilities that did not implement. In the VHA, facilities with dialysis units typically offer tertiary care services, and the demands of a more complex patient population and the better availability of financial resources in these facilities differs from facilities that provide only primary care services. As a result, the association of dialysis services to implementation of automated eGFR reporting suggests that presence of dialysis services may be highly correlated with one or all of the following: 1) presence of other resources in a facility, such as experienced laboratory information technology staff; 2) high demand to provide complex medical services (so facility is more apt to incorporate new innovations); or 3) efficient chain of command (facilities with dialysis units are larger and may incorporate more organizational hierarchy that promotes better accountability to tasks). Overall, the association of implementation of automated eGFR reporting and presence of dialysis services is consistent with previous research that indicates environmental barriers, such as lack of resources, may reduce provider adherence to clinical practice guidelines [14].

Aside from this finding, none of the other organizational characteristics were associated with implementation of automated eGFR reporting. These null results may have occurred because the variables used to describe the organizational domains of the conceptual model were only surrogate measures of implementation of automated eGFR reporting (Table (Table1).1). For example, the use of clinical champions is an important tool for implementation of healthcare innovations [15], and the CPOS-COS survey item for this variable was examined as a surrogate measure to determine whether use of clinical champions is important for implementation of automated eGFR reporting. All of the facilities reported similar frequencies in use of clinical champions for general QI initiatives. Although these similarities exist for general QI initiatives, the survey didn’t solicit the opinions of laboratory personnel to directly assess the use of clinical champions in implementation of automated eGFR reporting. As a result, the importance of clinical champions cannot be ruled out because our methods don’t include direct measurement of this variable. Similarly, all other organizational variables and domains from the conceptual model should be measured more directly before one concludes that there is no association with implementation of automated eGFR reporting. A similar survey distributed to laboratory personnel could provide more direct and specific assessment of these organizational variables. Not only that, direct query of laboratory decision-making processes or laboratory and IT leadership opinions, could provide more insight beyond the domains of this conceptual model.

We did not expect to find that none of the facility level characteristics from the CPOS-COS survey were associated with time to implementation of automated eGFR reporting. Intrinsic to our study design, we used the CPOS-COS survey for facility-level organizational variables because other similar studies demonstrated variable performance and practice patterns among VHA facilities that are related to facility- and clinic-level organizational characteristics [10,16-21]. We further justified use of the CPOS-COS survey because general QI characteristics can affect implementation of new innovations in individual facilities [22]. Conversely, our results show that general QI characteristics were not predictive of implementation of automated eGFR reporting. Automated eGFR reporting and other laboratory IT innovations are implemented differently from clinical innovations and are less affected by the extent of clinical QI infrastructure. This is an important lesson for future studies that attempt to assess the role facility-level organizational characteristics have in implementation of laboratory IT innovations.

This study has limitations that should be acknowledged. First, we did not assess laboratory-specific organizational characteristics for association with implementation of automated eGFR reporting. Without laboratory-specific variables, an explanation for the delayed implementation of automated eGFR reporting remains unclear. Second, we could not use verified start dates (of implementation) for each facility because of data transmission errors within the administrative data. As a result, we derived a definition for initiation of automated eGFR reporting that provided approximate dates of implementation. Last, the retrospective study design limited the data available for analysis of the process of software implementation. To counter this limitation, we utilized the 2006 CPOS-COS survey responses to obtain organizational characteristics that were measured within two years of the VHA’s initial adoption of automated eGFR reporting in 2004.

The wide variation in implementation of automated eGFR reporting in the VHA and other laboratories draws attention to the ongoing need for quality improvement in CKD management. Over the past decade, there has been interest in improving CKD identification, and automated eGFR reporting has been endorsed as a tool to enhance detection of CKD [2-4]. In fact, many studies, as described in a systematic review, have shown that automated eGFR reporting is associated with earlier detection of CKD [1]. Consequently, CKD detection may have been delayed in some VHA facilities as a result of the wide variation in implementation of automated eGFR reporting. This potential delay in diagnoses could be associated with disparate health outcomes between veterans who receive care at eGFR reporting facilities and those who do not. Specifically, late diagnosis of CKD leads to late nephrology referral which has been associated with increased mortality among those who progress to kidney failure [23]. Because of inconsistent implementation of automated eGFR reporting in other U.S. laboratories, disparate health outcomes may also exist outside the VHA. Given the growing prevalence of CKD, a concerted effort to enhance early detection and management of CKD remains important to prevent adverse outcomes and slow disease progression [6,24].

This study also has implications for future laboratory reporting innovations in nephrology. Although laboratories currently report eGFR from the MDRD equation, the MDRD equation may eventually be replaced by newer estimating equations, such as the Chronic Kidney Disease Epidemiology Collaboration (CKD-EPI) equation or estimates based on alternative biomarkers (e.g., cystatin-C) [25,26]. Alternative equations for estimation of GFR will necessitate the development and activation of additional software patches in clinical laboratories in the VHA and worldwide. Without a clear perspective on predictors of implementation, widespread implementation of additional eGFR reporting equations may be delayed.

Although we did not identify organizational characteristics clearly associated with rate of implementation of automated eGFR reporting, further investigation is warranted to inform implementation of future laboratory IT innovations which may lead to timely implementation and improved disease management. Future studies could include a qualitative analysis of facilities that did not implement automated eGFR reporting to reveal barriers to implementation. These barriers could be further evaluated prospectively with the implementation of similar laboratory IT. Additionally, an effort to develop a conceptual model specific for laboratory IT could enhance further implementation research.

Conclusions

There is evidence that VHA laboratories, in addition to non-VHA laboratories, demonstrated a variable rate of software implementation for automated eGFR reporting. The rationale for this remains unclear, and it may be explained by future studies that evaluate laboratory-specific organizational characteristics. Without better awareness of barriers to implementation of automated eGFR reporting, a similar pattern of implementation may occur with future laboratory IT innovations which may limit their effectiveness in medical decision-making.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

RH was responsible for study design, data collection, statistical analysis, interpretation of results, and manuscript preparation. VW participated in study design, interpretation of results, and revision of the manuscript. GJ participated in study design, interpretation of results, data acquisition, and revision of the manuscript. BH assisted with interpretation of results. MLM participated in study design and interpretation of results. EMY participated in study design, data acquisition, and interpretation of results. LS participated in study design and revision of the manuscript. UDP participated in study design, interpretation of results, and revision of the manuscript. All authors read and approved the final manuscript.

Disclaimer

The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the United States government.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6947/12/69/prepub

Acknowledgements

We thank Mrs. Lynn Van Scoyoc for her critical role in VHA data management and Chantelle Hardy and Hollis Weidenbacher for administrative support. Study data is based upon work supported by the Department of Veterans Affairs, Veterans Health Administration, Office of Research and Development: Department of Veterans Affairs Health Services Research and Development (VA HSR&D) Project No. 09–082 (EMY); Department of Veterans Affairs Office of Academic Affiliations Post-Doctoral Fellowship (VW); and VA HSRD Research Career Scientist Awards (05–195 (EMY); 10–391 (MLM)). This project was supported by NIH Grant No. K23 DK075929-04

W1 (UDP) and American Society of Nephrology Gottschalk Research Scholar Grant (UDP). This work was also supported by AHRQ Grant No. 1T32HS019490-01 (RH), and AHRQ Grant No. K12HS19479-01 (VW).

References

Kagoma YK, Weir MA, Iansavichus AV, Hemmelgarn BR, Akbari A, Patel UD, Garg AX, Jain AK. Impact of Estimated GFR Reporting on Patients, Clinicians, and Health-Care Systems: A Systematic Review. Am J Kidney Dis. 2011;57(4):592–601. doi: 10.1053/j.ajkd.2010.08.029. [PubMed] [Cross Ref]
K/DOQI clinical practice guidelines for chronic kidney disease. Evaluation, classification, and stratification. Am J Kidney Dis. 2002;39(2 Suppl 1):S1–266. [PubMed]
Hostetter T, Lising M. National Kidney Disease Education Program. J Am Soc Nephrol. 2003;14:S114–116. doi: 10.1097/01.ASN.0000070156.78824.C7. [PubMed] [Cross Ref]
Levey A, Eckardt K, Tsukamoto Y, Levin A, Coresh J, Rossert J, De Zeeuw DH, Hostetter TH, Lameire N, Eknoyan G. Definition and classification of chronic kidney disease: a Position statement from Kidney Disease: Improving Global Outcomes (KDIGO) Kidney Int. 2005;67(6):2089–2100. doi: 10.1111/j.1523-1755.2005.00365.x. [PubMed] [Cross Ref]
Accetta NA, Gladstone EH, DiSogra C, Wright EC, Briggs M, Narva AS. Prevalence of estimated GFR reporting among US clinical laboratories. Am J Kidney Dis. 2008;52(4):778–787. doi: 10.1053/j.ajkd.2008.05.023. [PMC free article] [PubMed] [Cross Ref]
Coresh J, Selvin E, Stevens LA, Manzi J, Kusek JW, Eggers P, Van Lente F, Levey AS. Prevalence of chronic kidney disease in the United States. JAMA. 2007;298(17):2038–2047. doi: 10.1001/jama.298.17.2038. [PubMed] [Cross Ref]
Kinchen KS, Sadler J, Fink N, Brookmeyer R, Klag MJ, Levey AS, Powe NR. The timing of specialist evaluation in chronic kidney disease and mortality. Ann Intern Med. 2002;137(6):479–486. [PubMed]
Lorenzi NM, Riley RT, Blyth AJ, Southon G, Dixon BJ. Antecedents of the people and organizational aspects of medical informatics: review of the literature. J Am Med Inform Assoc. 1997;4(2):79–93. doi: 10.1136/jamia.1997.0040079. [PMC free article] [PubMed] [Cross Ref]
Patel TG, Pogach LM, Barth RH. CKD screening and management in the Veterans Health Administration: the impact of system organization and an innovative electronic record. Am J Kidney Dis. 2009;53(3 Suppl 3):S78–85. [PubMed]
Lukas CV, Meterko MM, Mohr D, Seibert MN, Parlier R, Levesque O, Petzel RA. Implementation of a clinical innovation: the case of advanced clinic access in the Department of Veterans Affairs. J Ambul Care Manage. 2008;31(2):94–108. [PubMed]
Yano EM. The role of organizational research in implementing evidence-based practice: QUERI Series. Implement Sci. 2008;3:29. doi: 10.1186/1748-5908-3-29. [PMC free article] [PubMed] [Cross Ref]
Miller WG. Reporting estimated GFR: a laboratory perspective. Am J Kidney Dis. 2008;52(4):645–648. doi: 10.1053/j.ajkd.2008.07.032. [PubMed] [Cross Ref]
Hemmelgarn BR, Zhang J, Manns BJ, James MT, Quinn RR, Ravani P, Klarenbach SW, Culleton BF, Krause R, Thorlacius L. et al. Nephrology visits and health care resource use before and after reporting estimated glomerular filtration rate. JAMA. 2010;303(12):1151–1158. doi: 10.1001/jama.2010.303. [PubMed] [Cross Ref]
Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR. Why don't physicians follow clinical practice guidelines? A framework for improvement. Jama. 1999;282(15):1458–1465. doi: 10.1001/jama.282.15.1458. [PubMed] [Cross Ref]
Borbas C, Morris N, McLaughlin B, Asinger R, Gobel F. The role of clinical opinion leaders in guideline implementation and quality improvement. Chest. 2000;118(2 Suppl):24S–32S. [PubMed]
Jackson GL, Yano EM, Edelman D, Krein SL, Ibrahim MA, Carey TS, Lee SY, Hartmann KE, Dudley TK, Weinberger M. Veterans Affairs primary care organizational characteristics associated with better diabetes control. Am J Manag Care. 2005;11(4):225–237. [PubMed]
Kilbourne AM, Pincus HA, Schutte K, Kirchner JE, Haas GL, Yano EM. Management of mental disorders in VA primary care practices. Adm Policy Ment Health. 2006;33(2):208–214. doi: 10.1007/s10488-006-0034-6. [PubMed] [Cross Ref]
Schutte K, Yano EM, Kilbourne AM, Wickrama B, Kirchner JE, Humphreys K. Organizational contexts of primary care approaches for managing problem drinking. J Subst Abuse Treat. 2009;36(4):435–445. doi: 10.1016/j.jsat.2008.09.002. [PubMed] [Cross Ref]
Soban LM, Yano EM. The impact of primary care resources on prevention practices. J Ambul Care Manage. 2005;28(3):241–253. [PubMed]
Washington DL, Bean-Mayberry B, Mitchell MN, Riopelle D, Yano EM. Tailoring VA primary care to women veterans: association with patient-rated quality and satisfaction. Womens Health Issues. 2011;21(4 Suppl):S112–119. [PubMed]
Yano EM, Soban LM, Parkerton PH, Etzioni DA. Primary care practice organization influences colorectal cancer screening performance. Health Serv Res. 2007;42(3 Pt 1):1130–1149. [PMC free article] [PubMed]
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. doi: 10.1111/j.0887-378X.2004.00325.x. [PubMed] [Cross Ref]
Smart NA, Titus TT. Outcomes of early versus late nephrology referral in chronic kidney disease: a systematic review. Am J Med. 2011;124(11):1073–1080 e1072. doi: 10.1016/j.amjmed.2011.04.026. [PubMed] [Cross Ref]
Levin A, Stevens PE. Early detection of CKD: the benefits, limitations and effects on prognosis. Nat Rev Nephrol. 2011;7(8):446–457. doi: 10.1038/nrneph.2011.86. [PubMed] [Cross Ref]
Levey AS, Stevens LA, Schmid CH, Zhang YL, Castro AF, Feldman HI, Kusek JW, Eggers P, Van Lente F, Greene T. et al. A new equation to estimate glomerular filtration rate. Ann Intern Med. 2009;150(9):604–612. [PMC free article] [PubMed]
Stevens LA, Coresh J, Schmid CH, Feldman HI, Froissart M, Kusek J, Rossert J, Van Lente F, Bruce RD, Zhang YL. et al. Estimating GFR using serum cystatin C alone and in combination with serum creatinine: a pooled analysis of 3,418 individuals with CKD. Am J Kidney Dis. 2008;51(3):395–406. doi: 10.1053/j.ajkd.2007.11.018. [PMC free article] [PubMed] [Cross Ref]

Articles from BMC Medical Informatics and Decision Making are provided here courtesy of
BioMed Central