Rationale and Objectives

Clinical and contextual information associated with images may influence how radiologists draw diagnostic inferences, highlighting the need to control multiple sources of bias in the methodological design of investigations involving radiological interpretation. In the past, manual control methods to mask review films presented in practice have been used to reduce potential interpretive bias associated with differences between viewing images for patient care versus reviewing images for purposes of research, education, and quality improvement. These manual precedents from the film era raise the question whether similar methods to reduce bias can be implemented in the modern digital environment.

Materials and Methods

We built prototype “CreateAPatient” information technology for masking review case presentations within our institution’s production Radiology Information and Picture Archiving and Reporting Systems (RIS and PACS). To test whether CreateAPatient could be used to mask review images presented in practice, six board-certified radiologists participated in a pilot study. During pilot testing, seven digital chest radiographs, known to contain lung nodules and associated with fictitious patient identifiers, were mixed into the routine workload of the participating radiologists while they covered general evening call shifts. We tested whether it was possible to mask the presentation of these review cases, both by probing the interpreting radiologists to report detection and by conducting a forced-choice experiment on a separate cohort of 20 radiologists and information technology professionals.

Results

None of the participating radiologists reported awareness of review activity, and forced-choice detection was less than predicted at chance, suggesting radiologists were effectively blinded. In addition, we identified no evidence of review reports unsafely propagating beyond their intended scope or otherwise interfering with patient care, despite integration of these records within production electronic workflow systems.

Conclusion

Information technology can facilitate the design of unbiased methods involving professional review of digital diagnostic images.

The current array of PACS products and 3D visualization tools presents a wide range of options for applying advanced visualization methods in clinical radiology. The emergence of server-based rendering techniques creates new opportunities for raising the level of clinical image review. However, best-of-breed implementations of core PACS technology, volumetric image navigation, and application-specific 3D packages will, in general, be supplied by different vendors. Integration issues should be carefully considered before deploying such systems. This work presents a classification scheme describing five tiers of PACS modularity and integration with advanced visualization tools, with the goals of characterizing current options for such integration, providing an approach for evaluating such systems, and discussing possible future architectures. These five levels of increasing PACS modularity begin with what was until recently the dominant model for integrating advanced visualization into the clinical radiologist's workflow, consisting of a dedicated stand-alone post-processing workstation in the reading room. Introduction of context-sharing, thin clients using server-based rendering, archive integration, and user-level application hosting at successive levels of the hierarchy lead to a modularized imaging architecture, which promotes user interface integration, resource efficiency, system performance, supportability, and flexibility. These technical factors and system metrics are discussed in the context of the proposed five-level classification scheme.

Online social networking is an immature, but rapidly evolving industry of web-based technologies that allow individuals to develop online relationships. News stories populate the headlines about various websites which can facilitate patient and doctor interaction. There remain questions about protecting patient confidentiality and defining etiquette in order to preserve the doctor/patient relationship and protect physicians. How much social networking-based communication or other forms of E-communication is effective? What are the potential benefits and pitfalls of this form of communication? Physicians are exploring how social networking might provide a forum for interacting with their patients, and advance collaborative patient care. Several organizations and institutions have set forth policies to address these questions and more. Though still in its infancy, this form of media has the power to revolutionize the way physicians interact with their patients and fellow health care workers. In the end, physicians must ask what value is added by engaging patients or other health care providers in a social networking format. Social networks may flourish in health care as a means of distributing information to patients or serve mainly as support groups among patients. Physicians must tread a narrow path to bring value to interactions in these networks while limiting their exposure to unwanted liability.

Post-processing of volumetric data sets lands in a fuzzy boundary between the technologist and the radiologist. Is this the role of the technologist as part of image preparation? Or is it the beginning of the diagnostic process by the radiologist? Technology advances in real-time server side rendering platforms is challenging the traditional role of expensive dedicated advanced visualizations workstations with dedicated personnel. Will this also challenge the role of a dedicated 3D post-processing technologist?

Cloud computing has gathered significant attention from information technology (IT) vendors in providing massively scalable applications as well as highly managed remote services. What is cloud computing and how will it impact the medical IT market? Will the next generation of picture archiving and communication systems be leveraging cloud technology?

Many radiology information systems (RIS) cannot accept a final report from a dictation reporting system before the exam has been completed in the RIS by a technologist. A radiologist can still render a report in a reporting system once images are available, but the RIS and ancillary systems may not get the results because of the study’s uncompleted status. This delay in completing the study caused an alarming number of delayed reports and was undetected by conventional RIS reporting techniques. We developed a Web-based reporting tool to monitor uncompleted exams and automatically page section supervisors when a report was being delayed by its incomplete status in the RIS. Institutional Review Board exemption was obtained. At four imaging centers, a Python script was developed to poll the dictation system every 10 min for exams in five different modalities that were signed by the radiologist but could not be sent to the RIS. This script logged the exams into an existing Web-based tracking tool using PHP and a MySQL database. The script also text-paged the modality supervisor. The script logged the time at which the report was finally sent, and statistics were aggregated onto a separate Web-based reporting tool. Over a 1-year period, the average number of uncompleted exams per month and time to problem resolution decreased at every imaging center and in almost every imaging modality. Automated feedback provides a vital link in improving technologist performance and patient care without assigning a human resource to manage report queues.

The Picture Archiving and Communication System (PACS) market has been transformed by disruptive innovations from the information technology industry. The cost of storage alone has dropped by a factor of 100 within the past 10 years. Improvements in display, processing, and networking have likewise enabled PACS to be a capable replacement for film. The maturity of PACS has permeated the US healthcare industry from large academic hospitals to small outpatient imaging centers. Can PACS continue to be a platform for innovation or has it become a commodity?

Lesion segmentation involves outlining the contour of an abnormality on an image to distinguish boundaries between normal and abnormal tissue and is essential to track malignant and benign disease in medical imaging for clinical, research, and treatment purposes. A laser optical mouse and a graphics tablet were used by radiologists to segment 12 simulated reference lesions per subject in two groups (one group comprised three lesion morphologies in two sizes, one for each input device for each device two sets of six, composed of three morphologies in two sizes each). Time for segmentation was recorded. Subjects completed an opinion survey following segmentation. Error in contour segmentation was calculated using root mean square error. Error in area of segmentation was calculated compared to the reference lesion. 11 radiologists segmented a total of 132 simulated lesions. Overall error in contour segmentation was less with the graphics tablet than with the mouse (P < 0.0001). Error in area of segmentation was not significantly different between the tablet and the mouse (P = 0.62). Time for segmentation was less with the tablet than the mouse (P = 0.011). All subjects preferred the graphics tablet for future segmentation (P = 0.011) and felt subjectively that the tablet was faster, easier, and more accurate (P = 0.0005). For purposes in which accuracy in contour of lesion segmentation is of the greater importance, the graphics tablet is superior to the mouse in accuracy with a small speed benefit. For purposes in which accuracy of area of lesion segmentation is of greater importance, the graphics tablet and mouse are equally accurate.

Information technology teams in health care are tasked with maintaining a variety of information systems with complex support requirements. In radiology, this includes picture archive and communication systems, radiology information systems, speech recognition systems, and other ancillary systems. Hospital information technology (IT) departments are required to provide 24 × 7 support for these mission-critical systems that directly support patient care in emergency and other critical care departments. The practical know-how to keep these systems operational and diagnose problems promptly is difficult to maintain around the clock. Specific details on infrequent failure modes or advanced troubleshooting strategies may reside with only a few senior staff members. Our goal was to reduce diagnosis and recovery times for issues with our mission-critical systems. We created a knowledge base for building and quickly disseminating technical expertise to our entire support staff. We used an open source, wiki-based, collaborative authoring system internally within our IT department to improve our ability to deliver a high level of service to our customers. In this paper, we describe our evaluation of the wiki and the ways in which we used it to organize our support knowledge. We found the wiki to be an effective tool for knowledge management and for improving our ability to provide mission-critical support for health care IT systems.

Are we preparing future generations of physicians with the skills to practice in the information age? Has the health care IT industry matured to the stage that we can standardize training physicians in how to search and synthesize massive databases of clinical information and tease out complex diagnoses based upon scant information? Will literacy in information technology become a differentiator between physicians’ abilities? For the proposition of changing existing curriculum in medical schools to incorporate formal informatics training is Michael Chen, a second year medical student at the University of Maryland School of Medicine. Taking the opposing position is Nabile Safdar, M.D., assistant professor of radiology at the University of Maryland School of Medicines.

Are we preparing future generations of physicians with the skills to practice in the information age? Has the health care IT industry matured to the stage that we can standardize training physicians in how to search and synthesize massive databases of clinical information and tease out complex diagnoses based upon scant information? Will literacy in information technology become a differentiator between physicians’ abilities? For the proposition of changing existing curriculum in medical schools to incorporate formal informatics training is Michael Chen, a second year medical student at the University of Maryland School of Medicine. Taking the opposing position is Nabile Safdar, M.D., assistant professor of radiology at the University of Maryland School of Medicines.

It is clear that ubiquitous mobile computing platforms will be a disruptive technology in the delivery of healthcare in the near future. While radiologists are fairly sedentary, their customers, the referring physicians, and the patients are not. The need for closer collaboration and interaction with referring physicians is seen as a key to maintaining relationships and integrating tightly with the patient management team. While today, patients have to settle for their images on a CD, in short time, they will be taking them home on their cell phone. As PACS vendors are moving ever outward in the enterprise, they are already actively developing clients on mobile platforms. Two major contenders are the Apple’s iPhone and the Android platform developed by Google. These two designs represent two entirely different architectures and business models.

It is clear that ubiquitous mobile computing platforms will be a disruptive technology in the delivery of healthcare in the near future. While radiologists are fairly sedentary, their customers, the referring physicians, and the patients are not. The need for closer collaboration and interaction with referring physicians is seen as a key to maintaining relationships and integrating tightly with the patient management team. While today, patients have to settle for their images on a CD, in short time, they will be taking them home on their cell phone. As PACS vendors are moving ever outward in the enterprise, they are already actively developing clients on mobile platforms. Two major contenders are the Apple’s iPhone and the Android platform developed by Google. These two designs represent two entirely different architectures and business models.

The American Board of Imaging Informatics (ABII) was founded in 2005 by the Society of Imaging Informatics in Medicine (SIIM) and the American Registry of Radiologic Technologists (ARRT). ABII’s mission is to enhance patient care, professionalism, and competence in imaging informatics. This is accomplished primarily through the development and administration of a certification examination. The creation of the exam has been an exercise in open community involvement with SIIM providing access to the PACS community and ARRT providing skilled psychometric support to ensure a balanced and comprehensive examination. The process to generate the exam required several years and the efforts of dozens of subject matter experts active who volunteered to submit and validate questions for the examination. This article describes the organizational and statistical processes used to generate test items, assemble test forms, set performance standards, and validate test scores.

The American Board of Imaging Informatics (ABII) was founded in 2005 by the Society of Imaging Informatics in Medicine (SIIM) and the American Registry of Radiologic Technologists (ARRT). ABII’s mission is to enhance patient care, professionalism, and competence in imaging informatics. This is accomplished primarily through the development and administration of a certification examination. The creation of the exam has been an exercise in open community involvement with SIIM providing access to the PACS community and ARRT providing skilled psychometric support to ensure a balanced and comprehensive examination. The process to generate the exam required several years and the efforts of dozens of subject matter experts active who volunteered to submit and validate questions for the examination. This article describes the organizational and statistical processes used to generate test items, assemble test forms, set performance standards, and validate test scores.

Considerable debate within the medical community has focused on the optimal location of information technology (IT) support groups on the organizational chart. The challenge has been to marry local accountability and physician acceptance of IT with the benefits gained by the economies of scale achieved by centralized knowledge and system best practices. In the picture archiving and communication systems (PACS) industry, a slight shift has recently occurred toward centralized control. Radiology departments, however, have begun to realize that no physicians in any other discipline are as dependent on IT as radiologists are on their PACS. The potential strengths and weaknesses of centralized control of the PACS is the topic of discussion for this month’s Point/Counterpoint.

There is growing interest in bringing medical educational materials to the point of care. We sought to develop a system for just-in-time learning in radiology. A database of 34 learning modules was derived from previously published journal articles. Learning objectives were specified for each module, and multiple-choice test items were created. A web-based system—called TEMPO—was developed to allow radiologists to select and view the learning modules. Web services were used to exchange clinical context information between TEMPO and the simulated radiology work station. Preliminary evaluation was conducted using the System Usability Scale (SUS) questionnaire. TEMPO identified learning modules that were relevant to the age, sex, imaging modality, and body part or organ system of the patient being viewed by the radiologist on the simulated clinical work station. Users expressed a high degree of satisfaction with the system’s design and user interface. TEMPO enables just-in-time learning in radiology, and can be extended to create a fully functional learning management system for point-of-care learning in radiology.

This article defines and describes the numerous types of “clients” for picture archiving and communication systems (PACS). A radiologist uses a client to view images stored in the system. Many PACS are available in the market, and each offers different methods by which a client can view images from the server. The terminology used to describe these different methods can cause confusion and lead to poor choice for those imaging team members who are given the task of purchasing, implementing, and supporting the PACS. We propose a classification of clients with respect to their impact on client work stations, an effect often referred to as the application’s thickness. The thinner the client, the less effect it has on the hosting work station. In contrast, a thick client consumes the work station’s resources and often prevents a work station from being used to effectively run anything other than the client application. Functionality and supportability are highlighted as key and interacting metrics in determining optimal correct PACS solutions. The importance of a clear understanding of the needs and requirements of all users as well as the client application is emphasized. This relationship between supportability and functionality becomes increasingly important as the industry shifts to enterprise information technology solutions.

Rapid advances are changing the technology and applications of multidetector computed tomography (CT) scanners. The major increase in data associated with this new technology, however, breaks most commercial picture archiving and communication system (PACS) architectures by preventing them from delivering data in real time to radiologists and outside clinicians. We proposed a phased model for 3D workflow, installed a thin-slice archive and measured thin-slice data storage over a period of 5 months. A mean of 1,869 CT studies were stored per month, with an average of 643 images per study and a mean total volume of 588 GB/month. We also surveyed 48 radiologists to determine diagnostic use, impressions of thin-slice value, and requirements for retention times. The majority of radiologists thought thin slice was helpful for diagnosis and regularly used the application. Permanent storage of thin slice CT is likely to become best practice and a mission-critical pursuit for the health care enterprise.

The Digital Imaging and Communications in Medicine (DICOM) Validation Toolkit (DVTk) is an open-source framework with potential value for anyone working with the DICOM standard. DICOM’s flexibility requires hands-on experience in understanding ways in which the standard’s interpretation may vary among vendors. DVTk was developed as a clinical engineering tool to aid and accelerate DICOM integration at clinical sites. DVTk is used to provide an independent measurement of the accuracy of a product’s DICOM interface, according to both the DICOM standard and the product’s conformance statement. DVTk has stand-alone tools and a framework with which developers can create new tools. We provide an overview of the architecture of the toolkit, sample scenarios of its utility, and evidence of its relative ease of use. Our goal is to encourage involvement in this open-source project and attract developers to build off and further enrich this platform for DICOM integration testing.

Rapid prototyping is an important element in researching new imaging analysis techniques and developing custom medical applications. In the last ten years, the open source community and the number of open source libraries and freely available frameworks for biomedical research have grown significantly. What they offer are now considered standards in medical image analysis, computer-aided diagnosis, and medical visualization. A cursory review of the peer-reviewed literature in imaging informatics (indeed, in almost any information technology-dependent scientific discipline) indicates the current reliance on open source libraries to accelerate development and validation of processes and techniques. In this survey paper, we review and compare a few of the most successful open source libraries and frameworks for medical application development. Our dual intentions are to provide evidence that these approaches already constitute a vital and essential part of medical image analysis, diagnosis, and visualization and to motivate the reader to use open source libraries and software for rapid prototyping of medical applications and tools.